2024-02-16T10:17:33.369 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T10:17:33.370 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_cbodley@teuthology --name cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi --verbose --archive /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795 --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/orig.config.yaml 2024-02-16T10:17:33.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T10:17:33.491 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795 branch: wip-cbodley-testing description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7561795' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 0 sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBC6nXrM+OlF3aafwpMNs7Np4TJA+QMDswYRDat8a0+w4BFAI9SznJ3h29y3218fB+v5492vJ1qXn0H+yJ3oVI= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGzAcIUZ/qYTjP43Vy5kCT9OIQgki1Lv8KAzjb4Esofbb4K6FvArPg0VhO0gPDA6beK9BzhqGY4WJqswewmN6Wg= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:52:48 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-16T10:17:33.491 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa; will attempt to use it 2024-02-16T10:17:33.491 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks 2024-02-16T10:17:33.492 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-16T10:17:33.493 INFO:teuthology.task.internal:Checking packages... 2024-02-16T10:17:33.518 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6a4516ad3eca4b7cf7d93b64055992bfc2113285' 2024-02-16T10:17:33.518 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-16T10:17:33.518 INFO:teuthology.packaging:ref: None 2024-02-16T10:17:33.518 INFO:teuthology.packaging:tag: None 2024-02-16T10:17:33.518 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-02-16T10:17:33.518 INFO:teuthology.packaging:sha1: 6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:17:33.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley-testing 2024-02-16T10:17:33.825 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:17:33.827 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-16T10:17:33.832 INFO:teuthology.task.internal:no buildpackages task found 2024-02-16T10:17:33.832 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-16T10:17:33.839 INFO:teuthology.task.internal:Saving configuration 2024-02-16T10:17:33.851 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-16T10:17:33.857 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:17:33.881 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:11:54.941610', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHNCwubjYd03qkoCrxGEFqzlyt44AWy0e2jTfLlHC30U'} 2024-02-16T10:17:33.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:11:54.939710', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMH71nZfFG9gRMg4z+PPyeHmwG8LkVNfaWHt6RuqqbEw'} 2024-02-16T10:17:33.905 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-16T10:17:33.910 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-02-16T10:17:33.910 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-16T10:17:33.910 INFO:teuthology.run_tasks:Running task console_log... 2024-02-16T10:17:33.978 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f57e8555280>, signals=[15]) 2024-02-16T10:17:33.979 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-16T10:17:33.985 INFO:teuthology.task.internal:Opening connections... 2024-02-16T10:17:33.985 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-02-16T10:17:33.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:17:34.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:17:34.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:17:34.204 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-16T10:17:34.210 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-02-16T10:17:34.216 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-02-16T10:17:34.216 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-02-16T10:17:34.263 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-16T10:17:34.263 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-02-16T10:17:34.263 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-02-16T10:17:34.263 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-16T10:17:34.263 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-16T10:17:34.264 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-02-16T10:17:34.265 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-02-16T10:17:34.285 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-02-16T10:17:34.291 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-02-16T10:17:34.291 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-02-16T10:17:34.338 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-16T10:17:34.338 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-02-16T10:17:34.339 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-16T10:17:34.340 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-16T10:17:34.340 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-16T10:17:34.340 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-16T10:17:34.340 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-02-16T10:17:34.341 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-02-16T10:17:34.360 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-16T10:17:34.369 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-16T10:17:34.375 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-16T10:17:34.376 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-02-16T10:17:34.379 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-02-16T10:17:34.384 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-16T10:17:34.390 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-16T10:17:34.390 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-02-16T10:17:34.426 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-02-16T10:17:34.441 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-16T10:17:34.496 INFO:teuthology.run_tasks:Running task kernel... 2024-02-16T10:17:34.510 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-16T10:17:34.510 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-16T10:17:34.511 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T10:17:34.511 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-16T10:17:34.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:17:34.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:17:34.518 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-16T10:17:34.518 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-02-16T10:17:34.564 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-56-generic 2024-02-16T10:17:34.564 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.15.0-56-generic 2024-02-16T10:17:34.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-02-16T10:17:34.566 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-02-16T10:17:34.566 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-02-16T10:17:34.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-02-16T10:17:34.693 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-02-16T10:17:34.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-02-16T10:17:34.888 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:17:34.935 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-16T10:17:34.941 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-16T10:17:34.982 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:17:34.983 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-16T10:17:35.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-16T10:17:35.134 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-16T10:17:35.234 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-16T10:17:35.407 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-16T10:17:35.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-16T10:17:35.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [404 kB] 2024-02-16T10:17:35.437 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-16T10:17:35.527 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-16T10:17:35.532 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-16T10:17:35.533 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-16T10:17:35.534 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-16T10:17:35.548 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [570 kB] 2024-02-16T10:17:35.559 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-16T10:17:35.563 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:17:35.564 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-16T10:17:35.629 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-16T10:17:35.641 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-16T10:17:35.645 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-16T10:17:35.665 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-16T10:17:35.665 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-16T10:17:35.666 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-16T10:17:35.667 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-16T10:17:35.668 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-16T10:17:35.668 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-16T10:17:35.672 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-16T10:17:35.680 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-16T10:17:35.684 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,161 kB] 2024-02-16T10:17:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-16T10:17:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-16T10:17:35.704 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-16T10:17:35.705 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-16T10:17:35.706 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-16T10:17:35.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,377 kB] 2024-02-16T10:17:35.841 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-16T10:17:35.844 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [213 kB] 2024-02-16T10:17:35.855 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-16T10:17:35.856 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-16T10:17:35.858 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-16T10:17:35.858 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-16T10:17:35.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-16T10:17:35.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,401 kB] 2024-02-16T10:17:35.881 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-16T10:17:35.896 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-16T10:17:35.897 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,431 kB] 2024-02-16T10:17:35.934 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-16T10:17:35.938 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [231 kB] 2024-02-16T10:17:35.942 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:17:35.943 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-16T10:17:35.961 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-16T10:17:35.963 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-16T10:17:35.963 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:17:35.963 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [842 kB] 2024-02-16T10:17:35.964 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [235 kB] 2024-02-16T10:17:35.969 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-16T10:17:35.978 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [592 kB] 2024-02-16T10:17:36.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [689 kB] 2024-02-16T10:17:36.146 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-16T10:17:36.151 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [161 kB] 2024-02-16T10:17:36.544 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-16T10:17:36.550 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-16T10:17:36.555 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-16T10:17:36.561 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-16T10:17:36.562 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-16T10:17:36.564 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-16T10:17:36.565 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-16T10:17:36.568 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-16T10:17:36.575 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-16T10:17:36.578 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-16T10:17:36.712 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,049 kB] 2024-02-16T10:17:36.822 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [237 kB] 2024-02-16T10:17:36.842 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-16T10:17:36.843 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-16T10:17:36.847 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,184 B] 2024-02-16T10:17:36.847 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-16T10:17:36.848 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-16T10:17:36.848 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-16T10:17:36.851 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-16T10:17:36.853 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-16T10:17:37.018 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-16T10:17:37.100 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-16T10:17:37.181 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-16T10:17:37.234 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-16T10:17:37.288 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-16T10:17:41.276 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 11.6 MB in 2s (5,899 kB/s) 2024-02-16T10:17:41.837 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 11.6 MB in 3s (4,614 kB/s) 2024-02-16T10:17:42.540 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:17:42.556 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:17:42.607 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:17:42.783 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-02-16T10:17:42.783 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-02-16T10:17:42.929 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:17:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:17:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:17:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:17:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-16T10:17:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: python2.7-minimal 2024-02-16T10:17:42.930 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:17:42.930 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-02-16T10:17:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:17:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-16T10:17:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-16T10:17:42.932 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-02-16T10:17:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-16T10:17:42.932 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-02-16T10:17:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: thermald 2024-02-16T10:17:42.977 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-02-16T10:17:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:17:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-16T10:17:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-16T10:17:42.979 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-02-16T10:17:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-16T10:17:43.158 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:17:43.158 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 113 MB of archives. 2024-02-16T10:17:43.159 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-16T10:17:43.159 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-16T10:17:43.498 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:17:43.516 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:17:43.580 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:17:43.775 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-02-16T10:17:43.775 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-02-16T10:17:43.944 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:17:43.944 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:17:43.945 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:17:43.945 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:17:43.945 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-16T10:17:43.945 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-02-16T10:17:43.945 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:17:43.946 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-02-16T10:17:43.946 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:17:43.946 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-16T10:17:43.946 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-16T10:17:43.948 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-02-16T10:17:43.948 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-16T10:17:43.948 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-02-16T10:17:43.948 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-02-16T10:17:44.006 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-02-16T10:17:44.006 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-16T10:17:44.006 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-16T10:17:44.006 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-16T10:17:44.007 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-02-16T10:17:44.008 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-16T10:17:44.104 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:17:44.104 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-02-16T10:17:44.104 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-16T10:17:44.104 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-16T10:17:44.658 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-16T10:17:45.009 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-16T10:17:45.052 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-16T10:17:45.322 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-16T10:17:47.205 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-16T10:17:47.205 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-16T10:17:47.205 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-16T10:17:47.241 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-16T10:17:47.242 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-16T10:17:47.242 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-16T10:17:47.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-16T10:17:47.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-16T10:17:48.054 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 4s (31.0 MB/s) 2024-02-16T10:17:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-16T10:17:48.205 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-16T10:17:48.258 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-16T10:17:48.599 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 113 MB in 5s (21.7 MB/s) 2024-02-16T10:17:48.786 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-16T10:17:50.411 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-16T10:17:50.415 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:50.739 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:17:50.818 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-16T10:17:50.823 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:50.892 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:17:52.915 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-16T10:17:52.936 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:53.009 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:17:53.318 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-16T10:17:53.339 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:53.415 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:17:53.493 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-16T10:17:53.505 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:53.543 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:17:53.888 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-16T10:17:53.908 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:17:53.948 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:00.506 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:00.518 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:00.623 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:00.644 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:00.913 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:00.993 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:01.018 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:01.098 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:01.296 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-16T10:18:01.318 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-16T10:18:01.362 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:18:01.426 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-16T10:18:01.448 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-16T10:18:01.493 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:18:07.004 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-16T10:18:07.026 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:18:07.070 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:07.883 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-16T10:18:07.919 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-16T10:18:07.958 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:09.744 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:09.871 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:10.212 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:18:10.342 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:11.052 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-16T10:18:11.288 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:11.523 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-16T10:18:11.671 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-16T10:18:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-16T10:18:12.160 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:12.286 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-16T10:18:12.446 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:12.707 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:13.884 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:14.049 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:14.049 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:14.049 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:14.049 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:14.191 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:15.232 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:15.232 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:15.232 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:15.232 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:15.617 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-16T10:18:15.743 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-16T10:18:15.886 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:15.953 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-16T10:18:15.953 INFO:teuthology.orchestra.run.smithi107.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:17.137 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-16T10:18:17.263 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-16T10:18:17.389 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-16T10:18:17.456 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-16T10:18:17.456 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:29.988 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-16T10:18:29.988 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub' 2024-02-16T10:18:30.002 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:18:30.019 INFO:teuthology.orchestra.run.smithi107.stdout:Generating grub configuration file ... 2024-02-16T10:18:30.297 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:30.317 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:30.580 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:30.585 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:30.656 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:18:30.661 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:18:30.813 INFO:teuthology.orchestra.run.smithi107.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:18:30.813 INFO:teuthology.orchestra.run.smithi107.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:18:30.813 INFO:teuthology.orchestra.run.smithi107.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:18:30.859 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-02-16T10:18:31.341 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.94.91 2024-02-16T10:18:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:18:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:18:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-02-16T10:18:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-02-16T10:18:31.366 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:18:31.366 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-02-16T10:18:31.366 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-16T10:18:31.366 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T10:18:31.366 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T10:18:31.366 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-16T10:18:31.367 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T10:18:31.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-02-16T10:18:31.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-02-16T10:18:31.604 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-16T10:18:31.604 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-02-16T10:18:31.624 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:18:31.643 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-02-16T10:18:31.794 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:18:31.794 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:18:31.849 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:18:31.931 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:18:32.008 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:32.023 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:32.431 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:32.437 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:32.499 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:18:32.505 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:18:32.692 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:18:32.692 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:18:32.692 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:18:32.744 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-02-16T10:18:33.155 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:18:33.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:18:33.229 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-02-16T10:18:33.232 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:18:33.248 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.94.91 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:18:33.249 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-02-16T10:18:33.250 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-16T10:18:33.250 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-16T10:18:33.250 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-16T10:18:33.250 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-02-16T10:18:33.250 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-02-16T10:18:33.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-02-16T10:18:33.421 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-02-16T10:18:33.422 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-02-16T10:18:33.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-02-16T10:18:33.573 INFO:teuthology.orchestra.run.smithi107.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-16T10:18:33.573 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:18:33.573 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:18:33.573 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:18:33.574 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:18:33.574 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:18:33.574 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:18:33.574 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:18:33.611 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:18:33.613 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.94.91 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-02-16T10:18:33.628 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-02-16T10:18:33.629 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:18:33.629 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-02-16T10:18:33.629 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-02-16T10:18:33.676 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.zs8JvvcL9w 2024-02-16T10:18:33.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zs8JvvcL9w 2024-02-16T10:18:33.696 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:18:33.697 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:18:33.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.zs8JvvcL9w 2024-02-16T10:18:33.759 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:18:33.840 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:18:33.847 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.zs8JvvcL9w is 10KB 2024-02-16T10:18:33.860 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.zs8JvvcL9w 2024-02-16T10:18:33.865 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-16T10:18:33.918 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:18:33.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-16T10:18:33.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-16T10:18:33.985 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-16T10:18:33.986 DEBUG:teuthology.orchestra.run.smithi107:> sudo update-grub 2024-02-16T10:18:35.017 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:18:35.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-16T10:18:35.098 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:18:35.227 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-02-16T10:18:35.228 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:18:35.234 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-02-16T10:18:35.292 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-02-16T10:18:35.292 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-02-16T10:18:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:18:35.462 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:18:35.463 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:18:35.503 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 287 not upgraded. 2024-02-16T10:18:35.505 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-02-16T10:18:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.94.91 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-02-16T10:18:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-02-16T10:18:35.522 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-02-16T10:18:35.568 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.NaOnaOvGyf 2024-02-16T10:18:35.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NaOnaOvGyf 2024-02-16T10:18:35.623 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.NaOnaOvGyf 2024-02-16T10:18:35.651 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:35.657 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:35.695 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:18:35.700 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:18:35.746 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.NaOnaOvGyf is 10KB 2024-02-16T10:18:35.759 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.NaOnaOvGyf 2024-02-16T10:18:35.764 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-16T10:18:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:18:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:18:35.818 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:18:35.820 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:18:35.820 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-16T10:18:35.820 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-16T10:18:35.842 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-02-16T10:18:35.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-02-16T10:18:35.884 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-16T10:18:35.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-02-16T10:18:37.196 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-02-16T10:18:37.197 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-16T10:18:37.200 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-02-16T10:18:37.536 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-16T10:18:37.543 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-16T10:18:37.914 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-16T10:18:37.919 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-16T10:18:37.963 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-16T10:18:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-16T10:18:38.099 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-16T10:18:38.099 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-16T10:18:38.099 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-16T10:18:38.110 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-02-16T10:18:38.113 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-02-16T10:19:05.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-16T10:19:05.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:19:05.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:19:08.161 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-02-16T10:19:08.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-16T10:19:08.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:19:40.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-16T10:19:49.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:19:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:20:07.868 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-16T10:20:08.164 DEBUG:teuthology.orchestra.remote:timed out 2024-02-16T10:20:17.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-16T10:20:17.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:20:17.764 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-16T10:20:18.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-16T10:20:18.697 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-94-generic"... 2024-02-16T10:20:18.698 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-16T10:20:18.748 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-94-generic 2024-02-16T10:20:18.748 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-16T10:20:18.748 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T10:20:18.748 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-16T10:20:19.749 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-02-16T10:20:19.749 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T10:20:19.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:20:19.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:20:19.892 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-02-16T10:20:19.946 DEBUG:teuthology.parallel:result is None 2024-02-16T10:20:21.916 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-02-16T10:20:36.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:20:36.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:20:37.234 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-02-16T10:20:37.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:20:37.795 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-16T10:20:37.795 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-02-16T10:20:37.844 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-94-generic 2024-02-16T10:20:37.845 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-16T10:20:37.845 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-16T10:20:37.845 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-16T10:20:38.846 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-16T10:20:38.846 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-16T10:20:38.917 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-02-16T10:20:38.944 DEBUG:teuthology.parallel:result is None 2024-02-16T10:20:38.944 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-16T10:20:38.952 INFO:teuthology.task.internal:Creating test directory... 2024-02-16T10:20:38.952 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T10:20:38.954 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-16T10:20:38.960 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-16T10:20:38.967 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-16T10:20:38.977 INFO:teuthology.task.internal:Creating archive directory... 2024-02-16T10:20:38.977 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T10:20:39.003 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-16T10:20:39.134 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-16T10:20:39.141 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-16T10:20:39.141 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T10:20:39.144 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-16T10:20:39.158 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:20:39.163 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:20:39.166 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:20:39.173 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-16T10:20:39.175 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-16T10:20:39.181 INFO:teuthology.task.internal:Configuring sudo... 2024-02-16T10:20:39.182 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T10:20:39.212 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-16T10:20:39.233 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-16T10:20:39.242 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-16T10:20:39.242 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T10:20:39.268 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-16T10:20:39.280 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T10:20:39.323 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T10:20:39.371 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:20:39.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T10:20:39.429 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-16T10:20:39.435 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-16T10:20:39.481 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:20:39.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-16T10:20:39.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-02-16T10:20:39.555 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-02-16T10:20:39.624 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-16T10:20:39.631 INFO:teuthology.task.internal:Starting timer... 2024-02-16T10:20:39.631 INFO:teuthology.run_tasks:Running task pcp... 2024-02-16T10:20:39.662 INFO:teuthology.run_tasks:Running task selinux... 2024-02-16T10:20:39.670 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2024-02-16T10:20:39.670 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-02-16T10:20:39.670 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-16T10:20:39.671 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-16T10:20:39.671 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-16T10:20:39.671 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-16T10:20:39.681 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-16T10:20:39.698 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-16T10:20:39.699 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-16T10:27:41.778 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-02-16T10:27:41.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:27:41.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:27:41.862 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-02-16T10:27:41.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-02-16T10:27:41.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-16T10:27:41.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T10:27:42.024 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-16T10:27:42.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-16T10:27:42.100 INFO:teuthology.run_tasks:Running task clock... 2024-02-16T10:27:42.112 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-16T10:27:42.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T10:27:42.112 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:27:42.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-16T10:27:42.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:27:42.145 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-16T10:27:42.145 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Command line: ntpd -gq 2024-02-16T10:27:42.145 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: ---------------------------------------------------- 2024-02-16T10:27:42.145 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: ntp-4 is maintained by Network Time Foundation, 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: corporation. Support and training for ntp-4 are 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: available at https://www.nwtime.org/support 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: ---------------------------------------------------- 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: proto: precision = 0.061 usec (-24) 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: basedate set to 2022-02-04 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: gps base set to 2022-02-06 (week 2196) 2024-02-16T10:27:42.146 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:27:42.147 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:27:42.147 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:27:42.147 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen and drop on 0 v6wildcard [::]:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen normally on 2 lo 127.0.0.1:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen normally on 4 lo [::1]:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2024-02-16T10:27:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:42 ntpd[17174]: Listening on routing socket on fd #22 for interface updates 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Command line: ntpd -gq 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: ---------------------------------------------------- 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: ntp-4 is maintained by Network Time Foundation, 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: corporation. Support and training for ntp-4 are 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: available at https://www.nwtime.org/support 2024-02-16T10:27:42.171 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: ---------------------------------------------------- 2024-02-16T10:27:42.172 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: proto: precision = 0.044 usec (-24) 2024-02-16T10:27:42.172 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: basedate set to 2022-02-04 2024-02-16T10:27:42.172 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: gps base set to 2022-02-06 (week 2196) 2024-02-16T10:27:42.172 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:27:42.173 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-16T10:27:42.173 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: restrict ::: KOD does nothing without LIMITED. 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen and drop on 0 v6wildcard [::]:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen normally on 2 lo 127.0.0.1:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen normally on 4 lo [::1]:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-02-16T10:27:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:42 ntpd[17175]: Listening on routing socket on fd #22 for interface updates 2024-02-16T10:27:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:43.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:43 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:43.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:43 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:44.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:44.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:44.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:44.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:44.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:44.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:44 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:44.171 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:44 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:44.171 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:44 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:45.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:45 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:45 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:46.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:46 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:47.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:47 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:47 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:48.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:48.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:48.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:48.143 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:48.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:48.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:48 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.144 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stdout:16 Feb 10:27:49 ntpd[17174]: ntpd: time slew -0.000936 s 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew -0.000936s 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-16T10:27:49.145 INFO:teuthology.orchestra.run.smithi107.stderr:16 Feb 10:27:49 ntpd[17174]: can't open /var/log/ntpstats/loopstats.20240216: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.172 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240216: Permission denied 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240216: Permission denied 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stdout:16 Feb 10:27:49 ntpd[17175]: ntpd: time slew -0.002816 s 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.002816s 2024-02-16T10:27:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-16T10:27:49.174 INFO:teuthology.orchestra.run.smithi138.stderr:16 Feb 10:27:49 ntpd[17175]: can't open /var/log/ntpstats/loopstats.20240216: Permission denied 2024-02-16T10:27:49.324 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:27:49.324 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-02-16T10:27:49.324 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.325 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.325 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.325 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:27:49.356 INFO:teuthology.run_tasks:Running task install... 2024-02-16T10:27:49.365 DEBUG:teuthology.task.install:project ceph 2024-02-16T10:27:49.365 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}} 2024-02-16T10:27:49.365 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'} 2024-02-16T10:27:49.365 INFO:teuthology.task.install:Using flavor: default 2024-02-16T10:27:49.371 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-16T10:27:49.371 INFO:teuthology.task.install:extra packages: [] 2024-02-16T10:27:49.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2024-02-16T10:27:49.372 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-02-16T10:27:49.433 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-16T10:27:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-16T10:27:49.463 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-16T10:27:49.463 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2024-02-16T10:27:49.464 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-16T10:27:49.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:27:49.491 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-16T10:27:49.491 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-02-16T10:27:49.492 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-16T10:27:49.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:27:49.639 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default/ 2024-02-16T10:27:49.639 INFO:teuthology.task.install.deb:Package version is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:27:49.679 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default/ 2024-02-16T10:27:49.679 INFO:teuthology.task.install.deb:Package version is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:27:49.916 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:27:49.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-16T10:27:49.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-02-16T10:27:49.935 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:27:49.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-16T10:27:49.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-02-16T10:27:50.099 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:27:50.100 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:27:50.113 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:27:50.119 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-16T10:27:50.133 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:27:50.134 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-16T10:27:50.154 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-16T10:27:50.236 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-16T10:27:50.391 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy InRelease 2024-02-16T10:27:50.434 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy InRelease 2024-02-16T10:27:50.468 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-16T10:27:50.526 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-16T10:27:50.546 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-16T10:27:50.593 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-02-16T10:27:50.599 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-16T10:27:50.642 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-16T10:27:50.653 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-02-16T10:27:50.716 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-16T10:27:50.729 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 28.8 kB in 1s (48.9 kB/s) 2024-02-16T10:27:50.813 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 28.8 kB in 1s (42.2 kB/s) 2024-02-16T10:27:51.696 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:27:51.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1461-g6a4516ad-1jammy cephadm=19.0.0-1461-g6a4516ad-1jammy ceph-mds=19.0.0-1461-g6a4516ad-1jammy ceph-mgr=19.0.0-1461-g6a4516ad-1jammy ceph-common=19.0.0-1461-g6a4516ad-1jammy ceph-fuse=19.0.0-1461-g6a4516ad-1jammy ceph-test=19.0.0-1461-g6a4516ad-1jammy ceph-volume=19.0.0-1461-g6a4516ad-1jammy radosgw=19.0.0-1461-g6a4516ad-1jammy python3-rados=19.0.0-1461-g6a4516ad-1jammy python3-rgw=19.0.0-1461-g6a4516ad-1jammy python3-cephfs=19.0.0-1461-g6a4516ad-1jammy python3-rbd=19.0.0-1461-g6a4516ad-1jammy libcephfs2=19.0.0-1461-g6a4516ad-1jammy libcephfs-dev=19.0.0-1461-g6a4516ad-1jammy librados2=19.0.0-1461-g6a4516ad-1jammy librbd1=19.0.0-1461-g6a4516ad-1jammy rbd-fuse=19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:27:51.762 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-02-16T10:27:51.785 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:27:51.800 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1461-g6a4516ad-1jammy cephadm=19.0.0-1461-g6a4516ad-1jammy ceph-mds=19.0.0-1461-g6a4516ad-1jammy ceph-mgr=19.0.0-1461-g6a4516ad-1jammy ceph-common=19.0.0-1461-g6a4516ad-1jammy ceph-fuse=19.0.0-1461-g6a4516ad-1jammy ceph-test=19.0.0-1461-g6a4516ad-1jammy ceph-volume=19.0.0-1461-g6a4516ad-1jammy radosgw=19.0.0-1461-g6a4516ad-1jammy python3-rados=19.0.0-1461-g6a4516ad-1jammy python3-rgw=19.0.0-1461-g6a4516ad-1jammy python3-cephfs=19.0.0-1461-g6a4516ad-1jammy python3-rbd=19.0.0-1461-g6a4516ad-1jammy libcephfs2=19.0.0-1461-g6a4516ad-1jammy libcephfs-dev=19.0.0-1461-g6a4516ad-1jammy librados2=19.0.0-1461-g6a4516ad-1jammy librbd1=19.0.0-1461-g6a4516ad-1jammy rbd-fuse=19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:27:51.859 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-02-16T10:27:51.931 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-02-16T10:27:51.932 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-02-16T10:27:52.060 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-02-16T10:27:52.060 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-02-16T10:27:52.089 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:27:52.089 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:27:52.089 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:27:52.089 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:27:52.089 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:27:52.090 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:27:52.090 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:27:52.090 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-02-16T10:27:52.090 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-16T10:27:52.090 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-16T10:27:52.091 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:27:52.092 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-02-16T10:27:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-02-16T10:27:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-16T10:27:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-16T10:27:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:27:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-16T10:27:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-16T10:27:52.241 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-02-16T10:27:52.241 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-16T10:27:52.241 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-16T10:27:52.241 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-16T10:27:52.241 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-16T10:27:52.242 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-16T10:27:52.242 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-16T10:27:52.242 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-02-16T10:27:52.242 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-16T10:27:52.242 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-16T10:27:52.243 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-16T10:27:52.243 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-16T10:27:52.243 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-16T10:27:52.243 INFO:teuthology.orchestra.run.smithi107.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-16T10:27:52.243 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-16T10:27:52.244 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet zip 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-16T10:27:52.245 INFO:teuthology.orchestra.run.smithi107.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-02-16T10:27:52.246 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2024-02-16T10:27:52.287 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-16T10:27:52.287 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 176 MB of archives. 2024-02-16T10:27:52.288 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-16T10:27:52.288 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-16T10:27:52.332 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1461-g6a4516ad-1jammy [3,534 kB] 2024-02-16T10:27:52.347 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-02-16T10:27:52.347 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-16T10:27:52.348 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-16T10:27:52.349 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-16T10:27:52.349 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-16T10:27:52.349 INFO:teuthology.orchestra.run.smithi107.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-16T10:27:52.349 INFO:teuthology.orchestra.run.smithi107.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-16T10:27:52.349 INFO:teuthology.orchestra.run.smithi107.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-16T10:27:52.350 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-16T10:27:52.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-16T10:27:52.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-16T10:27:52.351 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-16T10:27:52.351 INFO:teuthology.orchestra.run.smithi107.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-16T10:27:52.422 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-16T10:27:52.425 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-16T10:27:52.434 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 118 newly installed, 0 to remove and 274 not upgraded. 2024-02-16T10:27:52.434 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 176 MB of archives. 2024-02-16T10:27:52.434 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-16T10:27:52.434 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-16T10:27:52.449 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-16T10:27:52.526 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1461-g6a4516ad-1jammy [3,534 kB] 2024-02-16T10:27:52.544 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-16T10:27:52.550 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-16T10:27:52.566 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-16T10:27:52.572 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-16T10:27:52.572 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-16T10:27:52.573 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-16T10:27:52.579 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1461-g6a4516ad-1jammy [3,211 kB] 2024-02-16T10:27:52.584 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-16T10:27:52.587 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-16T10:27:52.589 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-16T10:27:52.591 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-16T10:27:52.592 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-16T10:27:52.598 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-16T10:27:52.627 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-16T10:27:52.630 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-16T10:27:52.632 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-16T10:27:52.635 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-16T10:27:52.635 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-16T10:27:52.635 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-16T10:27:52.648 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-16T10:27:52.665 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-16T10:27:52.665 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-16T10:27:52.666 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-16T10:27:52.666 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-16T10:27:52.693 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-16T10:27:52.693 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-16T10:27:52.693 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-16T10:27:52.696 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-16T10:27:52.697 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-16T10:27:52.697 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-16T10:27:52.712 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-16T10:27:52.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-16T10:27:52.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-16T10:27:52.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-16T10:27:52.724 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1461-g6a4516ad-1jammy [710 kB] 2024-02-16T10:27:52.738 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-16T10:27:52.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-16T10:27:52.739 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-16T10:27:52.746 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-16T10:27:52.746 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-16T10:27:52.746 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-16T10:27:52.759 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1461-g6a4516ad-1jammy [357 kB] 2024-02-16T10:27:52.773 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1461-g6a4516ad-1jammy [32.8 kB] 2024-02-16T10:27:52.774 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1461-g6a4516ad-1jammy [180 kB] 2024-02-16T10:27:52.775 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-16T10:27:52.777 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-16T10:27:52.777 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-16T10:27:52.779 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-16T10:27:52.780 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-16T10:27:52.782 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1461-g6a4516ad-1jammy [64.8 kB] 2024-02-16T10:27:52.783 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-16T10:27:52.785 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1461-g6a4516ad-1jammy [330 kB] 2024-02-16T10:27:52.800 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-16T10:27:52.802 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-16T10:27:52.803 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-16T10:27:52.806 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-16T10:27:52.806 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-16T10:27:52.806 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-16T10:27:52.807 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-16T10:27:52.807 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1461-g6a4516ad-1jammy [6,564 kB] 2024-02-16T10:27:52.808 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-16T10:27:52.808 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-16T10:27:52.810 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-16T10:27:52.819 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-16T10:27:52.823 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-16T10:27:52.829 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-16T10:27:52.831 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-16T10:27:52.849 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-16T10:27:52.852 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-16T10:27:52.855 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-16T10:27:52.879 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-16T10:27:52.880 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-16T10:27:52.882 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-16T10:27:52.882 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-16T10:27:52.883 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-16T10:27:52.890 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-16T10:27:52.891 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-16T10:27:52.892 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-16T10:27:52.894 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-16T10:27:52.895 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-16T10:27:52.896 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-16T10:27:52.896 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-16T10:27:52.917 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-16T10:27:52.919 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-16T10:27:52.919 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-16T10:27:52.934 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-16T10:27:52.935 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-16T10:27:52.936 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-16T10:27:52.940 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-16T10:27:52.940 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-16T10:27:52.947 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-16T10:27:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-16T10:27:52.948 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-16T10:27:52.949 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-16T10:27:52.949 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-16T10:27:52.950 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-16T10:27:52.954 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-16T10:27:52.958 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-16T10:27:52.959 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-16T10:27:52.960 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-16T10:27:52.961 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-16T10:27:52.963 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-16T10:27:52.964 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-16T10:27:52.965 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-16T10:27:52.967 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-16T10:27:52.968 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-16T10:27:52.969 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-16T10:27:52.978 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-16T10:27:52.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-16T10:27:52.981 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-16T10:27:52.986 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-16T10:27:52.989 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-16T10:27:52.990 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-16T10:27:52.991 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-16T10:27:52.996 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-16T10:27:52.996 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-16T10:27:53.000 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-16T10:27:53.000 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-16T10:27:53.004 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-16T10:27:53.004 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-16T10:27:53.004 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-16T10:27:53.006 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-16T10:27:53.007 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-16T10:27:53.007 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-16T10:27:53.007 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-16T10:27:53.010 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-16T10:27:53.012 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-16T10:27:53.022 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-16T10:27:53.024 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-16T10:27:53.025 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-16T10:27:53.027 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-16T10:27:53.029 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-16T10:27:53.035 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-16T10:27:53.035 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-16T10:27:53.035 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-16T10:27:53.038 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-16T10:27:53.039 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-16T10:27:53.061 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-16T10:27:53.063 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-16T10:27:53.068 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-16T10:27:53.111 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1461-g6a4516ad-1jammy [112 kB] 2024-02-16T10:27:53.114 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1461-g6a4516ad-1jammy [466 kB] 2024-02-16T10:27:53.142 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1461-g6a4516ad-1jammy [24.1 MB] 2024-02-16T10:27:53.145 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-16T10:27:53.146 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-16T10:27:53.147 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-16T10:27:53.148 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-16T10:27:53.149 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-16T10:27:53.167 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-16T10:27:53.169 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-16T10:27:53.169 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-16T10:27:53.187 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-16T10:27:53.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-16T10:27:53.196 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-16T10:27:53.197 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-16T10:27:53.197 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-16T10:27:53.198 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-16T10:27:53.198 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-16T10:27:53.199 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-16T10:27:53.202 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-16T10:27:53.217 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-16T10:27:53.219 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-16T10:27:53.219 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-16T10:27:53.245 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-16T10:27:53.250 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-16T10:27:53.251 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-16T10:27:53.252 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-16T10:27:53.264 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-16T10:27:53.265 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-16T10:27:53.273 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-16T10:27:53.284 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-16T10:27:53.284 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-16T10:27:53.285 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-16T10:27:53.306 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-16T10:27:53.307 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-16T10:27:53.321 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-16T10:27:53.324 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-16T10:27:53.324 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-16T10:27:53.332 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-16T10:27:53.333 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-16T10:27:53.863 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1461-g6a4516ad-1jammy [3,211 kB] 2024-02-16T10:27:54.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1461-g6a4516ad-1jammy [5,074 kB] 2024-02-16T10:27:54.457 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1461-g6a4516ad-1jammy [710 kB] 2024-02-16T10:27:54.590 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1461-g6a4516ad-1jammy [243 kB] 2024-02-16T10:27:54.595 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1461-g6a4516ad-1jammy [357 kB] 2024-02-16T10:27:54.607 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1461-g6a4516ad-1jammy [32.8 kB] 2024-02-16T10:27:54.620 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1461-g6a4516ad-1jammy [124 kB] 2024-02-16T10:27:54.625 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1461-g6a4516ad-1jammy [1,519 kB] 2024-02-16T10:27:54.665 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1461-g6a4516ad-1jammy [180 kB] 2024-02-16T10:27:54.672 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1461-g6a4516ad-1jammy [64.8 kB] 2024-02-16T10:27:54.675 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1461-g6a4516ad-1jammy [330 kB] 2024-02-16T10:27:54.708 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1461-g6a4516ad-1jammy [6,240 kB] 2024-02-16T10:27:54.745 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1461-g6a4516ad-1jammy [6,564 kB] 2024-02-16T10:27:55.078 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1461-g6a4516ad-1jammy [22.7 MB] 2024-02-16T10:27:55.464 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1461-g6a4516ad-1jammy [112 kB] 2024-02-16T10:27:55.466 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1461-g6a4516ad-1jammy [466 kB] 2024-02-16T10:27:55.483 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1461-g6a4516ad-1jammy [24.1 MB] 2024-02-16T10:27:56.781 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1461-g6a4516ad-1jammy [14.0 kB] 2024-02-16T10:27:56.782 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [865 kB] 2024-02-16T10:27:56.799 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1461-g6a4516ad-1jammy [2,184 kB] 2024-02-16T10:27:56.915 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1461-g6a4516ad-1jammy [776 kB] 2024-02-16T10:27:56.942 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1461-g6a4516ad-1jammy [144 kB] 2024-02-16T10:27:56.981 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1461-g6a4516ad-1jammy [1,921 kB] 2024-02-16T10:27:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1461-g6a4516ad-1jammy [8,625 kB] 2024-02-16T10:27:57.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1461-g6a4516ad-1jammy [14.2 kB] 2024-02-16T10:27:57.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1461-g6a4516ad-1jammy [49.9 MB] 2024-02-16T10:27:57.849 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1461-g6a4516ad-1jammy [5,074 kB] 2024-02-16T10:27:58.256 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1461-g6a4516ad-1jammy [243 kB] 2024-02-16T10:27:58.264 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1461-g6a4516ad-1jammy [124 kB] 2024-02-16T10:27:58.319 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1461-g6a4516ad-1jammy [1,519 kB] 2024-02-16T10:27:58.473 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1461-g6a4516ad-1jammy [6,240 kB] 2024-02-16T10:27:59.151 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1461-g6a4516ad-1jammy [22.7 MB] 2024-02-16T10:28:01.175 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1461-g6a4516ad-1jammy [121 kB] 2024-02-16T10:28:01.177 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1461-g6a4516ad-1jammy [38.4 kB] 2024-02-16T10:28:01.179 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1461-g6a4516ad-1jammy [13.0 MB] 2024-02-16T10:28:01.668 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1461-g6a4516ad-1jammy [14.0 kB] 2024-02-16T10:28:01.668 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [865 kB] 2024-02-16T10:28:01.685 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1461-g6a4516ad-1jammy [2,184 kB] 2024-02-16T10:28:01.858 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1461-g6a4516ad-1jammy [776 kB] 2024-02-16T10:28:01.871 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [91.5 kB] 2024-02-16T10:28:01.896 INFO:teuthology.orchestra.run.smithi107.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1461-g6a4516ad-1jammy [144 kB] 2024-02-16T10:28:01.903 INFO:teuthology.orchestra.run.smithi107.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1461-g6a4516ad-1jammy [1,921 kB] 2024-02-16T10:28:02.001 INFO:teuthology.orchestra.run.smithi107.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1461-g6a4516ad-1jammy [8,625 kB] 2024-02-16T10:28:02.417 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 176 MB in 10s (18.2 MB/s) 2024-02-16T10:28:02.440 INFO:teuthology.orchestra.run.smithi107.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1461-g6a4516ad-1jammy [14.2 kB] 2024-02-16T10:28:02.440 INFO:teuthology.orchestra.run.smithi107.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1461-g6a4516ad-1jammy [49.9 MB] 2024-02-16T10:28:02.568 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-16T10:28:02.665 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-16T10:28:02.671 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-16T10:28:02.750 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:28:03.020 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-16T10:28:03.046 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-16T10:28:03.078 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:28:03.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-16T10:28:03.432 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-16T10:28:03.473 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:28:03.909 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-16T10:28:03.936 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:03.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:04.379 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-16T10:28:04.394 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:04.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:04.791 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-16T10:28:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:04.857 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:05.193 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-16T10:28:05.220 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-16T10:28:05.260 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:28:05.372 INFO:teuthology.orchestra.run.smithi107.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1461-g6a4516ad-1jammy [121 kB] 2024-02-16T10:28:05.375 INFO:teuthology.orchestra.run.smithi107.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1461-g6a4516ad-1jammy [38.4 kB] 2024-02-16T10:28:05.376 INFO:teuthology.orchestra.run.smithi107.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1461-g6a4516ad-1jammy [13.0 MB] 2024-02-16T10:28:05.554 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-02-16T10:28:05.581 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:05.621 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:05.892 INFO:teuthology.orchestra.run.smithi107.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley-testing/6a4516ad3eca4b7cf7d93b64055992bfc2113285/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1461-g6a4516ad-1jammy [91.5 kB] 2024-02-16T10:28:06.066 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-02-16T10:28:06.092 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librbd1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:06.132 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:06.425 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 176 MB in 14s (13.0 MB/s) 2024-02-16T10:28:06.577 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-02-16T10:28:06.585 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-16T10:28:06.603 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:06.643 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:06.684 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-16T10:28:06.690 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-16T10:28:06.775 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:28:06.929 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-02-16T10:28:06.955 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:06.995 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:07.056 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-16T10:28:07.071 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-16T10:28:07.106 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:28:07.298 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-16T10:28:07.324 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:07.356 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:07.467 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-16T10:28:07.493 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-16T10:28:07.534 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:28:07.576 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-02-16T10:28:07.602 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:07.642 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:07.936 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-16T10:28:07.963 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:07.971 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-16T10:28:07.997 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:08.003 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:08.046 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:08.346 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-16T10:28:08.373 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-16T10:28:08.414 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:28:08.433 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-16T10:28:08.459 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:08.499 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:08.742 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-02-16T10:28:08.768 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-16T10:28:08.809 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-16T10:28:08.853 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-16T10:28:08.879 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-16T10:28:08.919 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:28:09.044 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-02-16T10:28:09.060 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:09.094 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:09.239 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-16T10:28:09.265 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-16T10:28:09.297 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:28:09.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-16T10:28:09.432 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-16T10:28:09.472 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:28:09.742 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-16T10:28:09.765 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-16T10:28:09.811 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:28:09.826 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librados2. 2024-02-16T10:28:09.852 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-librados2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:09.892 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:10.111 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-16T10:28:10.137 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-16T10:28:10.177 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:28:10.354 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librbd1. 2024-02-16T10:28:10.380 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-librbd1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:10.420 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:10.689 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-02-16T10:28:10.716 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-16T10:28:10.756 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:28:10.840 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2024-02-16T10:28:10.866 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:10.906 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:11.050 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-02-16T10:28:11.065 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-16T10:28:11.108 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-16T10:28:11.184 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2024-02-16T10:28:11.199 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:11.242 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:11.361 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-02-16T10:28:11.384 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-16T10:28:11.428 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-02-16T10:28:11.562 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-16T10:28:11.588 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:11.628 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:11.740 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-02-16T10:28:11.766 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-16T10:28:11.806 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:28:11.906 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2024-02-16T10:28:11.932 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:11.973 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:12.160 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-02-16T10:28:12.186 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-16T10:28:12.218 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:28:12.250 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-16T10:28:12.267 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:12.300 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:12.604 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-16T10:28:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-02-16T10:28:12.630 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-16T10:28:12.644 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-librgw2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:12.670 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:28:12.684 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:12.990 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2024-02-16T10:28:13.016 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-16T10:28:13.057 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-16T10:28:13.178 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-02-16T10:28:13.193 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:13.228 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:13.326 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2024-02-16T10:28:13.341 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:13.384 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:13.539 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-16T10:28:13.565 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-16T10:28:13.606 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:28:13.713 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-16T10:28:13.739 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-16T10:28:13.779 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:28:13.909 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-02-16T10:28:13.935 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:13.975 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:14.057 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-16T10:28:14.072 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-16T10:28:14.115 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:28:14.337 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-02-16T10:28:14.363 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:14.395 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:14.426 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-16T10:28:14.441 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-16T10:28:14.484 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:28:15.038 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua5.1. 2024-02-16T10:28:15.064 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-16T10:28:15.105 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:28:15.408 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-any. 2024-02-16T10:28:15.423 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-16T10:28:15.466 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-16T10:28:15.617 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-02-16T10:28:15.643 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:15.684 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:15.710 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package zip. 2024-02-16T10:28:15.726 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-16T10:28:15.769 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking zip (3.0-12build2) ... 2024-02-16T10:28:16.089 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package unzip. 2024-02-16T10:28:16.115 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-16T10:28:16.155 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:28:16.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-16T10:28:16.431 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-16T10:28:16.462 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:28:16.518 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package luarocks. 2024-02-16T10:28:16.544 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-16T10:28:16.576 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:28:16.757 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-02-16T10:28:16.772 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-16T10:28:16.807 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:28:16.934 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2024-02-16T10:28:16.960 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-librgw2_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:17.001 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:17.068 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-16T10:28:17.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-16T10:28:17.135 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:28:17.438 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-16T10:28:17.464 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-16T10:28:17.503 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2024-02-16T10:28:17.504 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:28:17.518 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:17.570 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:17.816 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-16T10:28:17.842 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-16T10:28:17.882 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:28:17.915 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-16T10:28:17.941 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-16T10:28:17.981 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:28:18.160 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-02-16T10:28:18.175 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-16T10:28:18.210 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-16T10:28:18.301 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2024-02-16T10:28:18.327 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:18.368 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:18.496 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-02-16T10:28:18.522 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-16T10:28:18.563 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-16T10:28:18.738 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2024-02-16T10:28:18.764 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:18.829 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:18.874 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-16T10:28:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-16T10:28:18.940 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-16T10:28:19.193 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-16T10:28:19.220 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-16T10:28:19.252 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:28:19.597 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-02-16T10:28:19.623 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-16T10:28:19.663 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-16T10:28:19.983 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-02-16T10:28:20.010 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-16T10:28:20.050 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-16T10:28:20.256 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2024-02-16T10:28:20.282 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:20.319 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-16T10:28:20.335 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-16T10:28:20.369 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:28:20.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:20.706 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-02-16T10:28:20.732 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-16T10:28:20.772 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:28:20.982 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-16T10:28:21.008 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-16T10:28:21.048 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:28:21.117 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-16T10:28:21.144 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-16T10:28:21.183 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:28:21.300 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cheroot. 2024-02-16T10:28:21.316 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-16T10:28:21.350 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:28:21.437 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-16T10:28:21.462 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-16T10:28:21.494 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:28:21.646 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-16T10:28:21.672 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-16T10:28:21.712 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:28:21.789 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-02-16T10:28:21.816 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-16T10:28:21.855 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:28:22.015 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-16T10:28:22.041 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-16T10:28:22.082 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:28:22.200 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-02-16T10:28:22.227 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-16T10:28:22.269 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:28:22.360 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-16T10:28:22.386 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-16T10:28:22.426 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:28:22.553 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-02-16T10:28:22.570 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-16T10:28:22.611 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:28:22.813 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempora. 2024-02-16T10:28:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-16T10:28:22.864 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-02-16T10:28:22.888 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-16T10:28:22.891 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-16T10:28:22.930 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:28:23.207 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-portend. 2024-02-16T10:28:23.234 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-16T10:28:23.235 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-16T10:28:23.261 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-16T10:28:23.274 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-16T10:28:23.300 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:28:23.610 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-16T10:28:23.611 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-16T10:28:23.636 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-16T10:28:23.638 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-16T10:28:23.678 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:28:23.685 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-16T10:28:23.981 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-02-16T10:28:24.008 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-16T10:28:24.038 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-16T10:28:24.047 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-16T10:28:24.065 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-16T10:28:24.113 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:28:24.342 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-02-16T10:28:24.369 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-16T10:28:24.409 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:28:24.500 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2024-02-16T10:28:24.527 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-16T10:28:24.575 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-16T10:28:24.797 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-02-16T10:28:24.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-16T10:28:24.863 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-16T10:28:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2024-02-16T10:28:24.997 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-16T10:28:25.045 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-16T10:28:25.193 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-02-16T10:28:25.220 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-16T10:28:25.635 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-16T10:28:26.315 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-02-16T10:28:26.324 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-16T10:28:26.340 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-16T10:28:26.350 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-16T10:28:26.380 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:28:26.390 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:28:26.684 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-02-16T10:28:26.711 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-16T10:28:26.718 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2024-02-16T10:28:26.742 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:28:26.745 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-16T10:28:26.785 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:28:26.996 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-16T10:28:27.023 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-16T10:28:27.054 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:28:27.097 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-16T10:28:27.124 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-16T10:28:27.155 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:28:27.299 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-16T10:28:27.315 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:27.349 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:27.425 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-16T10:28:27.451 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-16T10:28:27.491 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:28:27.705 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-16T10:28:27.732 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:27.772 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:27.794 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2024-02-16T10:28:27.821 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-16T10:28:27.861 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:28:28.043 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-16T10:28:28.068 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-16T10:28:28.100 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:28:28.181 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2024-02-16T10:28:28.207 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-16T10:28:28.251 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:28:28.395 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-02-16T10:28:28.422 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-16T10:28:28.461 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-16T10:28:28.558 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2024-02-16T10:28:28.585 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-16T10:28:28.625 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:28:28.848 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-02-16T10:28:28.875 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:28.915 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2024-02-16T10:28:28.954 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-16T10:28:28.994 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:28:29.285 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-02-16T10:28:29.306 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-16T10:28:29.312 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:29.321 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-16T10:28:29.343 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:29.364 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:28:29.684 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-16T10:28:29.710 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-16T10:28:29.751 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:28:29.948 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-02-16T10:28:29.974 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:30.014 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:30.020 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2024-02-16T10:28:30.036 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-16T10:28:30.071 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-16T10:28:30.399 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2024-02-16T10:28:30.425 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-16T10:28:30.465 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:28:30.862 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-certifi. 2024-02-16T10:28:30.889 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-16T10:28:30.929 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-16T10:28:31.076 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-02-16T10:28:31.100 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:31.143 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:31.257 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-idna. 2024-02-16T10:28:31.283 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-16T10:28:31.323 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-16T10:28:31.421 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-02-16T10:28:31.448 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:31.487 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:31.593 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-urllib3. 2024-02-16T10:28:31.608 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-16T10:28:31.643 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:28:31.921 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests. 2024-02-16T10:28:31.948 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-16T10:28:31.979 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:28:32.041 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-02-16T10:28:32.068 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:32.108 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:32.266 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-16T10:28:32.293 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-16T10:28:32.332 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:28:32.487 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-02-16T10:28:32.513 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-cephadm_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:32.553 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:32.611 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-16T10:28:32.637 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:32.677 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:32.840 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-16T10:28:32.866 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-16T10:28:32.931 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-16T10:28:33.016 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-16T10:28:33.031 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:33.065 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:33.243 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-16T10:28:33.269 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:28:33.301 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:28:33.369 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-16T10:28:33.395 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-16T10:28:33.435 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:28:33.738 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2024-02-16T10:28:33.765 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-16T10:28:33.805 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-16T10:28:34.150 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2024-02-16T10:28:34.177 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:34.224 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:34.290 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-02-16T10:28:34.317 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:28:34.356 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:28:34.586 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2024-02-16T10:28:34.613 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:34.693 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-02-16T10:28:34.720 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-16T10:28:34.760 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:28:35.080 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-16T10:28:35.107 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:35.147 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:35.190 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2024-02-16T10:28:35.216 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:35.256 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-16T10:28:35.519 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-16T10:28:35.558 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-16T10:28:35.829 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-02-16T10:28:35.852 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-16T10:28:35.887 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:28:36.191 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-16T10:28:36.217 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:36.265 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:36.326 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2024-02-16T10:28:36.353 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-ceph_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:36.393 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:36.720 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-16T10:28:36.746 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2024-02-16T10:28:36.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-16T10:28:36.772 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:36.786 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:28:36.812 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:37.141 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2024-02-16T10:28:37.167 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:37.207 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:37.357 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-02-16T10:28:37.384 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-16T10:28:37.423 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:28:37.585 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2024-02-16T10:28:37.612 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-cephadm_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:37.651 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:37.761 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-16T10:28:37.788 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-16T10:28:37.827 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:28:37.988 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-16T10:28:38.015 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-16T10:28:38.054 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-16T10:28:38.139 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-02-16T10:28:38.166 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-16T10:28:38.205 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:28:38.357 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-16T10:28:38.384 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:28:38.415 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:28:38.874 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-16T10:28:38.902 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:39.026 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:39.513 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-babel. 2024-02-16T10:28:39.540 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-16T10:28:39.587 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:28:39.956 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-02-16T10:28:39.957 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2024-02-16T10:28:39.983 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-16T10:28:39.984 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-16T10:28:40.022 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-16T10:28:40.023 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:28:40.326 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-16T10:28:40.353 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-16T10:28:40.392 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:28:40.436 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-16T10:28:40.462 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:40.502 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:40.721 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-16T10:28:40.748 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-16T10:28:40.788 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:28:41.072 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-16T10:28:41.100 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-16T10:28:41.124 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-02-16T10:28:41.130 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-16T10:28:41.151 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-16T10:28:41.191 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-16T10:28:41.417 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2024-02-16T10:28:41.444 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-16T10:28:41.462 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-02-16T10:28:41.478 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-16T10:28:41.483 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:28:41.512 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-16T10:28:41.795 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-16T10:28:41.816 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-16T10:28:41.821 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:41.843 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-16T10:28:41.882 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:28:41.886 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:42.298 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-16T10:28:42.325 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-16T10:28:42.353 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-02-16T10:28:42.364 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:28:42.380 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-16T10:28:42.419 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-16T10:28:42.732 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-16T10:28:42.758 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-16T10:28:42.798 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:28:42.877 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2024-02-16T10:28:42.903 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-16T10:28:42.943 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:28:43.299 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-16T10:28:43.326 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-16T10:28:43.365 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:28:43.455 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-16T10:28:43.471 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:43.513 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:43.660 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2024-02-16T10:28:43.687 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-16T10:28:43.726 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:28:43.850 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-16T10:28:43.877 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-16T10:28:43.916 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:28:44.228 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-16T10:28:44.256 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:28:44.294 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:28:44.417 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-16T10:28:44.445 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:44.556 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-02-16T10:28:44.569 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:44.584 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:28:44.622 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-16T10:28:44.868 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-02-16T10:28:44.895 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-16T10:28:44.934 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:28:45.230 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-02-16T10:28:45.258 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-16T10:28:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:28:45.573 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2024-02-16T10:28:45.600 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-16T10:28:45.631 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-16T10:28:45.642 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-02-16T10:28:45.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:45.692 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:45.917 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-16T10:28:45.932 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-16T10:28:45.975 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:28:46.653 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-16T10:28:46.680 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-16T10:28:46.719 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:28:47.039 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2024-02-16T10:28:47.066 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-16T10:28:47.106 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-16T10:28:47.384 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2024-02-16T10:28:47.411 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-16T10:28:47.442 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-16T10:28:47.704 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-16T10:28:47.731 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-16T10:28:47.787 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:28:48.098 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2024-02-16T10:28:48.125 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-16T10:28:48.131 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-02-16T10:28:48.159 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:48.164 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-16T10:28:48.198 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:48.476 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-16T10:28:48.503 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-16T10:28:48.511 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-16T10:28:48.538 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:48.542 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:28:48.577 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:48.872 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-16T10:28:48.900 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-16T10:28:48.930 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:28:49.198 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-16T10:28:49.214 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:49.236 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-16T10:28:49.247 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:49.263 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-16T10:28:49.327 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:28:49.500 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-16T10:28:49.528 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-16T10:28:49.575 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:28:49.699 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-02-16T10:28:49.726 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-16T10:28:49.765 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:28:49.928 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-16T10:28:49.956 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:28:49.994 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:28:50.163 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-02-16T10:28:50.191 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-16T10:28:50.229 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:28:50.263 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2024-02-16T10:28:50.291 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-16T10:28:50.339 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-16T10:28:50.491 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-16T10:28:50.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-16T10:28:50.549 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:28:50.583 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2024-02-16T10:28:50.599 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-16T10:28:50.632 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:28:50.935 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2024-02-16T10:28:50.951 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-16T10:28:50.970 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-16T10:28:50.994 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:28:50.997 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-16T10:28:51.036 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-16T10:28:51.339 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-02-16T10:28:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2024-02-16T10:28:51.367 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-16T10:28:51.367 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:51.397 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:51.406 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-16T10:28:51.718 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-02-16T10:28:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-16T10:28:51.776 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:28:52.097 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-02-16T10:28:52.124 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-16T10:28:52.163 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-16T10:28:52.483 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-02-16T10:28:52.510 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-16T10:28:52.550 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-16T10:28:52.870 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-02-16T10:28:52.898 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-16T10:28:52.937 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:28:53.433 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-16T10:28:53.461 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-16T10:28:53.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:28:53.727 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2024-02-16T10:28:53.754 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1461-g6a4516ad-1jammy_all.deb ... 2024-02-16T10:28:53.786 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-02-16T10:28:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:53.814 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-16T10:28:53.853 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-16T10:28:54.088 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-16T10:28:54.104 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:54.148 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-02-16T10:28:54.155 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-16T10:28:54.214 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:28:54.474 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-16T10:28:54.502 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-16T10:28:54.535 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-02-16T10:28:54.540 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:28:54.563 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-16T10:28:54.601 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:28:54.836 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-16T10:28:54.852 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-16T10:28:54.871 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-16T10:28:54.886 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:28:54.899 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-16T10:28:54.938 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:28:55.274 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2024-02-16T10:28:55.301 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-16T10:28:55.340 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:28:55.651 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-02-16T10:28:55.678 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-radosgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:55.717 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:55.762 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package pkg-config. 2024-02-16T10:28:55.789 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-16T10:28:55.828 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:28:56.089 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-16T10:28:56.117 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-16T10:28:56.156 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:28:56.546 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-02-16T10:28:56.574 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:28:56.600 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-16T10:28:56.621 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:56.628 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-16T10:28:56.667 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-16T10:28:56.909 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-16T10:28:57.160 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:28:57.253 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2024-02-16T10:28:57.280 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-16T10:28:57.286 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:28:57.311 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-16T10:28:57.554 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-16T10:28:57.614 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2024-02-16T10:28:57.642 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-16T10:28:57.689 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:28:57.892 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-16T10:28:57.942 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2024-02-16T10:28:57.969 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-16T10:28:58.000 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-16T10:28:58.275 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-16T10:28:58.319 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2024-02-16T10:28:58.347 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-16T10:28:58.347 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:28:58.385 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-16T10:28:58.681 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pygments. 2024-02-16T10:28:58.697 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-16T10:28:58.730 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:28:58.865 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-02-16T10:28:59.021 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:28:59.159 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-16T10:28:59.175 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-16T10:28:59.209 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:28:59.298 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:28:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-toml. 2024-02-16T10:28:59.524 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:28:59.539 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-16T10:28:59.578 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-16T10:28:59.642 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:28:59.881 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2024-02-16T10:28:59.902 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-16T10:28:59.908 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-16T10:28:59.947 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:29:00.170 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:29:00.293 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2024-02-16T10:29:00.296 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-16T10:29:00.321 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-16T10:29:00.359 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:29:00.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:29:00.628 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-16T10:29:00.656 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-16T10:29:00.694 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:29:00.967 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-16T10:29:01.218 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-16T10:29:01.474 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2024-02-16T10:29:01.495 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:29:01.502 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../116-radosgw_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:29:01.540 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:01.763 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:29:02.031 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:29:02.266 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:29:02.368 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2024-02-16T10:29:02.396 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1461-g6a4516ad-1jammy_amd64.deb ... 2024-02-16T10:29:02.434 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:02.534 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:02.738 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-16T10:29:02.885 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:29:02.989 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-16T10:29:03.013 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:29:03.115 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-16T10:29:03.139 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:29:03.240 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:29:03.381 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-16T10:29:03.567 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:29:03.726 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-16T10:29:03.960 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-16T10:29:03.990 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-16T10:29:04.054 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:29:04.134 INFO:teuthology.orchestra.run.smithi107.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-16T10:29:04.189 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-16T10:29:04.216 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:04.540 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:29:04.641 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-16T10:29:04.901 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:29:05.177 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:29:05.185 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2024-02-16T10:29:05.340 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-16T10:29:05.495 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-02-16T10:29:05.616 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-16T10:29:05.621 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:29:05.876 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-16T10:29:06.001 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-16T10:29:06.261 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-16T10:29:06.340 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:29:06.495 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-16T10:29:06.600 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:29:06.605 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-16T10:29:06.726 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:29:06.853 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:29:06.898 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-16T10:29:07.154 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-16T10:29:07.267 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-16T10:29:07.526 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-16T10:29:07.589 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-16T10:29:07.810 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-16T10:29:07.823 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:29:08.037 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-16T10:29:08.200 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:29:08.280 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-16T10:29:08.502 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:29:08.614 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-16T10:29:08.862 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:29:08.873 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:09.130 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:29:09.133 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-16T10:29:09.247 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:09.259 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-16T10:29:09.384 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-16T10:29:09.510 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-16T10:29:09.524 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2024-02-16T10:29:09.761 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-16T10:29:09.834 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:29:10.164 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-16T10:29:10.192 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-16T10:29:10.256 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-16T10:29:10.382 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-16T10:29:10.758 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-16T10:29:10.884 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-16T10:29:10.999 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:29:11.160 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-16T10:29:11.234 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:11.368 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-16T10:29:11.419 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-16T10:29:11.628 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:29:11.729 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up zip (3.0-12build2) ... 2024-02-16T10:29:11.754 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:29:11.847 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-16T10:29:11.872 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:29:12.149 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:29:12.392 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-16T10:29:12.643 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:12.673 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-16T10:29:12.769 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:29:12.941 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-16T10:29:13.067 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-16T10:29:13.071 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:29:13.193 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-16T10:29:13.331 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-16T10:29:13.494 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-16T10:29:13.574 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-16T10:29:13.845 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-16T10:29:14.025 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:29:14.088 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-16T10:29:14.276 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-16T10:29:14.456 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-16T10:29:14.544 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:29:14.670 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-16T10:29:14.740 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-16T10:29:14.955 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:29:15.057 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:29:15.083 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-16T10:29:15.324 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:29:15.342 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-16T10:29:15.468 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:15.626 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:29:15.744 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-idna (3.3-1) ... 2024-02-16T10:29:15.877 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:29:16.004 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:29:16.073 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-16T10:29:16.129 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:29:16.220 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-16T10:29:16.448 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:29:16.558 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:29:16.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:29:17.226 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-16T10:29:17.236 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-16T10:29:17.354 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-16T10:29:17.436 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:17.545 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-16T10:29:17.588 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:17.706 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:29:17.805 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-16T10:29:17.931 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-16T10:29:18.007 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:29:18.056 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-16T10:29:18.300 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:29:18.349 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-16T10:29:18.569 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-16T10:29:18.600 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-16T10:29:18.695 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-16T10:29:18.851 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:18.953 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-16T10:29:18.963 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-16T10:29:19.237 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-16T10:29:19.239 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:29:19.488 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-16T10:29:19.568 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:29:19.747 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-16T10:29:19.937 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-16T10:29:20.032 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-16T10:29:20.214 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:29:20.299 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-16T10:29:20.533 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:29:20.567 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-16T10:29:20.659 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:20.693 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-16T10:29:20.786 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:20.912 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:29:20.960 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-16T10:29:21.070 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-16T10:29:21.232 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:21.350 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:21.362 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-16T10:29:21.477 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-16T10:29:21.664 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-16T10:29:21.786 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:21.913 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:21.914 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-16T10:29:22.041 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-16T10:29:22.069 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-16T10:29:22.256 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-16T10:29:22.268 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:29:22.268 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:29:22.510 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-16T10:29:22.611 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-16T10:29:22.732 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:22.842 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:22.968 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:22.979 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-16T10:29:23.094 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:29:23.263 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-16T10:29:23.389 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-16T10:29:23.648 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-16T10:29:23.774 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-16T10:29:24.109 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-16T10:29:24.290 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:24.401 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-16T10:29:24.416 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:24.543 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:24.669 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:24.669 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-16T10:29:24.787 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-16T10:29:24.787 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:25.071 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-16T10:29:25.255 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-02-16T10:29:25.347 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-16T10:29:25.608 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-02-16T10:29:25.683 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-16T10:29:25.785 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-02-16T10:29:25.796 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-16T10:29:25.929 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-16T10:29:26.060 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-16T10:29:26.243 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-16T10:29:26.345 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-16T10:29:26.680 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-16T10:29:26.723 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:26.781 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:26.849 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:26.882 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:27.000 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-16T10:29:27.336 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:27.338 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:29:27.339 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:29:27.462 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:27.588 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-16T10:29:27.835 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:27.856 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:28.170 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-16T10:29:28.199 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:28.308 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:28.520 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:29:28.521 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-16T10:29:28.654 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:28.865 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:29:28.865 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:29:29.001 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:29.102 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:29.211 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:29.337 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-16T10:29:29.356 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:29.551 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:29:29.552 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:29:30.024 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.302 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:29:30.302 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:29:30.490 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.608 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.734 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.801 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.860 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.928 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:30.986 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:31.079 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:31.289 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:29:31.289 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:29:31.495 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2024-02-16T10:29:31.764 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:31.863 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2024-02-16T10:29:31.882 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:31.981 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2024-02-16T10:29:31.991 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:31.997 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-16T10:29:32.142 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:32.151 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-16T10:29:32.467 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-16T10:29:32.495 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-16T10:29:32.631 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-16T10:29:32.783 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-16T10:29:32.955 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:33.081 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:33.525 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:29:33.525 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-16T10:29:33.920 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-16T10:29:33.991 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:34.334 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-16T10:29:34.557 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-16T10:29:34.563 DEBUG:teuthology.parallel:result is None 2024-02-16T10:29:34.810 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:35.022 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:29:35.022 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-16T10:29:35.503 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:35.752 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:29:35.752 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-16T10:29:36.213 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:36.441 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:29:36.441 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-16T10:29:36.881 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:37.007 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:37.158 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:37.371 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:29:37.371 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-16T10:29:37.826 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:37.977 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:38.103 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:38.254 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (19.0.0-1461-g6a4516ad-1jammy) ... 2024-02-16T10:29:38.861 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-16T10:29:39.046 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-16T10:29:39.281 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-16T10:29:40.482 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-16T10:29:41.129 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-16T10:29:41.135 DEBUG:teuthology.parallel:result is None 2024-02-16T10:29:41.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:29:41.277 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2024-02-16T10:29:41.295 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:29:41.296 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:29:41.296 INFO:teuthology.task.install:The correct ceph version 19.0.0-1461-g6a4516ad-1jammy is installed. 2024-02-16T10:29:41.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6a4516ad3eca4b7cf7d93b64055992bfc2113285 2024-02-16T10:29:41.440 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-02-16T10:29:41.459 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:29:41.460 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1461-g6a4516ad-1jammy 2024-02-16T10:29:41.460 INFO:teuthology.task.install:The correct ceph version 19.0.0-1461-g6a4516ad-1jammy is installed. 2024-02-16T10:29:41.462 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-16T10:29:41.462 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:41.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T10:29:41.476 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:41.476 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-16T10:29:41.521 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-16T10:29:41.521 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:41.521 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T10:29:41.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T10:29:41.590 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:41.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-02-16T10:29:41.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-16T10:29:41.659 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-16T10:29:41.659 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:41.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T10:29:41.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T10:29:41.725 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:41.725 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-16T10:29:41.738 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-16T10:29:41.790 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-16T10:29:41.790 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:41.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T10:29:41.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T10:29:41.857 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:41.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-02-16T10:29:41.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-16T10:29:41.927 INFO:teuthology.run_tasks:Running task ceph... 2024-02-16T10:29:42.017 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-16T10:29:42.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-02-16T10:29:42.021 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-02-16T10:29:42.034 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-16T10:29:42.034 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T10:29:42.076 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-16T10:29:42.088 INFO:tasks.ceph:Creating extra log directories... 2024-02-16T10:29:42.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T10:29:42.132 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-16T10:29:42.154 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-16T10:29:42.154 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-16T10:29:42.155 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795', 'branch': 'wip-cbodley-testing', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7561795', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 0, 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBC6nXrM+OlF3aafwpMNs7Np4TJA+QMDswYRDat8a0+w4BFAI9SznJ3h29y3218fB+v5492vJ1qXn0H+yJ3oVI=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGzAcIUZ/qYTjP43Vy5kCT9OIQgki1Lv8KAzjb4Esofbb4K6FvArPg0VhO0gPDA6beK9BzhqGY4WJqswewmN6Wg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '6a4516ad3eca4b7cf7d93b64055992bfc2113285', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-15_21:52:48', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-16T10:29:42.155 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T10:29:42.188 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-16T10:29:42.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T10:29:42.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-02-16T10:29:42.249 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:42.249 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T10:29:42.295 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T10:29:42.295 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-02-16 10:24:24.736848379 +0000 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-02-16 10:24:24.492850558 +0000 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-02-16 10:24:24.492850558 +0000 2024-02-16T10:29:42.343 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-02-16T10:29:42.343 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T10:29:42.397 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-02-16T10:29:42.397 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-02-16T10:29:42.397 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00044451 s, 1.2 MB/s 2024-02-16T10:29:42.398 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T10:29:42.448 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-02-16T10:29:42.495 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-02-16 10:24:25.236843912 +0000 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-02-16 10:24:24.960846378 +0000 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-02-16 10:24:24.960846378 +0000 2024-02-16T10:29:42.496 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-02-16T10:29:42.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T10:29:42.548 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-02-16T10:29:42.548 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-02-16T10:29:42.548 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000419714 s, 1.2 MB/s 2024-02-16T10:29:42.550 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T10:29:42.600 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-02-16 10:24:25.456841947 +0000 2024-02-16T10:29:42.647 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-02-16 10:24:25.452841983 +0000 2024-02-16T10:29:42.648 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-02-16 10:24:25.452841983 +0000 2024-02-16T10:29:42.648 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-02-16T10:29:42.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T10:29:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-02-16T10:29:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-02-16T10:29:42.701 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000410851 s, 1.2 MB/s 2024-02-16T10:29:42.702 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T10:29:42.752 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-02-16T10:29:42.799 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T10:29:42.799 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:42.799 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-02-16T10:29:42.800 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:42.800 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-02-16 10:24:26.240834945 +0000 2024-02-16T10:29:42.800 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-02-16 10:24:25.960837446 +0000 2024-02-16T10:29:42.800 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-02-16 10:24:25.960837446 +0000 2024-02-16T10:29:42.800 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-02-16T10:29:42.800 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T10:29:42.853 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-02-16T10:29:42.853 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-02-16T10:29:42.853 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000319682 s, 1.6 MB/s 2024-02-16T10:29:42.854 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T10:29:42.904 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T10:29:42.904 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:42.904 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-02-16T10:29:42.910 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-16T10:29:42.910 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-16 10:24:26.033523751 +0000 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-16 10:24:25.789525930 +0000 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-16 10:24:25.789525930 +0000 2024-02-16T10:29:42.960 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-16T10:29:42.960 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-16T10:29:43.018 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-16T10:29:43.018 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-16T10:29:43.018 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000438201 s, 1.2 MB/s 2024-02-16T10:29:43.020 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-16T10:29:43.069 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-16 10:24:26.257521750 +0000 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-16 10:24:26.253521786 +0000 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-16 10:24:26.253521786 +0000 2024-02-16T10:29:43.115 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-16T10:29:43.116 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-16T10:29:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-16T10:29:43.170 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-16T10:29:43.170 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000311272 s, 1.6 MB/s 2024-02-16T10:29:43.171 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-16T10:29:43.221 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-02-16T10:29:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-16 10:24:26.989515211 +0000 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-16 10:24:26.737517463 +0000 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-16 10:24:26.737517463 +0000 2024-02-16T10:29:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-16T10:29:43.268 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-16T10:29:43.322 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-16T10:29:43.322 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-16T10:29:43.322 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00036748 s, 1.4 MB/s 2024-02-16T10:29:43.323 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-16T10:29:43.372 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-02-16T10:29:43.419 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-16T10:29:43.419 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-16T10:29:43.419 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-02-16T10:29:43.419 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-16T10:29:43.419 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-16 10:24:27.257512818 +0000 2024-02-16T10:29:43.420 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-16 10:24:27.253512853 +0000 2024-02-16T10:29:43.420 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-16 10:24:27.253512853 +0000 2024-02-16T10:29:43.420 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-02-16T10:29:43.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-16T10:29:43.473 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-16T10:29:43.474 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-16T10:29:43.474 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000384903 s, 1.3 MB/s 2024-02-16T10:29:43.475 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-16T10:29:43.524 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:29:43.525 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T10:29:43.525 INFO:tasks.ceph:Generating config... 2024-02-16T10:29:43.526 INFO:tasks.ceph:[client] debug ms = 1 2024-02-16T10:29:43.526 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-02-16T10:29:43.526 INFO:tasks.ceph:[client] debug rgw = 20 2024-02-16T10:29:43.526 INFO:tasks.ceph:[client] setgroup = ceph 2024-02-16T10:29:43.526 INFO:tasks.ceph:[client] setuser = ceph 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug objclass = 20 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-16T10:29:43.527 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-16T10:29:43.528 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-16T10:29:43.528 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-16T10:29:43.528 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-16T10:29:43.528 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-16T10:29:43.528 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-16T10:29:43.528 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-16T10:29:43.528 INFO:tasks.ceph:Setting up mon.a... 2024-02-16T10:29:43.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-16T10:29:43.563 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-02-16T10:29:43.586 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-16T10:29:43.665 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:29:43.717 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107')] 2024-02-16T10:29:43.718 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-02-16T10:29:43.719 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:43.719 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T10:29:43.763 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:43.843 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:29:43.844 INFO:teuthology.orchestra.run.smithi107.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:29:43.845 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:43.845 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid dfa5632e-b877-4440-87a8-22335bb237e0 2024-02-16T10:29:43.845 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = quincy 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:fsid dfa5632e-b877-4440-87a8-22335bb237e0 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-02-16T10:29:43.842268+0000 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-02-16T10:29:43.842268+0000 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 17 (quincy) 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-02-16T10:29:43.846 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-02-16T10:29:43.847 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-16T10:29:43.890 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dfa5632e-b877-4440-87a8-22335bb237e0... 2024-02-16T10:29:43.891 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T10:29:43.936 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.964 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-02-16T10:29:43.965 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.966 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = 172.21.15.107 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = dfa5632e-b877-4440-87a8-22335bb237e0 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-02-16T10:29:43.967 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.968 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: debug objclass = 20 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-02-16T10:29:43.969 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-02-16T10:29:43.970 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-02-16T10:29:43.971 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.972 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: rgw gc obj min wait = 15 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: debug rgw = 20 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: setgroup = ceph 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout: setuser = ceph 2024-02-16T10:29:43.973 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.976 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = 172.21.15.107 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = dfa5632e-b877-4440-87a8-22335bb237e0 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-02-16T10:29:43.978 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-02-16T10:29:43.979 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: debug objclass = 20 2024-02-16T10:29:43.980 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.981 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-02-16T10:29:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-16T10:29:43.983 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-02-16T10:29:43.984 INFO:teuthology.orchestra.run.smithi138.stdout: rgw gc obj min wait = 15 2024-02-16T10:29:43.985 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw = 20 2024-02-16T10:29:43.985 INFO:teuthology.orchestra.run.smithi138.stdout: setgroup = ceph 2024-02-16T10:29:43.985 INFO:teuthology.orchestra.run.smithi138.stdout: setuser = ceph 2024-02-16T10:29:43.985 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-02-16T10:29:43.985 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-16T10:29:43.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-16T10:29:44.065 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-16T10:29:44.066 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:44.066 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-16T10:29:44.071 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:44.071 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-16T10:29:44.119 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-02-16T10:29:44.119 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:44.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T10:29:44.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:29:44.183 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:44.183 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:44.231 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:29:44.231 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:44.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-16T10:29:44.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-16T10:29:44.254 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:44.254 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:44.300 INFO:tasks.ceph:Setting up mon nodes... 2024-02-16T10:29:44.300 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-16T10:29:44.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T10:29:44.384 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-16T10:29:44.400 INFO:tasks.ceph:Setting up mds nodes... 2024-02-16T10:29:44.400 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-16T10:29:44.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-16T10:29:44.476 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-16T10:29:44.488 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-16T10:29:44.488 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-02-16T10:29:44.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-16T10:29:44.502 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-02-16T10:29:44.502 INFO:tasks.ceph:role: osd.0 2024-02-16T10:29:44.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-02-16T10:29:44.502 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T10:29:44.565 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:29:44.566 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:29:45.021 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-02-16T10:29:45.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-02-16T10:29:45.023 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-16T10:29:45.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-16T10:29:45.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:29:45.126 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:29:45.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:45.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.234+0000 7f42d40017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-16T10:29:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.238+0000 7f42d40017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-16T10:29:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.238+0000 7f42d40017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:29:45.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.238+0000 7f42d40017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:29:45.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.242+0000 7f42d40017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-16T10:29:45.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:29:45.242+0000 7f42d40017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-16T10:29:48.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-16T10:29:48.244 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-16T10:29:48.258 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:29:48.258 INFO:tasks.ceph:role: osd.1 2024-02-16T10:29:48.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:29:48.258 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:29:48.324 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:29:48.778 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-02-16T10:29:48.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-02-16T10:29:48.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-16T10:29:48.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-16T10:29:48.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:29:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:29:48.881 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-16T10:29:48.933 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:29:48.933 INFO:tasks.ceph:role: osd.2 2024-02-16T10:29:48.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:29:48.933 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:29:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:29:49.459 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-02-16T10:29:49.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-02-16T10:29:49.462 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-02-16T10:29:49.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-16T10:29:49.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:29:49.609 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:29:49.610 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-16T10:29:49.663 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-02-16T10:29:49.663 INFO:tasks.ceph:role: osd.3 2024-02-16T10:29:49.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:29:49.663 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-16T10:29:49.727 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-16T10:29:49.728 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-16T10:29:50.199 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-02-16T10:29:50.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-02-16T10:29:50.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-02-16T10:29:50.347 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-16T10:29:50.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:29:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-02-16T10:29:50.359 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:50.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-16T10:29:50.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-16T10:29:50.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:29:50.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:29:50.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-16T10:29:50.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:50.469+0000 7fea7092f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-16T10:29:53.449 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-16T10:29:53.463 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:53.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-16T10:29:53.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-16T10:29:53.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:29:53.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:29:53.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-16T10:29:53.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:53.537+0000 7f6f825117c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-16T10:29:56.540 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-16T10:29:56.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:29:56.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-16T10:29:56.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-16T10:29:56.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:29:56.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:29:56.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-16T10:29:56.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:29:56.669+0000 7fefc578b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-16T10:29:59.656 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-16T10:29:59.716 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-16T10:29:59.717 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:29:59.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-16T10:29:59.732 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:59.732 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-16T10:29:59.771 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:59.771 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-16T10:29:59.827 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:59.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-16T10:29:59.882 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:59.882 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-16T10:29:59.938 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:29:59.938 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-16T10:29:59.987 INFO:tasks.ceph:Adding keys to all mons... 2024-02-16T10:29:59.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAZOc9l5VtIDhAAT9gDz1gBTAAIrrbHRkScmg== 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAYOc9lt9a4FhAA9sCC5+NfHM/EGrD9/81h/Q== 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAeOc9l7yY1HBAAQMSvCThpBJdl9rslOy5TkA== 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-02-16T10:29:59.999 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAhOc9lTG9GIBAAI0BZpVEHbeVans8Zv2+Ipg== 2024-02-16T10:30:00.000 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-02-16T10:30:00.000 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAkOc9ltr8jKBAAS04eg8jmY1bI5iRk+VStJw== 2024-02-16T10:30:00.000 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-02-16T10:30:00.000 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAYOc9lNvs5HBAAUaglqGHYkLQPrnmUi85QEA== 2024-02-16T10:30:00.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:30:00.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-16T10:30:00.168 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:30:00.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:30:00.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-16T10:30:00.415 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-16T10:30:00.501 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-16T10:30:00.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-16T10:30:00.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-16T10:30:00.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-16T10:30:00.658 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-16T10:30:00.707 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-16T10:30:00.708 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-16T10:30:00.708 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-16T10:30:00.751 INFO:tasks.ceph.mon.a:Started 2024-02-16T10:30:00.752 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-16T10:30:00.752 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-16T10:30:00.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-16T10:30:00.755 INFO:tasks.ceph.mgr.x:Started 2024-02-16T10:30:00.755 INFO:tasks.ceph:Setting crush tunables to default 2024-02-16T10:30:00.755 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-02-16T10:30:00.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.870+0000 7f527acf3640 1 Processor -- start 2024-02-16T10:30:00.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.870+0000 7f527acf3640 1 -- start start 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f527acf3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f527406e040 0x7f52741333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f527acf3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527406f070 con 0x7f527406d550 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f527acf3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527406e950 con 0x7f527406e040 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f5273fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f527406e040 0x7f52741333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f5273fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f527406e040 0x7f52741333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41728/0 (socket says 172.21.15.107:41728) 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f5273fff640 1 -- 172.21.15.107:0/2621309483 learned_addr learned my addr 172.21.15.107:0/2621309483 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:00.879 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f5273fff640 1 -- 172.21.15.107:0/2621309483 >> v1:172.21.15.107:6789/0 conn(0x7f527406d550 legacy=0x7f527406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:00.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.874+0000 7f5273fff640 1 -- 172.21.15.107:0/2621309483 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527409b570 con 0x7f527406e040 2024-02-16T10:30:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5273fff640 1 --2- 172.21.15.107:0/2621309483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406e040 0x7f52741333f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f52600097f0 tx=0x7f526001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79552b0927a611f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52737fe640 1 -- 172.21.15.107:0/2621309483 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52600ab530 con 0x7f527406e040 2024-02-16T10:30:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52737fe640 1 -- 172.21.15.107:0/2621309483 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600a7050 con 0x7f527406e040 2024-02-16T10:30:00.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52737fe640 1 -- 172.21.15.107:0/2621309483 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52600ab7e0 con 0x7f527406e040 2024-02-16T10:30:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/2621309483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406e040 msgr2=0x7f52741333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 --2- 172.21.15.107:0/2621309483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406e040 0x7f52741333f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f52600097f0 tx=0x7f526001c430 comp rx=0 tx=0).stop 2024-02-16T10:30:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/2621309483 shutdown_connections 2024-02-16T10:30:00.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 --2- 172.21.15.107:0/2621309483 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406e040 0x7f52741333f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/2621309483 >> 172.21.15.107:0/2621309483 conn(0x7f527409c2f0 msgr2=0x7f5274071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/2621309483 shutdown_connections 2024-02-16T10:30:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/2621309483 wait complete. 2024-02-16T10:30:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 Processor -- start 2024-02-16T10:30:00.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- start start 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52741222d0 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5278a8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5278a8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41734/0 (socket says 172.21.15.107:41734) 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5278a8f640 1 -- 172.21.15.107:0/4121145143 learned_addr learned my addr 172.21.15.107:0/4121145143 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5278a8f640 1 -- 172.21.15.107:0/4121145143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600094d0 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f5278a8f640 1 --2- 172.21.15.107:0/4121145143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f526800c480 tx=0x7f526800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5268005150 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680052b0 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5274120ce0 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5268007030 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52741311f0 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5268007520 con 0x7f527406d550 2024-02-16T10:30:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.894+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5268003d00 con 0x7f527406d550 2024-02-16T10:30:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.898+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274062980 con 0x7f527406d550 2024-02-16T10:30:00.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.910+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f52680036b0 con 0x7f527406d550 2024-02-16T10:30:00.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f52741211c0 con 0x7f527406d550 2024-02-16T10:30:00.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f52717fa640 1 -- 172.21.15.107:0/4121145143 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5268006880 con 0x7f527406d550 2024-02-16T10:30:00.981 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 msgr2=0x7f527412ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 --2- 172.21.15.107:0/4121145143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f526800c480 tx=0x7f526800c940 comp rx=0 tx=0).stop 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 shutdown_connections 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 --2- 172.21.15.107:0/4121145143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f527406d550 0x7f527412ea60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.974+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 >> 172.21.15.107:0/4121145143 conn(0x7f527409c2f0 msgr2=0x7f527406f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:00.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.978+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 shutdown_connections 2024-02-16T10:30:00.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:00.978+0000 7f527acf3640 1 -- 172.21.15.107:0/4121145143 wait complete. 2024-02-16T10:30:00.999 INFO:tasks.ceph:check_enable_crimson: False 2024-02-16T10:30:00.999 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-16T10:30:00.999 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-02-16T10:30:00.999 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-16T10:30:01.012 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:30:01.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-16T10:30:01.026 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:30:01.026 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-16T10:30:01.083 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-16T10:30:01.083 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-16T10:30:01.142 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new e30b1f56-9d73-4706-ad70-510f64ec8246 0 2024-02-16T10:30:01.194 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:01.185+0000 7f32a3e38180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04aa19e640 1 Processor -- start 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04aa19e640 1 -- start start 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04aa19e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04a4118270 0x7f04a411a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04aa19e640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a411aba0 con 0x7f04a4115540 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04aa19e640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a411bd60 con 0x7f04a4118270 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a2ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04a4118270 0x7f04a411a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a37fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f04a4115540 0x7f04a4115920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:55438/0 (socket says 172.21.15.138:55438) 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a2ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04a4118270 0x7f04a411a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:34694/0 (socket says 172.21.15.138:34694) 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a37fe640 1 -- 172.21.15.138:0/1106778848 learned_addr learned my addr 172.21.15.138:0/1106778848 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265268062 0 0) 0x7f04a411aba0 con 0x7f04a4115540 2024-02-16T10:30:01.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f048c003530 con 0x7f04a4115540 2024-02-16T10:30:01.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3231082191 0 0) 0x7f048c003530 con 0x7f04a4115540 2024-02-16T10:30:01.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a2ffd640 1 -- 172.21.15.138:0/1106778848 >> v1:172.21.15.107:6789/0 conn(0x7f04a4115540 legacy=0x7f04a4115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.301+0000 7f04a2ffd640 1 -- 172.21.15.138:0/1106778848 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a411bed0 con 0x7f04a4118270 2024-02-16T10:30:01.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04a2ffd640 1 --2- 172.21.15.138:0/1106778848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4118270 0x7f04a411a660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0498009740 tx=0x7f049801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd86310f140b1ee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f049c001930 con 0x7f04a4118270 2024-02-16T10:30:01.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980a7050 con 0x7f04a4118270 2024-02-16T10:30:01.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04a27fc640 1 -- 172.21.15.138:0/1106778848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04980ab530 con 0x7f04a4118270 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 -- 172.21.15.138:0/1106778848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4118270 msgr2=0x7f04a411a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 --2- 172.21.15.138:0/1106778848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4118270 0x7f04a411a660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0498009740 tx=0x7f049801c320 comp rx=0 tx=0).stop 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 -- 172.21.15.138:0/1106778848 shutdown_connections 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 --2- 172.21.15.138:0/1106778848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4118270 0x7f04a411a660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 -- 172.21.15.138:0/1106778848 >> 172.21.15.138:0/1106778848 conn(0x7f04a406eff0 msgr2=0x7f04a4071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 -- 172.21.15.138:0/1106778848 shutdown_connections 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 -- 172.21.15.138:0/1106778848 wait complete. 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.305+0000 7f04aa19e640 1 Processor -- start 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 -- start start 2024-02-16T10:30:01.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41ac6b0 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04a37fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:34702/0 (socket says 172.21.15.138:34702) 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04a37fe640 1 -- 172.21.15.138:0/3142226412 learned_addr learned my addr 172.21.15.138:0/3142226412 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04a37fe640 1 -- 172.21.15.138:0/3142226412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498009420 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04a37fe640 1 --2- 172.21.15.138:0/3142226412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f049c00cfc0 tx=0x7f049c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f049c00ad70 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c012400 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a41ac8b0 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f049c012570 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a41a6180 con 0x7f04a4115540 2024-02-16T10:30:01.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f049c0126d0 con 0x7f04a4115540 2024-02-16T10:30:01.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f049c007070 con 0x7f04a4115540 2024-02-16T10:30:01.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.309+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a4062980 con 0x7f04a4115540 2024-02-16T10:30:01.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.317+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f049c021060 con 0x7f04a4115540 2024-02-16T10:30:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.385+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e30b1f56-9d73-4706-ad70-510f64ec8246", "id": 0} v 0) v1 -- 0x7f04a411b8e0 con 0x7f04a4115540 2024-02-16T10:30:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.385+0000 7f048bfff640 1 -- 172.21.15.138:0/3142226412 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e30b1f56-9d73-4706-ad70-510f64ec8246", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f049c017070 con 0x7f04a4115540 2024-02-16T10:30:01.393 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.385+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 msgr2=0x7f04a41ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.385+0000 7f04aa19e640 1 --2- 172.21.15.138:0/3142226412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f049c00cfc0 tx=0x7f049c00a430 comp rx=0 tx=0).stop 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.389+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 shutdown_connections 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.389+0000 7f04aa19e640 1 --2- 172.21.15.138:0/3142226412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04a4115540 0x7f04a41ac0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.389+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 >> 172.21.15.138:0/3142226412 conn(0x7f04a406eff0 msgr2=0x7f04a4118820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.389+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 shutdown_connections 2024-02-16T10:30:01.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.389+0000 7f04aa19e640 1 -- 172.21.15.138:0/3142226412 wait complete. 2024-02-16T10:30:01.410 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 1da30104-8813-42b7-a590-7292fa7f6ab4 1 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab2ad4640 1 Processor -- start 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab2ad4640 1 -- start start 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab2ad4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faaac118270 0x7faaac11a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab2ad4640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac11aba0 con 0x7faaac115570 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab2ad4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac11bd60 con 0x7faaac118270 2024-02-16T10:30:01.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faaabfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faaac118270 0x7faaac11a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab0870640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7faaac115570 0x7faaac115950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:55446/0 (socket says 172.21.15.138:55446) 2024-02-16T10:30:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faab0870640 1 -- 172.21.15.138:0/1856115001 learned_addr learned my addr 172.21.15.138:0/1856115001 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faaab7fe640 1 -- 172.21.15.138:0/1856115001 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866533780 0 0) 0x7faaac11aba0 con 0x7faaac115570 2024-02-16T10:30:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faaab7fe640 1 -- 172.21.15.138:0/1856115001 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa94003530 con 0x7faaac115570 2024-02-16T10:30:01.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faaabfff640 1 -- 172.21.15.138:0/1856115001 >> v1:172.21.15.107:6789/0 conn(0x7faaac115570 legacy=0x7faaac115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.561+0000 7faaabfff640 1 -- 172.21.15.138:0/1856115001 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac11bed0 con 0x7faaac118270 2024-02-16T10:30:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faaabfff640 1 --2- 172.21.15.138:0/1856115001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac118270 0x7faaac11a660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009740 tx=0x7faaa001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91047ebc382936a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faaab7fe640 1 -- 172.21.15.138:0/1856115001 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa00a8050 con 0x7faaac118270 2024-02-16T10:30:01.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faaab7fe640 1 -- 172.21.15.138:0/1856115001 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa00ac520 con 0x7faaac118270 2024-02-16T10:30:01.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faaab7fe640 1 -- 172.21.15.138:0/1856115001 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa00ac7c0 con 0x7faaac118270 2024-02-16T10:30:01.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- 172.21.15.138:0/1856115001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac118270 msgr2=0x7faaac11a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 --2- 172.21.15.138:0/1856115001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac118270 0x7faaac11a660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009740 tx=0x7faaa001c370 comp rx=0 tx=0).stop 2024-02-16T10:30:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- 172.21.15.138:0/1856115001 shutdown_connections 2024-02-16T10:30:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 --2- 172.21.15.138:0/1856115001 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac118270 0x7faaac11a660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- 172.21.15.138:0/1856115001 >> 172.21.15.138:0/1856115001 conn(0x7faaac06f7c0 msgr2=0x7faaac071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- 172.21.15.138:0/1856115001 shutdown_connections 2024-02-16T10:30:01.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- 172.21.15.138:0/1856115001 wait complete. 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 Processor -- start 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- start start 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.565+0000 7faab2ad4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac10e730 con 0x7faaac115570 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab0870640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab0870640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:34712/0 (socket says 172.21.15.138:34712) 2024-02-16T10:30:01.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab0870640 1 -- 172.21.15.138:0/1826281905 learned_addr learned my addr 172.21.15.138:0/1826281905 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab0870640 1 -- 172.21.15.138:0/1826281905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009420 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab0870640 1 --2- 172.21.15.138:0/1826281905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c3d0 tx=0x7faa9c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c005ce0 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac10e930 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c005e40 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa9c007220 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac10edb0 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7faa9c007440 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7faa9c012920 con 0x7faaac115570 2024-02-16T10:30:01.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.569+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac062980 con 0x7faaac115570 2024-02-16T10:30:01.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.573+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7faa9c017070 con 0x7faaac115570 2024-02-16T10:30:01.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.641+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1da30104-8813-42b7-a590-7292fa7f6ab4", "id": 1} v 0) v1 -- 0x7faaac10eff0 con 0x7faaac115570 2024-02-16T10:30:01.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faaa97fa640 1 -- 172.21.15.138:0/1826281905 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1da30104-8813-42b7-a590-7292fa7f6ab4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa9c012c50 con 0x7faaac115570 2024-02-16T10:30:01.652 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-02-16T10:30:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 msgr2=0x7faaac10e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 --2- 172.21.15.138:0/1826281905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c3d0 tx=0x7faa9c00c890 comp rx=0 tx=0).stop 2024-02-16T10:30:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 shutdown_connections 2024-02-16T10:30:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 --2- 172.21.15.138:0/1826281905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaac115570 0x7faaac10e1f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 >> 172.21.15.138:0/1826281905 conn(0x7faaac06f7c0 msgr2=0x7faaac118760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 shutdown_connections 2024-02-16T10:30:01.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.645+0000 7faab2ad4640 1 -- 172.21.15.138:0/1826281905 wait complete. 2024-02-16T10:30:01.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 45c7343b-43ff-4d86-8d32-4b563fcd2be0 2 2024-02-16T10:30:01.679 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:01.669+0000 7f32a3e38180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f468df5a640 1 Processor -- start 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f468df5a640 1 -- start start 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f468df5a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f46881165c0 0x7f46881169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f468df5a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4688117000 con 0x7f46881114b0 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f468df5a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4688112050 con 0x7f46881165c0 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f46877fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f46881165c0 0x7f46881169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f4686ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f46881114b0 0x7f4688111940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:55450/0 (socket says 172.21.15.138:55450) 2024-02-16T10:30:01.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f4686ffd640 1 -- 172.21.15.138:0/1073560762 learned_addr learned my addr 172.21.15.138:0/1073560762 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:01.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f46867fc640 1 -- 172.21.15.138:0/1073560762 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064895224 0 0) 0x7f4688117000 con 0x7f46881114b0 2024-02-16T10:30:01.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f46867fc640 1 -- 172.21.15.138:0/1073560762 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4670003530 con 0x7f46881114b0 2024-02-16T10:30:01.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f46877fe640 1 -- 172.21.15.138:0/1073560762 >> v1:172.21.15.107:6789/0 conn(0x7f46881114b0 legacy=0x7f4688111940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.777+0000 7f46877fe640 1 -- 172.21.15.138:0/1073560762 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46881121c0 con 0x7f46881165c0 2024-02-16T10:30:01.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46877fe640 1 --2- 172.21.15.138:0/1073560762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881165c0 0x7f46881169a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4678009740 tx=0x7f467801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e56d547543df000 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46867fc640 1 -- 172.21.15.138:0/1073560762 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46780a8050 con 0x7f46881165c0 2024-02-16T10:30:01.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46867fc640 1 -- 172.21.15.138:0/1073560762 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46780ac520 con 0x7f46881165c0 2024-02-16T10:30:01.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46867fc640 1 -- 172.21.15.138:0/1073560762 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46780ac7c0 con 0x7f46881165c0 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- 172.21.15.138:0/1073560762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881165c0 msgr2=0x7f46881169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 --2- 172.21.15.138:0/1073560762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881165c0 0x7f46881169a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4678009740 tx=0x7f467801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- 172.21.15.138:0/1073560762 shutdown_connections 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 --2- 172.21.15.138:0/1073560762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881165c0 0x7f46881169a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- 172.21.15.138:0/1073560762 >> 172.21.15.138:0/1073560762 conn(0x7f468806de10 msgr2=0x7f468810fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- 172.21.15.138:0/1073560762 shutdown_connections 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- 172.21.15.138:0/1073560762 wait complete. 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 Processor -- start 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- start start 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f468df5a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881ae9a0 con 0x7f46881114b0 2024-02-16T10:30:01.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46877fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:34730/0 (socket says 172.21.15.138:34730) 2024-02-16T10:30:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.781+0000 7f46877fe640 1 -- 172.21.15.138:0/333497434 learned_addr learned my addr 172.21.15.138:0/333497434 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f46877fe640 1 -- 172.21.15.138:0/333497434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009420 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f46877fe640 1 --2- 172.21.15.138:0/333497434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f467801c3b0 tx=0x7f467801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46780ab8d0 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46881aeb40 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46780aba50 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46780abd30 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46881a8470 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f46780b87e0 con 0x7f46881114b0 2024-02-16T10:30:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f46780c1400 con 0x7f46881114b0 2024-02-16T10:30:01.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.785+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688062980 con 0x7f46881114b0 2024-02-16T10:30:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.789+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f46780dfdd0 con 0x7f46881114b0 2024-02-16T10:30:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.861+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45c7343b-43ff-4d86-8d32-4b563fcd2be0", "id": 2} v 0) v1 -- 0x7f46881165c0 con 0x7f46881114b0 2024-02-16T10:30:01.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.861+0000 7f466ffff640 1 -- 172.21.15.138:0/333497434 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45c7343b-43ff-4d86-8d32-4b563fcd2be0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46780ce030 con 0x7f46881114b0 2024-02-16T10:30:01.869 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 msgr2=0x7f46881ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 --2- 172.21.15.138:0/333497434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f467801c3b0 tx=0x7f467801abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 shutdown_connections 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 --2- 172.21.15.138:0/333497434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881114b0 0x7f46881ae3d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 >> 172.21.15.138:0/333497434 conn(0x7f468806de10 msgr2=0x7f4688110030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 shutdown_connections 2024-02-16T10:30:01.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:01.865+0000 7f468df5a640 1 -- 172.21.15.138:0/333497434 wait complete. 2024-02-16T10:30:01.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 04ceea14-48fe-40ac-8dbe-2a18fd6d4796 3 2024-02-16T10:30:01.952 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:01.945+0000 7f32a3e38180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-16T10:30:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe649510640 1 Processor -- start 2024-02-16T10:30:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe649510640 1 -- start start 2024-02-16T10:30:02.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe649510640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe644115570 0x7fe644115950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe649510640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe644116010 con 0x7fe64406b680 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe649510640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64406c240 con 0x7fe644115570 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe642ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe644115570 0x7fe644115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe6427fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe64406b680 0x7fe64406bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:55462/0 (socket says 172.21.15.138:55462) 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe6427fc640 1 -- 172.21.15.138:0/4285805581 learned_addr learned my addr 172.21.15.138:0/4285805581 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe642ffd640 1 -- 172.21.15.138:0/4285805581 >> v1:172.21.15.107:6789/0 conn(0x7fe64406b680 legacy=0x7fe64406bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.037+0000 7fe642ffd640 1 -- 172.21.15.138:0/4285805581 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64406c3b0 con 0x7fe644115570 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe642ffd640 1 --2- 172.21.15.138:0/4285805581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe644115570 0x7fe644115950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe634009740 tx=0x7fe63401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9151028675b7eefb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe641ffb640 1 -- 172.21.15.138:0/4285805581 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6340a8050 con 0x7fe644115570 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe641ffb640 1 -- 172.21.15.138:0/4285805581 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340ac520 con 0x7fe644115570 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe641ffb640 1 -- 172.21.15.138:0/4285805581 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6340ac7e0 con 0x7fe644115570 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- 172.21.15.138:0/4285805581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe644115570 msgr2=0x7fe644115950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 --2- 172.21.15.138:0/4285805581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe644115570 0x7fe644115950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe634009740 tx=0x7fe63401c370 comp rx=0 tx=0).stop 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- 172.21.15.138:0/4285805581 shutdown_connections 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 --2- 172.21.15.138:0/4285805581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe644115570 0x7fe644115950 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- 172.21.15.138:0/4285805581 >> 172.21.15.138:0/4285805581 conn(0x7fe64406f7c0 msgr2=0x7fe644071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- 172.21.15.138:0/4285805581 shutdown_connections 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- 172.21.15.138:0/4285805581 wait complete. 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 Processor -- start 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- start start 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe649510640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441ac770 con 0x7fe64406b680 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe642ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe642ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:34750/0 (socket says 172.21.15.138:34750) 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.041+0000 7fe642ffd640 1 -- 172.21.15.138:0/1877663694 learned_addr learned my addr 172.21.15.138:0/1877663694 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe642ffd640 1 -- 172.21.15.138:0/1877663694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634009420 con 0x7fe64406b680 2024-02-16T10:30:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe642ffd640 1 --2- 172.21.15.138:0/1877663694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe63401aa20 tx=0x7fe63401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6340ab8d0 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6441ac910 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340aba30 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6340abd10 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6441a6240 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe6340b87e0 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe6340c1b30 con 0x7fe64406b680 2024-02-16T10:30:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.045+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644062980 con 0x7fe64406b680 2024-02-16T10:30:02.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.049+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe6340dfdd0 con 0x7fe64406b680 2024-02-16T10:30:02.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.117+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04ceea14-48fe-40ac-8dbe-2a18fd6d4796", "id": 3} v 0) v1 -- 0x7fe64411dcc0 con 0x7fe64406b680 2024-02-16T10:30:02.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe62b7fe640 1 -- 172.21.15.138:0/1877663694 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04ceea14-48fe-40ac-8dbe-2a18fd6d4796", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6340ce030 con 0x7fe64406b680 2024-02-16T10:30:02.128 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-02-16T10:30:02.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 msgr2=0x7fe6441ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 --2- 172.21.15.138:0/1877663694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe63401aa20 tx=0x7fe63401abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 shutdown_connections 2024-02-16T10:30:02.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 --2- 172.21.15.138:0/1877663694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe64406b680 0x7fe6441ac1a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 >> 172.21.15.138:0/1877663694 conn(0x7fe64406f7c0 msgr2=0x7fe6441112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 shutdown_connections 2024-02-16T10:30:02.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:02.121+0000 7fe649510640 1 -- 172.21.15.138:0/1877663694 wait complete. 2024-02-16T10:30:02.144 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-16T10:30:02.144 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-16T10:30:02.147 INFO:tasks.ceph.osd.0:Started 2024-02-16T10:30:02.147 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-16T10:30:02.148 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-16T10:30:02.188 INFO:tasks.ceph.osd.1:Started 2024-02-16T10:30:02.188 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-16T10:30:02.188 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-16T10:30:02.190 INFO:tasks.ceph.osd.2:Started 2024-02-16T10:30:02.191 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-16T10:30:02.191 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-16T10:30:02.193 INFO:tasks.ceph.osd.3:Started 2024-02-16T10:30:02.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:02.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f657e062640 1 Processor -- start 2024-02-16T10:30:02.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f657e062640 1 -- start start 2024-02-16T10:30:02.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f657e062640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f657812e460 0x7f657812e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f657e062640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657812ed80 con 0x7f657806de40 2024-02-16T10:30:02.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f657e062640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6578070730 con 0x7f657812e460 2024-02-16T10:30:02.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f65777fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f657812e460 0x7f657812e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f6576ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f657806de40 0x7f657806e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36474/0 (socket says 172.21.15.107:36474) 2024-02-16T10:30:02.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f6576ffd640 1 -- 172.21.15.107:0/1799186183 learned_addr learned my addr 172.21.15.107:0/1799186183 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:02.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f65777fe640 1 -- 172.21.15.107:0/1799186183 >> v1:172.21.15.107:6789/0 conn(0x7f657806de40 legacy=0x7f657806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.306+0000 7f65777fe640 1 -- 172.21.15.107:0/1799186183 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780700c0 con 0x7f657812e460 2024-02-16T10:30:02.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 --2- 172.21.15.107:0/1799186183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657812e460 0x7f657812e840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6568009740 tx=0x7f656801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b021c52c31ab44a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65767fc640 1 -- 172.21.15.107:0/1799186183 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65680ab530 con 0x7f657812e460 2024-02-16T10:30:02.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65767fc640 1 -- 172.21.15.107:0/1799186183 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680a7050 con 0x7f657812e460 2024-02-16T10:30:02.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65767fc640 1 -- 172.21.15.107:0/1799186183 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65680ab7e0 con 0x7f657812e460 2024-02-16T10:30:02.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/1799186183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657812e460 msgr2=0x7f657812e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 --2- 172.21.15.107:0/1799186183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657812e460 0x7f657812e840 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6568009740 tx=0x7f656801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/1799186183 shutdown_connections 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 --2- 172.21.15.107:0/1799186183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657812e460 0x7f657812e840 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/1799186183 >> 172.21.15.107:0/1799186183 conn(0x7f657809dd80 msgr2=0x7f657806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/1799186183 shutdown_connections 2024-02-16T10:30:02.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/1799186183 wait complete. 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 Processor -- start 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- start start 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6578120420 con 0x7f657806de40 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41756/0 (socket says 172.21.15.107:41756) 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 -- 172.21.15.107:0/440942304 learned_addr learned my addr 172.21.15.107:0/440942304 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:02.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 -- 172.21.15.107:0/440942304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009420 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f65777fe640 1 --2- 172.21.15.107:0/440942304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6568018f80 tx=0x7f656801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65680b7580 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680b7700 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657811ebb0 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65680b79e0 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657811f7d0 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f65680059a0 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.310+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f65680b5910 con 0x7f657806de40 2024-02-16T10:30:02.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.314+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657811fa80 con 0x7f657806de40 2024-02-16T10:30:02.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.314+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f65680bb020 con 0x7f657806de40 2024-02-16T10:30:02.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.370+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6578062980 con 0x7f657806de40 2024-02-16T10:30:02.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f655ffff640 1 -- 172.21.15.107:0/440942304 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f65680b0070 con 0x7f657806de40 2024-02-16T10:30:02.378 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:02.378 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":6,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:02.125284+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:02.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 msgr2=0x7f657812cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 --2- 172.21.15.107:0/440942304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6568018f80 tx=0x7f656801abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 shutdown_connections 2024-02-16T10:30:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 --2- 172.21.15.107:0/440942304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f657806de40 0x7f657812cbb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 >> 172.21.15.107:0/440942304 conn(0x7f657809dd80 msgr2=0x7f657812f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 shutdown_connections 2024-02-16T10:30:02.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:02.374+0000 7f657e062640 1 -- 172.21.15.107:0/440942304 wait complete. 2024-02-16T10:30:02.395 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-16T10:30:02.396 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-16T10:30:02.510 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.501+0000 7f32a3e38180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-16T10:30:02.564 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.557+0000 7f32a3e38180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-16T10:30:02.617 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.609+0000 7f32a3e38180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-16T10:30:02.694 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.685+0000 7f32a3e38180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-16T10:30:02.746 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.737+0000 7f32a3e38180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-16T10:30:02.756 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-02-16T10:30:02.750+0000 7f9d55ddb7c0 -1 Falling back to public interface 2024-02-16T10:30:02.798 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:02.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-02-16T10:30:02.813+0000 7ff89f1ff7c0 -1 Falling back to public interface 2024-02-16T10:30:02.821 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-02-16T10:30:02.813+0000 7f0f324f37c0 -1 Falling back to public interface 2024-02-16T10:30:02.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-02-16T10:30:02.813+0000 7ff89e1bf640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2024-02-16T10:30:02.823 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-02-16T10:30:02.817+0000 7f4248b157c0 -1 Falling back to public interface 2024-02-16T10:30:02.824 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.817+0000 7f32a3e38180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-16T10:30:02.879 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:02.873+0000 7f32a3e38180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f98856640 1 Processor -- start 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f98856640 1 -- start start 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f98856640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1f940924f0 0x7f1f94093850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f98856640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f94093280 con 0x7f1f94093d90 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f98856640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f94095a40 con 0x7f1f940924f0 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f91d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1f94093d90 0x7f1f941304e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36486/0 (socket says 172.21.15.107:36486) 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f91d9b640 1 -- 172.21.15.107:0/904303019 learned_addr learned my addr 172.21.15.107:0/904303019 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:02.922 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.914+0000 7f1f9259c640 1 --2- 172.21.15.107:0/904303019 >> v2:172.21.15.107:3300/0 conn(0x7f1f940924f0 0x7f1f94093850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.923 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9259c640 1 -- 172.21.15.107:0/904303019 >> v1:172.21.15.107:6789/0 conn(0x7f1f94093d90 legacy=0x7f1f941304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.923 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9159a640 1 -- 172.21.15.107:0/904303019 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833029032 0 0) 0x7f1f94093280 con 0x7f1f94093d90 2024-02-16T10:30:02.923 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9259c640 1 -- 172.21.15.107:0/904303019 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94073380 con 0x7f1f940924f0 2024-02-16T10:30:02.925 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9259c640 1 --2- 172.21.15.107:0/904303019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f94093850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009d90 tx=0x7f1f8c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89c23ce837873de server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.925 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9159a640 1 -- 172.21.15.107:0/904303019 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c0a5740 con 0x7f1f940924f0 2024-02-16T10:30:02.925 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9159a640 1 -- 172.21.15.107:0/904303019 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c0a58a0 con 0x7f1f940924f0 2024-02-16T10:30:02.925 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f9159a640 1 -- 172.21.15.107:0/904303019 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c0a5b60 con 0x7f1f940924f0 2024-02-16T10:30:02.926 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f98856640 1 -- 172.21.15.107:0/904303019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 msgr2=0x7f1f94093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f98856640 1 --2- 172.21.15.107:0/904303019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f94093850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009d90 tx=0x7f1f8c01c8c0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f98856640 1 -- 172.21.15.107:0/904303019 shutdown_connections 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f98856640 1 --2- 172.21.15.107:0/904303019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f94093850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.918+0000 7f1f98856640 1 -- 172.21.15.107:0/904303019 >> 172.21.15.107:0/904303019 conn(0x7f1f9409a250 msgr2=0x7f1f9409a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- 172.21.15.107:0/904303019 shutdown_connections 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- 172.21.15.107:0/904303019 wait complete. 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 Processor -- start 2024-02-16T10:30:02.927 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- start start 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94125b40 con 0x7f1f940924f0 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f9259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f9259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41770/0 (socket says 172.21.15.107:41770) 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f9259c640 1 -- 172.21.15.107:0/3793788186 learned_addr learned my addr 172.21.15.107:0/3793788186 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f9259c640 1 -- 172.21.15.107:0/3793788186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009a70 con 0x7f1f940924f0 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f9259c640 1 --2- 172.21.15.107:0/3793788186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c01cda0 tx=0x7f1f8c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:02.929 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c0039a0 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c003b00 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c003da0 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f94091390 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9408f250 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1f8c0b4040 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1f8c004020 con 0x7f1f940924f0 2024-02-16T10:30:02.930 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.922+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f94062980 con 0x7f1f940924f0 2024-02-16T10:30:02.931 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.926+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1f8c0e0dd0 con 0x7f1f940924f0 2024-02-16T10:30:02.988 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f94073a10 con 0x7f1f940924f0 2024-02-16T10:30:02.988 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f8affd640 1 -- 172.21.15.107:0/3793788186 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f1f8c0cf030 con 0x7f1f940924f0 2024-02-16T10:30:02.989 INFO:teuthology.misc.health.smithi107.stdout: 2024-02-16T10:30:02.989 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":6,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:02.125284+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 msgr2=0x7f1f940902e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 --2- 172.21.15.107:0/3793788186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c01cda0 tx=0x7f1f8c019660 comp rx=0 tx=0).stop 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 shutdown_connections 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 --2- 172.21.15.107:0/3793788186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f940924f0 0x7f1f940902e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 >> 172.21.15.107:0/3793788186 conn(0x7f1f9409a250 msgr2=0x7f1f94070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 shutdown_connections 2024-02-16T10:30:02.990 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:02.982+0000 7f1f98856640 1 -- 172.21.15.107:0/3793788186 wait complete. 2024-02-16T10:30:03.004 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-16T10:30:03.027 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:03.021+0000 7f32a3e38180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-16T10:30:03.089 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:03.081+0000 7f32a3e38180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-16T10:30:03.801 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-16T10:30:03.802 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-16T10:30:03.802 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-02-16T10:30:03.879 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:03.873+0000 7f32a3e38180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-16T10:30:04.034 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:04.025+0000 7f32a3e38180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-16T10:30:04.215 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:04.209+0000 7f32a3e38180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-16T10:30:04.285 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:04.277+0000 7f32a3e38180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-16T10:30:04.433 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:04.425+0000 7f32a3e38180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-16T10:30:05.067 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.061+0000 7f32a3e38180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-16T10:30:05.145 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.137+0000 7f32a3e38180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-16T10:30:05.325 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.317+0000 7f32a3e38180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-16T10:30:05.399 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.393+0000 7f32a3e38180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-16T10:30:05.708 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.701+0000 7f32a3e38180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-16T10:30:05.785 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:05.777+0000 7f32a3e38180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-16T10:30:06.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-02-16T10:30:06.221+0000 7ff89f1ff7c0 -1 osd.1 0 log_to_monitors true 2024-02-16T10:30:06.489 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-02-16T10:30:06.482+0000 7f9d55ddb7c0 -1 osd.0 0 log_to_monitors true 2024-02-16T10:30:06.548 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-02-16T10:30:06.541+0000 7f4248b157c0 -1 osd.2 0 log_to_monitors true 2024-02-16T10:30:06.563 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-02-16T10:30:06.557+0000 7f0f324f37c0 -1 osd.3 0 log_to_monitors true 2024-02-16T10:30:06.819 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-02-16T10:30:06.813+0000 7f324b289640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-16T10:30:08.953 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-02-16T10:30:08.946+0000 7f9d51561640 -1 osd.0 0 waiting for initial osdmap 2024-02-16T10:30:08.975 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-02-16T10:30:08.970+0000 7f9d49ba8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:30:09.409 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:09.534 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.526+0000 7fa255569640 1 Processor -- start 2024-02-16T10:30:09.534 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.526+0000 7fa255569640 1 -- start start 2024-02-16T10:30:09.535 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa255569640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa250091570 0x7fa250091950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:09.535 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa255569640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa250092b60 con 0x7fa250091e90 2024-02-16T10:30:09.535 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa255569640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa250072fb0 con 0x7fa250091570 2024-02-16T10:30:09.535 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa250091570 0x7fa250091950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:09.536 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24e7fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa250091e90 0x7fa25012e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32826/0 (socket says 172.21.15.107:32826) 2024-02-16T10:30:09.536 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24e7fc640 1 -- 172.21.15.107:0/1050699077 learned_addr learned my addr 172.21.15.107:0/1050699077 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:09.536 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24effd640 1 -- 172.21.15.107:0/1050699077 >> v1:172.21.15.107:6789/0 conn(0x7fa250091e90 legacy=0x7fa25012e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:09.536 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24effd640 1 -- 172.21.15.107:0/1050699077 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250092fc0 con 0x7fa250091570 2024-02-16T10:30:09.537 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24effd640 1 --2- 172.21.15.107:0/1050699077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa250091950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa240009740 tx=0x7fa24001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f3287cce02bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:09.537 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24dffb640 1 -- 172.21.15.107:0/1050699077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2400ab530 con 0x7fa250091570 2024-02-16T10:30:09.537 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24dffb640 1 -- 172.21.15.107:0/1050699077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400a7050 con 0x7fa250091570 2024-02-16T10:30:09.537 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa24dffb640 1 -- 172.21.15.107:0/1050699077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2400ab7e0 con 0x7fa250091570 2024-02-16T10:30:09.538 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa255569640 1 -- 172.21.15.107:0/1050699077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 msgr2=0x7fa250091950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.530+0000 7fa255569640 1 --2- 172.21.15.107:0/1050699077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa250091950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa240009740 tx=0x7fa24001c370 comp rx=0 tx=0).stop 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/1050699077 shutdown_connections 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 --2- 172.21.15.107:0/1050699077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa250091950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/1050699077 >> 172.21.15.107:0/1050699077 conn(0x7fa25009f930 msgr2=0x7fa25009fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/1050699077 shutdown_connections 2024-02-16T10:30:09.539 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/1050699077 wait complete. 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 Processor -- start 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- start start 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250127b40 con 0x7fa250091570 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa24effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa24effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44936/0 (socket says 172.21.15.107:44936) 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa24effd640 1 -- 172.21.15.107:0/204866478 learned_addr learned my addr 172.21.15.107:0/204866478 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa24effd640 1 -- 172.21.15.107:0/204866478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009420 con 0x7fa250091570 2024-02-16T10:30:09.542 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa24effd640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ae040 tx=0x7fa240019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2400b4410 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400b4570 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa250128060 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2400b4850 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa250090d90 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 43479+0+0 (secure 0 0 0) 0x7fa2400b2040 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 0x7fa23c037e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa250062980 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.534+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7fa2400e13c0 con 0x7fa250091570 2024-02-16T10:30:09.543 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.538+0000 7fa24e7fc640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 0x7fa23c037e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:09.544 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.538+0000 7fa24e7fc640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 0x7fa23c037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa244001610 tx=0x7fa244007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:09.548 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.542+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2400b0070 con 0x7fa250091570 2024-02-16T10:30:09.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-02-16T10:30:09.605+0000 7ff89a985640 -1 osd.1 0 waiting for initial osdmap 2024-02-16T10:30:09.631 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-02-16T10:30:09.625+0000 7f424429b640 -1 osd.2 0 waiting for initial osdmap 2024-02-16T10:30:09.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-02-16T10:30:09.629+0000 7ff892fcc640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:30:09.647 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-02-16T10:30:09.641+0000 7f423c8e2640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:30:09.654 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-02-16T10:30:09.645+0000 7f0f2dc79640 -1 osd.3 0 waiting for initial osdmap 2024-02-16T10:30:09.691 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-02-16T10:30:09.685+0000 7f0f262c0640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-16T10:30:09.711 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.706+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa250090d90 con 0x7fa250091570 2024-02-16T10:30:09.712 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.706+0000 7fa2377fe640 1 -- 172.21.15.107:0/204866478 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fa250090d90 con 0x7fa250091570 2024-02-16T10:30:09.712 INFO:teuthology.misc.health.smithi107.stdout: 2024-02-16T10:30:09.712 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":8,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:07.876430+0000","last_up_change":"0.000000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:09.714 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 msgr2=0x7fa23c037e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 0x7fa23c037e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa244001610 tx=0x7fa244007ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 msgr2=0x7fa2501259f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ae040 tx=0x7fa240019110 comp rx=0 tx=0).stop 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 shutdown_connections 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa23c035980 0x7fa23c037e40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 --2- 172.21.15.107:0/204866478 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa250091570 0x7fa2501259f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 >> 172.21.15.107:0/204866478 conn(0x7fa25009f930 msgr2=0x7fa25006fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 shutdown_connections 2024-02-16T10:30:09.715 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:09.710+0000 7fa255569640 1 -- 172.21.15.107:0/204866478 wait complete. 2024-02-16T10:30:09.730 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-02-16T10:30:16.133 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:16.254 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f04112a8640 1 Processor -- start 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f04112a8640 1 -- start start 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f04112a8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f040c093f60 0x7f040c1314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f04112a8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c093280 con 0x7f040c0924f0 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f04112a8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040c095a40 con 0x7f040c093f60 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f040c093f60 0x7f040c1314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f040c093f60 0x7f040c1314f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40244/0 (socket says 172.21.15.107:40244) 2024-02-16T10:30:16.255 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 -- 172.21.15.107:0/2478160015 learned_addr learned my addr 172.21.15.107:0/2478160015 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:16.256 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 -- 172.21.15.107:0/2478160015 >> v1:172.21.15.107:6789/0 conn(0x7f040c0924f0 legacy=0x7f040c093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.256 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 -- 172.21.15.107:0/2478160015 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c073380 con 0x7f040c093f60 2024-02-16T10:30:16.257 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f040a7fc640 1 --2- 172.21.15.107:0/2478160015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c093f60 0x7f040c1314f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097f0 tx=0x7f03fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd169653379d337 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.257 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f0409ffb640 1 -- 172.21.15.107:0/2478160015 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03fc0ab530 con 0x7f040c093f60 2024-02-16T10:30:16.257 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f0409ffb640 1 -- 172.21.15.107:0/2478160015 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc0a7050 con 0x7f040c093f60 2024-02-16T10:30:16.258 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.249+0000 7f0409ffb640 1 -- 172.21.15.107:0/2478160015 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03fc0ab7e0 con 0x7f040c093f60 2024-02-16T10:30:16.258 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/2478160015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c093f60 msgr2=0x7f040c1314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.258 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 --2- 172.21.15.107:0/2478160015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c093f60 0x7f040c1314f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097f0 tx=0x7f03fc01c430 comp rx=0 tx=0).stop 2024-02-16T10:30:16.259 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/2478160015 shutdown_connections 2024-02-16T10:30:16.259 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 --2- 172.21.15.107:0/2478160015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c093f60 0x7f040c1314f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.259 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/2478160015 >> 172.21.15.107:0/2478160015 conn(0x7f040c09a250 msgr2=0x7f040c09a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:16.259 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/2478160015 shutdown_connections 2024-02-16T10:30:16.259 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/2478160015 wait complete. 2024-02-16T10:30:16.260 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 Processor -- start 2024-02-16T10:30:16.260 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- start start 2024-02-16T10:30:16.260 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c08f9e0 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40250/0 (socket says 172.21.15.107:40250) 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040affd640 1 -- 172.21.15.107:0/110147547 learned_addr learned my addr 172.21.15.107:0/110147547 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040affd640 1 -- 172.21.15.107:0/110147547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0094d0 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040affd640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f040000c480 tx=0x7f040000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0400005150 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04000052b0 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c091680 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0400007030 con 0x7f040c0924f0 2024-02-16T10:30:16.261 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c0920d0 con 0x7f040c0924f0 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c091d20 con 0x7f040c0924f0 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0400007190 con 0x7f040c0924f0 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 0x7f03f8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f0400047060 con 0x7f040c0924f0 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.253+0000 7f040a7fc640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 0x7f03f8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.262 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.257+0000 7f040a7fc640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 0x7f03f8037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ad000 tx=0x7f03fc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.266 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.261+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04000108d0 con 0x7f040c0924f0 2024-02-16T10:30:16.417 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.409+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f040c073a10 con 0x7f040c0924f0 2024-02-16T10:30:16.418 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.409+0000 7f03f37fe640 1 -- 172.21.15.107:0/110147547 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7975 (secure 0 0 0) 0x7f040001a3a0 con 0x7f040c0924f0 2024-02-16T10:30:16.418 INFO:teuthology.misc.health.smithi107.stdout: 2024-02-16T10:30:16.418 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":13,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:13.974451+0000","last_up_change":"2024-02-16T10:30:09.953578+0000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:30:11.897035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6801","nonce":1630367885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6803","nonce":1630367885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6807","nonce":1630367885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6805","nonce":1630367885}]},"public_addr":"172.21.15.107:6801/1630367885","cluster_addr":"172.21.15.107:6803/1630367885","heartbeat_back_addr":"172.21.15.107:6807/1630367885","heartbeat_front_addr":"172.21.15.107:6805/1630367885","state":["exists","up"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6805","nonce":802812406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6810","nonce":802812406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6817","nonce":802812406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6813","nonce":802812406}]},"public_addr":"172.21.15.138:6805/802812406","cluster_addr":"172.21.15.138:6810/802812406","heartbeat_back_addr":"172.21.15.138:6817/802812406","heartbeat_front_addr":"172.21.15.138:6813/802812406","state":["exists","up"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6815","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6816","nonce":3134970710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6819","nonce":3134970710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6823","nonce":3134970710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6821","nonce":3134970710}]},"public_addr":"172.21.15.138:6816/3134970710","cluster_addr":"172.21.15.138:6819/3134970710","heartbeat_back_addr":"172.21.15.138:6823/3134970710","heartbeat_front_addr":"172.21.15.138:6821/3134970710","state":["exists","up"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6801","nonce":756089529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6804","nonce":756089529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6811","nonce":756089529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6807","nonce":756089529}]},"public_addr":"172.21.15.138:6801/756089529","cluster_addr":"172.21.15.138:6804/756089529","heartbeat_back_addr":"172.21.15.138:6811/756089529","heartbeat_front_addr":"172.21.15.138:6807/756089529","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.534819+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.231540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.512871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.523709+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 msgr2=0x7f03f8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 0x7f03f8037ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ad000 tx=0x7f03fc0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 msgr2=0x7f040c0902e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f040000c480 tx=0x7f040000c940 comp rx=0 tx=0).stop 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 shutdown_connections 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03f8035a10 0x7f03f8037ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 --2- 172.21.15.107:0/110147547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f040c0924f0 0x7f040c0902e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 >> 172.21.15.107:0/110147547 conn(0x7f040c09a250 msgr2=0x7f040c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 shutdown_connections 2024-02-16T10:30:16.420 INFO:teuthology.misc.health.smithi107.stderr:2024-02-16T10:30:16.413+0000 7f04112a8640 1 -- 172.21.15.107:0/110147547 wait complete. 2024-02-16T10:30:16.434 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-02-16T10:30:16.434 INFO:tasks.ceph:Creating RBD pool 2024-02-16T10:30:16.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool create rbd 8 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.533+0000 7f33a6477640 1 Processor -- start 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.533+0000 7f33a6477640 1 -- start start 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33a012eed0 0x7f33a01312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a01285e0 con 0x7f33a0128a30 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a0129520 con 0x7f33a012eed0 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339ffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f33a0128a30 0x7f33a0128e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52192/0 (socket says 172.21.15.107:52192) 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339ffff640 1 -- 172.21.15.107:0/48698024 learned_addr learned my addr 172.21.15.107:0/48698024 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339f7fe640 1 --2- 172.21.15.107:0/48698024 >> v2:172.21.15.107:3300/0 conn(0x7f33a012eed0 0x7f33a01312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339effd640 1 -- 172.21.15.107:0/48698024 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484932257 0 0) 0x7f33a01285e0 con 0x7f33a0128a30 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339effd640 1 -- 172.21.15.107:0/48698024 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3388003530 con 0x7f33a0128a30 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339f7fe640 1 -- 172.21.15.107:0/48698024 >> v1:172.21.15.107:6789/0 conn(0x7f33a0128a30 legacy=0x7f33a0128e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339f7fe640 1 -- 172.21.15.107:0/48698024 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0072190 con 0x7f33a012eed0 2024-02-16T10:30:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339f7fe640 1 --2- 172.21.15.107:0/48698024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01312c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3390009740 tx=0x7f339001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a7dbab53f1078c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339effd640 1 -- 172.21.15.107:0/48698024 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33900ab530 con 0x7f33a012eed0 2024-02-16T10:30:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339effd640 1 -- 172.21.15.107:0/48698024 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a7050 con 0x7f33a012eed0 2024-02-16T10:30:16.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f339effd640 1 -- 172.21.15.107:0/48698024 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33900ab7e0 con 0x7f33a012eed0 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- 172.21.15.107:0/48698024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 msgr2=0x7f33a01312c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 --2- 172.21.15.107:0/48698024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01312c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3390009740 tx=0x7f339001c370 comp rx=0 tx=0).stop 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- 172.21.15.107:0/48698024 shutdown_connections 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 --2- 172.21.15.107:0/48698024 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01312c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- 172.21.15.107:0/48698024 >> 172.21.15.107:0/48698024 conn(0x7f33a0099cd0 msgr2=0x7f33a006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- 172.21.15.107:0/48698024 shutdown_connections 2024-02-16T10:30:16.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.537+0000 7f33a6477640 1 -- 172.21.15.107:0/48698024 wait complete. 2024-02-16T10:30:16.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 Processor -- start 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 -- start start 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0125d70 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40276/0 (socket says 172.21.15.107:40276) 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339ffff640 1 -- 172.21.15.107:0/2870659184 learned_addr learned my addr 172.21.15.107:0/2870659184 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339ffff640 1 -- 172.21.15.107:0/2870659184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009420 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339ffff640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f339400c450 tx=0x7f339400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3394005c20 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3394005d80 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01258d0 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33940071a0 con 0x7f33a012eed0 2024-02-16T10:30:16.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a0114260 con 0x7f33a012eed0 2024-02-16T10:30:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3394007300 con 0x7f33a012eed0 2024-02-16T10:30:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a0125fb0 con 0x7f33a012eed0 2024-02-16T10:30:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 0x7f338c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f3394047090 con 0x7f33a012eed0 2024-02-16T10:30:16.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339f7fe640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 0x7f338c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:16.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.541+0000 7f339f7fe640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 0x7f338c037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3390009740 tx=0x7f33900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:16.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.545+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3394010c20 con 0x7f33a012eed0 2024-02-16T10:30:16.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.701+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f33a0062980 con 0x7f33a012eed0 2024-02-16T10:30:16.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.985+0000 7f339cff9640 1 -- 172.21.15.107:0/2870659184 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3394017070 con 0x7f33a012eed0 2024-02-16T10:30:16.994 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'rbd' created 2024-02-16T10:30:16.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 msgr2=0x7f338c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 0x7f338c037ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3390009740 tx=0x7f33900a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 msgr2=0x7f33a01215d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f339400c450 tx=0x7f339400c910 comp rx=0 tx=0).stop 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 shutdown_connections 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f338c035a10 0x7f338c037ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 --2- 172.21.15.107:0/2870659184 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33a012eed0 0x7f33a01215d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 >> 172.21.15.107:0/2870659184 conn(0x7f33a0128a30 msgr2=0x7f33a01272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 shutdown_connections 2024-02-16T10:30:16.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:16.989+0000 7f33a6477640 1 -- 172.21.15.107:0/2870659184 wait complete. 2024-02-16T10:30:17.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-02-16T10:30:17.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f24719bd640 1 Processor -- start 2024-02-16T10:30:17.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f24719bd640 1 -- start start 2024-02-16T10:30:17.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f24719bd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f246c06eb30 0x7f246c1333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f24719bd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c06ff30 con 0x7f246c12e190 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f24719bd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c071990 con 0x7f246c06eb30 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f246a7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f246c06eb30 0x7f246c1333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f246affd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f246c12e190 0x7f246c12e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52208/0 (socket says 172.21.15.107:52208) 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f246affd640 1 -- 172.21.15.107:0/2790663631 learned_addr learned my addr 172.21.15.107:0/2790663631 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f246a7fc640 1 -- 172.21.15.107:0/2790663631 >> v1:172.21.15.107:6789/0 conn(0x7f246c12e190 legacy=0x7f246c12e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f246a7fc640 1 -- 172.21.15.107:0/2790663631 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c06f840 con 0x7f246c06eb30 2024-02-16T10:30:17.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.141+0000 7f2469ffb640 1 -- 172.21.15.107:0/2790663631 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425726536 0 0) 0x7f246c06ff30 con 0x7f246c12e190 2024-02-16T10:30:17.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f246a7fc640 1 --2- 172.21.15.107:0/2790663631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c1333f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f245c009740 tx=0x7f245c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d693b23b9ae9644a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:17.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f2469ffb640 1 -- 172.21.15.107:0/2790663631 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f245c0ab530 con 0x7f246c06eb30 2024-02-16T10:30:17.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f2469ffb640 1 -- 172.21.15.107:0/2790663631 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c0a7050 con 0x7f246c06eb30 2024-02-16T10:30:17.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f2469ffb640 1 -- 172.21.15.107:0/2790663631 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f245c0ab7e0 con 0x7f246c06eb30 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 -- 172.21.15.107:0/2790663631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 msgr2=0x7f246c1333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 --2- 172.21.15.107:0/2790663631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c1333f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f245c009740 tx=0x7f245c01c310 comp rx=0 tx=0).stop 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 -- 172.21.15.107:0/2790663631 shutdown_connections 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 --2- 172.21.15.107:0/2790663631 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c1333f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 -- 172.21.15.107:0/2790663631 >> 172.21.15.107:0/2790663631 conn(0x7f246c09dc40 msgr2=0x7f246c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 -- 172.21.15.107:0/2790663631 shutdown_connections 2024-02-16T10:30:17.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.145+0000 7f24719bd640 1 -- 172.21.15.107:0/2790663631 wait complete. 2024-02-16T10:30:17.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 Processor -- start 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 -- start start 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c133020 con 0x7f246c06eb30 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40282/0 (socket says 172.21.15.107:40282) 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246affd640 1 -- 172.21.15.107:0/1038658586 learned_addr learned my addr 172.21.15.107:0/1038658586 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:17.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246affd640 1 -- 172.21.15.107:0/1038658586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009420 con 0x7f246c06eb30 2024-02-16T10:30:17.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246affd640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f246000c420 tx=0x7f246000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:17.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24600074d0 con 0x7f246c06eb30 2024-02-16T10:30:17.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2460007630 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c11e640 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2460004960 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c11f2d0 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2460004ac0 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c0680d0 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 0x7f2458037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f24600472b0 con 0x7f246c06eb30 2024-02-16T10:30:17.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246a7fc640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 0x7f2458037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:17.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.149+0000 7f246a7fc640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 0x7f2458037ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f245c0ad000 tx=0x7f245c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:17.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.153+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f246001ad70 con 0x7f246c06eb30 2024-02-16T10:30:17.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.313+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f246c062980 con 0x7f246c06eb30 2024-02-16T10:30:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.993+0000 7f2453fff640 1 -- 172.21.15.107:0/1038658586 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2460018030 con 0x7f246c06eb30 2024-02-16T10:30:18.000 INFO:teuthology.orchestra.run.smithi107.stderr:enabled application 'rbd' on pool 'rbd' 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 msgr2=0x7f2458037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 0x7f2458037ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f245c0ad000 tx=0x7f245c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 msgr2=0x7f246c12c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f246000c420 tx=0x7f246000c8e0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 shutdown_connections 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2458035a10 0x7f2458037ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 --2- 172.21.15.107:0/1038658586 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f246c06eb30 0x7f246c12c4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 >> 172.21.15.107:0/1038658586 conn(0x7f246c09dc40 msgr2=0x7f246c131910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 shutdown_connections 2024-02-16T10:30:18.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:17.997+0000 7f24719bd640 1 -- 172.21.15.107:0/1038658586 wait complete. 2024-02-16T10:30:18.029 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-16T10:30:18.030 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-16T10:30:18.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-16T10:30:18.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-16T10:30:18.030 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-16T10:30:18.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.141+0000 7fbe6dff9640 1 Processor -- start 2024-02-16T10:30:18.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.141+0000 7fbe6dff9640 1 -- start start 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbe6812e7b0 0x7fbe6806e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe68071600 con 0x7fbe6812e3d0 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe68070fc0 con 0x7fbe6812e7b0 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe66ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbe6812e7b0 0x7fbe6806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe677fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbe6812e3d0 0x7fbe6806e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52220/0 (socket says 172.21.15.107:52220) 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe677fe640 1 -- 172.21.15.107:0/575507461 learned_addr learned my addr 172.21.15.107:0/575507461 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe66ffd640 1 -- 172.21.15.107:0/575507461 >> v1:172.21.15.107:6789/0 conn(0x7fbe6812e3d0 legacy=0x7fbe6806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe66ffd640 1 -- 172.21.15.107:0/575507461 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68071aa0 con 0x7fbe6812e7b0 2024-02-16T10:30:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe66ffd640 1 --2- 172.21.15.107:0/575507461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e7b0 0x7fbe6806e760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009740 tx=0x7fbe5801cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3788ab157d0e30fa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe667fc640 1 -- 172.21.15.107:0/575507461 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe580ab530 con 0x7fbe6812e7b0 2024-02-16T10:30:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe667fc640 1 -- 172.21.15.107:0/575507461 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580a7050 con 0x7fbe6812e7b0 2024-02-16T10:30:18.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe667fc640 1 -- 172.21.15.107:0/575507461 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe580ab7e0 con 0x7fbe6812e7b0 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- 172.21.15.107:0/575507461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e7b0 msgr2=0x7fbe6806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/575507461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e7b0 0x7fbe6806e760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009740 tx=0x7fbe5801cd40 comp rx=0 tx=0).stop 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- 172.21.15.107:0/575507461 shutdown_connections 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/575507461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e7b0 0x7fbe6806e760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- 172.21.15.107:0/575507461 >> 172.21.15.107:0/575507461 conn(0x7fbe6809df50 msgr2=0x7fbe6806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.145+0000 7fbe6dff9640 1 -- 172.21.15.107:0/575507461 shutdown_connections 2024-02-16T10:30:18.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- 172.21.15.107:0/575507461 wait complete. 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 Processor -- start 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- start start 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6811f710 con 0x7fbe6812e3d0 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40302/0 (socket says 172.21.15.107:40302) 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe677fe640 1 -- 172.21.15.107:0/4236327501 learned_addr learned my addr 172.21.15.107:0/4236327501 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:18.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe677fe640 1 -- 172.21.15.107:0/4236327501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58009420 con 0x7fbe6812e3d0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe677fe640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c480 tx=0x7fbe5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c005c20 con 0x7fbe6812e3d0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c005d80 con 0x7fbe6812e3d0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6811f430 con 0x7fbe6812e3d0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0071a0 con 0x7fbe6812e3d0 2024-02-16T10:30:18.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe68133940 con 0x7fbe6812e3d0 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6811f850 con 0x7fbe6812e3d0 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbe5c007300 con 0x7fbe6812e3d0 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 0x7fbe54037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fbe5c0471d0 con 0x7fbe6812e3d0 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.149+0000 7fbe66ffd640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 0x7fbe54037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.153+0000 7fbe66ffd640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 0x7fbe54037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe580ad000 tx=0x7fbe58004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.153+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe6811f850 con 0x7fbe6812e3d0 2024-02-16T10:30:18.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.353+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbe6811ef70 con 0x7fbe6812e3d0 2024-02-16T10:30:18.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe4ffff640 1 -- 172.21.15.107:0/4236327501 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83335 (secure 0 0 0) 0x7fbe6811ef70 con 0x7fbe6812e3d0 2024-02-16T10:30:18.365 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 msgr2=0x7fbe54037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 0x7fbe54037ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe580ad000 tx=0x7fbe58004740 comp rx=0 tx=0).stop 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 msgr2=0x7fbe6812c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c480 tx=0x7fbe5c00c940 comp rx=0 tx=0).stop 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 shutdown_connections 2024-02-16T10:30:18.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe54035a10 0x7fbe54037ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 --2- 172.21.15.107:0/4236327501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe6812e3d0 0x7fbe6812c680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 >> 172.21.15.107:0/4236327501 conn(0x7fbe6809df50 msgr2=0x7fbe681322a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 shutdown_connections 2024-02-16T10:30:18.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.357+0000 7fbe6dff9640 1 -- 172.21.15.107:0/4236327501 wait complete. 2024-02-16T10:30:18.383 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2589059759},{"type":"v1","addr":"172.21.15.138:6825","nonce":2589059759}]},"active_addr":"172.21.15.138:6825/2589059759","active_change":"2024-02-16T10:30:05.803842+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":2950579034}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3214010106}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1950658025}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":2887148315}]}]} 2024-02-16T10:30:18.385 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-16T10:30:18.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-16T10:30:18.385 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:18.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.493+0000 7fa027d87640 1 Processor -- start 2024-02-16T10:30:18.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.493+0000 7fa027d87640 1 -- start start 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa02012dd30 0x7fa020130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa020071480 con 0x7fa02012af60 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02009c000 con 0x7fa02012dd30 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025322640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa02012dd30 0x7fa020130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025b23640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa02012af60 0x7fa02012b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52228/0 (socket says 172.21.15.107:52228) 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025b23640 1 -- 172.21.15.107:0/4293019015 learned_addr learned my addr 172.21.15.107:0/4293019015 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025322640 1 -- 172.21.15.107:0/4293019015 >> v1:172.21.15.107:6789/0 conn(0x7fa02012af60 legacy=0x7fa02012b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025322640 1 -- 172.21.15.107:0/4293019015 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02012ad40 con 0x7fa02012dd30 2024-02-16T10:30:18.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa025322640 1 --2- 172.21.15.107:0/4293019015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012dd30 0x7fa020130120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa010009740 tx=0x7fa01001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aad59426ac931bd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa024b21640 1 -- 172.21.15.107:0/4293019015 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0100ab530 con 0x7fa02012dd30 2024-02-16T10:30:18.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa024b21640 1 -- 172.21.15.107:0/4293019015 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0100a7050 con 0x7fa02012dd30 2024-02-16T10:30:18.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa024b21640 1 -- 172.21.15.107:0/4293019015 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0100ab7e0 con 0x7fa02012dd30 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- 172.21.15.107:0/4293019015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012dd30 msgr2=0x7fa020130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 --2- 172.21.15.107:0/4293019015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012dd30 0x7fa020130120 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa010009740 tx=0x7fa01001c370 comp rx=0 tx=0).stop 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- 172.21.15.107:0/4293019015 shutdown_connections 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 --2- 172.21.15.107:0/4293019015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012dd30 0x7fa020130120 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- 172.21.15.107:0/4293019015 >> 172.21.15.107:0/4293019015 conn(0x7fa02009a1c0 msgr2=0x7fa02009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- 172.21.15.107:0/4293019015 shutdown_connections 2024-02-16T10:30:18.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.497+0000 7fa027d87640 1 -- 172.21.15.107:0/4293019015 wait complete. 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 Processor -- start 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 -- start start 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201264f0 con 0x7fa02012af60 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025b23640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025b23640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40306/0 (socket says 172.21.15.107:40306) 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025b23640 1 -- 172.21.15.107:0/2042719344 learned_addr learned my addr 172.21.15.107:0/2042719344 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025b23640 1 -- 172.21.15.107:0/2042719344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010009420 con 0x7fa02012af60 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025b23640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c480 tx=0x7fa01c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa01c005c20 con 0x7fa02012af60 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c005d80 con 0x7fa02012af60 2024-02-16T10:30:18.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa020126f60 con 0x7fa02012af60 2024-02-16T10:30:18.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa01c0071a0 con 0x7fa02012af60 2024-02-16T10:30:18.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa020127bf0 con 0x7fa02012af60 2024-02-16T10:30:18.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa01c007300 con 0x7fa02012af60 2024-02-16T10:30:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa020127750 con 0x7fa02012af60 2024-02-16T10:30:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 0x7fa004037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa01c0471d0 con 0x7fa02012af60 2024-02-16T10:30:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.501+0000 7fa025322640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 0x7fa004037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.505+0000 7fa025322640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 0x7fa004037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa0100ad000 tx=0x7fa010008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.505+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa01c0075b0 con 0x7fa02012af60 2024-02-16T10:30:18.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.665+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa020062980 con 0x7fa02012af60 2024-02-16T10:30:18.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.665+0000 7fa0167fc640 1 -- 172.21.15.107:0/2042719344 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9756 (secure 0 0 0) 0x7fa01c017070 con 0x7fa02012af60 2024-02-16T10:30:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:18.674 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":15,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:17.992854+0000","last_up_change":"2024-02-16T10:30:09.953578+0000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:30:11.897035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:30:16.742733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6801","nonce":1630367885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6803","nonce":1630367885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6807","nonce":1630367885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6805","nonce":1630367885}]},"public_addr":"172.21.15.107:6801/1630367885","cluster_addr":"172.21.15.107:6803/1630367885","heartbeat_back_addr":"172.21.15.107:6807/1630367885","heartbeat_front_addr":"172.21.15.107:6805/1630367885","state":["exists","up"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6805","nonce":802812406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6810","nonce":802812406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6817","nonce":802812406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6813","nonce":802812406}]},"public_addr":"172.21.15.138:6805/802812406","cluster_addr":"172.21.15.138:6810/802812406","heartbeat_back_addr":"172.21.15.138:6817/802812406","heartbeat_front_addr":"172.21.15.138:6813/802812406","state":["exists","up"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6815","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6816","nonce":3134970710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6819","nonce":3134970710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6823","nonce":3134970710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6821","nonce":3134970710}]},"public_addr":"172.21.15.138:6816/3134970710","cluster_addr":"172.21.15.138:6819/3134970710","heartbeat_back_addr":"172.21.15.138:6823/3134970710","heartbeat_front_addr":"172.21.15.138:6821/3134970710","state":["exists","up"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6801","nonce":756089529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6804","nonce":756089529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6811","nonce":756089529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6807","nonce":756089529}]},"public_addr":"172.21.15.138:6801/756089529","cluster_addr":"172.21.15.138:6804/756089529","heartbeat_back_addr":"172.21.15.138:6811/756089529","heartbeat_front_addr":"172.21.15.138:6807/756089529","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.534819+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.231540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.512871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.523709+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:18.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 msgr2=0x7fa004037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 0x7fa004037ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa0100ad000 tx=0x7fa010008040 comp rx=0 tx=0).stop 2024-02-16T10:30:18.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 msgr2=0x7fa020125410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c480 tx=0x7fa01c00c940 comp rx=0 tx=0).stop 2024-02-16T10:30:18.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 shutdown_connections 2024-02-16T10:30:18.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa004035a10 0x7fa004037ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 --2- 172.21.15.107:0/2042719344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa02012af60 0x7fa020125410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 >> 172.21.15.107:0/2042719344 conn(0x7fa02009a1c0 msgr2=0x7fa02006f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 shutdown_connections 2024-02-16T10:30:18.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.669+0000 7fa027d87640 1 -- 172.21.15.107:0/2042719344 wait complete. 2024-02-16T10:30:18.692 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-16T10:30:18.692 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:30:18.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311d044640 1 Processor -- start 2024-02-16T10:30:18.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311d044640 1 -- start start 2024-02-16T10:30:18.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311d044640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f311812e3d0 0x7f311812e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311d044640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311812ecf0 con 0x7f311806e050 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311d044640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3118071600 con 0x7f311812e3d0 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f3116d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f311812e3d0 0x7f311812e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f311806e050 0x7f311806e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52232/0 (socket says 172.21.15.107:52232) 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f311659c640 1 -- 172.21.15.107:0/1443460763 learned_addr learned my addr 172.21.15.107:0/1443460763 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f3116d9d640 1 -- 172.21.15.107:0/1443460763 >> v1:172.21.15.107:6789/0 conn(0x7f311806e050 legacy=0x7f311806e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.801+0000 7f3116d9d640 1 -- 172.21.15.107:0/1443460763 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118070fc0 con 0x7f311812e3d0 2024-02-16T10:30:18.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f3116d9d640 1 --2- 172.21.15.107:0/1443460763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311812e3d0 0x7f311812e7b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3108009740 tx=0x7f310801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd6b4fed4b08699 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f3115d9b640 1 -- 172.21.15.107:0/1443460763 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31080ab530 con 0x7f311812e3d0 2024-02-16T10:30:18.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f3115d9b640 1 -- 172.21.15.107:0/1443460763 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080a7050 con 0x7f311812e3d0 2024-02-16T10:30:18.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f3115d9b640 1 -- 172.21.15.107:0/1443460763 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31080ab7e0 con 0x7f311812e3d0 2024-02-16T10:30:18.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 -- 172.21.15.107:0/1443460763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311812e3d0 msgr2=0x7f311812e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 --2- 172.21.15.107:0/1443460763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311812e3d0 0x7f311812e7b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3108009740 tx=0x7f310801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:18.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 -- 172.21.15.107:0/1443460763 shutdown_connections 2024-02-16T10:30:18.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 --2- 172.21.15.107:0/1443460763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311812e3d0 0x7f311812e7b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 -- 172.21.15.107:0/1443460763 >> 172.21.15.107:0/1443460763 conn(0x7f311809df50 msgr2=0x7f311806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 -- 172.21.15.107:0/1443460763 shutdown_connections 2024-02-16T10:30:18.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.805+0000 7f311d044640 1 -- 172.21.15.107:0/1443460763 wait complete. 2024-02-16T10:30:18.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 Processor -- start 2024-02-16T10:30:18.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 -- start start 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31181203c0 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f3116d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f3116d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40314/0 (socket says 172.21.15.107:40314) 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f3116d9d640 1 -- 172.21.15.107:0/4189391537 learned_addr learned my addr 172.21.15.107:0/4189391537 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f3116d9d640 1 -- 172.21.15.107:0/4189391537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009420 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f3116d9d640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3108018f80 tx=0x7f310801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31080b7660 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080b77e0 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3118133c30 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31080b7ac0 con 0x7f311806e050 2024-02-16T10:30:18.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311811f770 con 0x7f311806e050 2024-02-16T10:30:18.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3118062980 con 0x7f311806e050 2024-02-16T10:30:18.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f31080b7c20 con 0x7f311806e050 2024-02-16T10:30:18.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 0x7f3104037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:18.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f31080e2900 con 0x7f311806e050 2024-02-16T10:30:18.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311659c640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 0x7f3104037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:18.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.809+0000 7f311659c640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 0x7f3104037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f310c001610 tx=0x7f310c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:18.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.813+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31080c79f0 con 0x7f311806e050 2024-02-16T10:30:18.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.973+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f311811fa20 con 0x7f311806e050 2024-02-16T10:30:18.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.973+0000 7f30ff7fe640 1 -- 172.21.15.107:0/4189391537 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9756 (secure 0 0 0) 0x7f31080b0070 con 0x7f311806e050 2024-02-16T10:30:18.981 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:18.981 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":15,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:30:17.992854+0000","last_up_change":"2024-02-16T10:30:09.953578+0000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:30:11.897035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:30:16.742733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6801","nonce":1630367885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6803","nonce":1630367885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6807","nonce":1630367885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6805","nonce":1630367885}]},"public_addr":"172.21.15.107:6801/1630367885","cluster_addr":"172.21.15.107:6803/1630367885","heartbeat_back_addr":"172.21.15.107:6807/1630367885","heartbeat_front_addr":"172.21.15.107:6805/1630367885","state":["exists","up"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6805","nonce":802812406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6810","nonce":802812406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6817","nonce":802812406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6813","nonce":802812406}]},"public_addr":"172.21.15.138:6805/802812406","cluster_addr":"172.21.15.138:6810/802812406","heartbeat_back_addr":"172.21.15.138:6817/802812406","heartbeat_front_addr":"172.21.15.138:6813/802812406","state":["exists","up"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6815","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6816","nonce":3134970710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6819","nonce":3134970710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6823","nonce":3134970710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6821","nonce":3134970710}]},"public_addr":"172.21.15.138:6816/3134970710","cluster_addr":"172.21.15.138:6819/3134970710","heartbeat_back_addr":"172.21.15.138:6823/3134970710","heartbeat_front_addr":"172.21.15.138:6821/3134970710","state":["exists","up"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6801","nonce":756089529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6804","nonce":756089529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6811","nonce":756089529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6807","nonce":756089529}]},"public_addr":"172.21.15.138:6801/756089529","cluster_addr":"172.21.15.138:6804/756089529","heartbeat_back_addr":"172.21.15.138:6811/756089529","heartbeat_front_addr":"172.21.15.138:6807/756089529","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.534819+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.231540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.512871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.523709+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 msgr2=0x7f3104037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 0x7f3104037ed0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f310c001610 tx=0x7f310c007ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 msgr2=0x7f311812ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3108018f80 tx=0x7f310801abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 shutdown_connections 2024-02-16T10:30:18.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3104035a10 0x7f3104037ed0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 --2- 172.21.15.107:0/4189391537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f311806e050 0x7f311812ca70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:18.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 >> 172.21.15.107:0/4189391537 conn(0x7f311809df50 msgr2=0x7f3118132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:18.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 shutdown_connections 2024-02-16T10:30:18.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:18.977+0000 7f311d044640 1 -- 172.21.15.107:0/4189391537 wait complete. 2024-02-16T10:30:19.000 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-16T10:30:19.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-16T10:30:19.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-16T10:30:19.002 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-16T10:30:19.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35f48d1640 1 Processor -- start 2024-02-16T10:30:19.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35f48d1640 1 -- start start 2024-02-16T10:30:19.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35f48d1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f35f0098a30 0x7f35f0098e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35f48d1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f0099b20 con 0x7f35f0099350 2024-02-16T10:30:19.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35f48d1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f009b4e0 con 0x7f35f0098a30 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35edd9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f35f0099350 0x7f35f012bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52246/0 (socket says 172.21.15.107:52246) 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35edd9b640 1 -- 172.21.15.107:0/3056325876 learned_addr learned my addr 172.21.15.107:0/3056325876 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35ee59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f35f0098a30 0x7f35f0098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35ee59c640 1 -- 172.21.15.107:0/3056325876 >> v1:172.21.15.107:6789/0 conn(0x7f35f0099350 legacy=0x7f35f012bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35ed59a640 1 -- 172.21.15.107:0/3056325876 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647188745 0 0) 0x7f35f0099b20 con 0x7f35f0099350 2024-02-16T10:30:19.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35ee59c640 1 -- 172.21.15.107:0/3056325876 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f009e010 con 0x7f35f0098a30 2024-02-16T10:30:19.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e6de1e640 1 Processor -- start 2024-02-16T10:30:19.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e6de1e640 1 -- start start 2024-02-16T10:30:19.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4acd71d640 1 Processor -- start 2024-02-16T10:30:19.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3437e13640 1 Processor -- start 2024-02-16T10:30:19.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4acd71d640 1 -- start start 2024-02-16T10:30:19.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3437e13640 1 -- start start 2024-02-16T10:30:19.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4acd71d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ac806f050 0x7f4ac8133480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4acd71d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac806f5e0 con 0x7f4ac806e560 2024-02-16T10:30:19.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4acd71d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac806cec0 con 0x7f4ac806f050 2024-02-16T10:30:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e6de1e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0e6812ef80 0x7f0e68131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4abe7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ac806f050 0x7f4ac8133480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4abe7fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ac806f050 0x7f4ac8133480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40332/0 (socket says 172.21.15.107:40332) 2024-02-16T10:30:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4abe7fc640 1 -- 172.21.15.107:0/519709251 learned_addr learned my addr 172.21.15.107:0/519709251 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e677fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0e6806f8b0 0x7f0e6812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52260/0 (socket says 172.21.15.107:52260) 2024-02-16T10:30:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e677fe640 1 -- 172.21.15.107:0/3767486056 learned_addr learned my addr 172.21.15.107:0/3767486056 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3437e13640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f343012e380 0x7f343012e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e66ffd640 1 --2- 172.21.15.107:0/3767486056 >> v2:172.21.15.107:3300/0 conn(0x7f0e6812ef80 0x7f0e68131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e68072450 con 0x7f0e6806f8b0 2024-02-16T10:30:19.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3435baf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f343012e380 0x7f343012e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3435baf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f343012e380 0x7f343012e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40352/0 (socket says 172.21.15.107:40352) 2024-02-16T10:30:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6812bed0 con 0x7f0e6812ef80 2024-02-16T10:30:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4abe7fc640 1 -- 172.21.15.107:0/519709251 >> v1:172.21.15.107:6789/0 conn(0x7f4ac806e560 legacy=0x7f4ac806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f4abe7fc640 1 -- 172.21.15.107:0/519709251 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac806c6a0 con 0x7f4ac806f050 2024-02-16T10:30:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3437e13640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343006f240 con 0x7f343012eca0 2024-02-16T10:30:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3437e13640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3430070130 con 0x7f343012e380 2024-02-16T10:30:19.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3435baf640 1 -- 172.21.15.107:0/2628744480 learned_addr learned my addr 172.21.15.107:0/2628744480 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e667fc640 1 -- 172.21.15.107:0/3767486056 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855875439 0 0) 0x7f0e68072450 con 0x7f0e6806f8b0 2024-02-16T10:30:19.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e667fc640 1 -- 172.21.15.107:0/3767486056 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e50003530 con 0x7f0e6806f8b0 2024-02-16T10:30:19.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e66ffd640 1 -- 172.21.15.107:0/3767486056 >> v1:172.21.15.107:6789/0 conn(0x7f0e6806f8b0 legacy=0x7f0e6812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f0e66ffd640 1 -- 172.21.15.107:0/3767486056 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68112bd0 con 0x7f0e6812ef80 2024-02-16T10:30:19.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f35ee59c640 1 --2- 172.21.15.107:0/3056325876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0098e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009740 tx=0x7f35e001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9937685fa63766 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3435baf640 1 -- 172.21.15.107:0/2628744480 >> v1:172.21.15.107:6789/0 conn(0x7f343012eca0 legacy=0x7f343006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.105+0000 7f3435baf640 1 -- 172.21.15.107:0/2628744480 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430071cb0 con 0x7f343012e380 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ed59a640 1 -- 172.21.15.107:0/3056325876 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35e00ab530 con 0x7f35f0098a30 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ed59a640 1 -- 172.21.15.107:0/3056325876 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00a7050 con 0x7f35f0098a30 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ed59a640 1 -- 172.21.15.107:0/3056325876 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35e00ab7e0 con 0x7f35f0098a30 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- 172.21.15.107:0/3056325876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 msgr2=0x7f35f0098e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 --2- 172.21.15.107:0/3056325876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0098e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009740 tx=0x7f35e001c310 comp rx=0 tx=0).stop 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- 172.21.15.107:0/3056325876 shutdown_connections 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 --2- 172.21.15.107:0/3056325876 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0098e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- 172.21.15.107:0/3056325876 >> 172.21.15.107:0/3056325876 conn(0x7f35f009c460 msgr2=0x7f35f0071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- 172.21.15.107:0/3056325876 shutdown_connections 2024-02-16T10:30:19.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- 172.21.15.107:0/3056325876 wait complete. 2024-02-16T10:30:19.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 Processor -- start 2024-02-16T10:30:19.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- start start 2024-02-16T10:30:19.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4abe7fc640 1 --2- 172.21.15.107:0/519709251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806f050 0x7f4ac8133480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097f0 tx=0x7f4ab001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8beda5dd0eca7fd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4ac67fc640 1 -- 172.21.15.107:0/519709251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ab00ab470 con 0x7f4ac806f050 2024-02-16T10:30:19.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f0e66ffd640 1 --2- 172.21.15.107:0/3767486056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6812ef80 0x7f0e68131370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009740 tx=0x7f0e5c0207a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7595c8eda31f5e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4ac67fc640 1 -- 172.21.15.107:0/519709251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab00ab5d0 con 0x7f4ac806f050 2024-02-16T10:30:19.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4ac67fc640 1 -- 172.21.15.107:0/519709251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ab00ab8b0 con 0x7f4ac806f050 2024-02-16T10:30:19.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3435baf640 1 --2- 172.21.15.107:0/2628744480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012e760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f342c0097f0 tx=0x7f342c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce34dc0927e3999b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f0e667fc640 1 -- 172.21.15.107:0/3767486056 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c0ad5a0 con 0x7f0e6812ef80 2024-02-16T10:30:19.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3434bad640 1 -- 172.21.15.107:0/2628744480 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c0ab530 con 0x7f343012e380 2024-02-16T10:30:19.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f0e667fc640 1 -- 172.21.15.107:0/3767486056 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c0ad700 con 0x7f0e6812ef80 2024-02-16T10:30:19.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35f48d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f011cd30 con 0x7f35f0098a30 2024-02-16T10:30:19.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f0e667fc640 1 -- 172.21.15.107:0/3767486056 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e5c0ada00 con 0x7f0e6812ef80 2024-02-16T10:30:19.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3434bad640 1 -- 172.21.15.107:0/2628744480 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c0a7050 con 0x7f343012e380 2024-02-16T10:30:19.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3434bad640 1 -- 172.21.15.107:0/2628744480 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c0ab7e0 con 0x7f343012e380 2024-02-16T10:30:19.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ee59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ee59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40362/0 (socket says 172.21.15.107:40362) 2024-02-16T10:30:19.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ee59c640 1 -- 172.21.15.107:0/2536623 learned_addr learned my addr 172.21.15.107:0/2536623 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ee59c640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009420 con 0x7f35f0098a30 2024-02-16T10:30:19.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35ee59c640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35e0019fa0 tx=0x7f35e001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4acd71d640 1 -- 172.21.15.107:0/519709251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806f050 msgr2=0x7f4ac8133480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4acd71d640 1 --2- 172.21.15.107:0/519709251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806f050 0x7f4ac8133480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097f0 tx=0x7f4ab001c450 comp rx=0 tx=0).stop 2024-02-16T10:30:19.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35e00b7450 con 0x7f35f0098a30 2024-02-16T10:30:19.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4acd71d640 1 -- 172.21.15.107:0/519709251 shutdown_connections 2024-02-16T10:30:19.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4acd71d640 1 --2- 172.21.15.107:0/519709251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806f050 0x7f4ac8133480 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097f0 tx=0x7f4ab001c450 comp rx=0 tx=0).stop 2024-02-16T10:30:19.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f4acd71d640 1 -- 172.21.15.107:0/519709251 >> 172.21.15.107:0/519709251 conn(0x7f4ac809c630 msgr2=0x7f4ac809ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3437e13640 1 -- 172.21.15.107:0/2628744480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 msgr2=0x7f343012e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.109+0000 7f3437e13640 1 --2- 172.21.15.107:0/2628744480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012e760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f342c0097f0 tx=0x7f342c01c4a0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f011b4f0 con 0x7f35f0098a30 2024-02-16T10:30:19.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6812ef80 msgr2=0x7f0e68131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3767486056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6812ef80 0x7f0e68131370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009740 tx=0x7f0e5c0207a0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f011c180 con 0x7f35f0098a30 2024-02-16T10:30:19.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00b75b0 con 0x7f35f0098a30 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35e00b7850 con 0x7f35f0098a30 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 shutdown_connections 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3767486056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6812ef80 0x7f0e68131370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 >> 172.21.15.107:0/3767486056 conn(0x7f0e6809a1c0 msgr2=0x7f0e6809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 shutdown_connections 2024-02-16T10:30:19.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3767486056 wait complete. 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/2628744480 shutdown_connections 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 --2- 172.21.15.107:0/2628744480 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012e760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/2628744480 >> 172.21.15.107:0/2628744480 conn(0x7f343009ce90 msgr2=0x7f343006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/2628744480 shutdown_connections 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/2628744480 wait complete. 2024-02-16T10:30:19.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35f0131fc0 con 0x7f35f0098a30 2024-02-16T10:30:19.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 -- 172.21.15.107:0/519709251 shutdown_connections 2024-02-16T10:30:19.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 -- 172.21.15.107:0/519709251 wait complete. 2024-02-16T10:30:19.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35e00b79b0 con 0x7f35f0098a30 2024-02-16T10:30:19.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 0x7f35d0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 Processor -- start 2024-02-16T10:30:19.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 Processor -- start 2024-02-16T10:30:19.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f35e00e26a0 con 0x7f35f0098a30 2024-02-16T10:30:19.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- start start 2024-02-16T10:30:19.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- start start 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 0x7f35d003d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35d003dca0 con 0x7f35d003b190 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35e00e4c50 con 0x7f35f0098a30 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35eed9d640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 0x7f35d003d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35edd9b640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 0x7f35d0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 Processor -- start 2024-02-16T10:30:19.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e681148e0 con 0x7f0e6806f8b0 2024-02-16T10:30:19.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343011b550 con 0x7f343012e380 2024-02-16T10:30:19.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40376/0 (socket says 172.21.15.107:40376) 2024-02-16T10:30:19.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e677fe640 1 -- 172.21.15.107:0/3598201339 learned_addr learned my addr 172.21.15.107:0/3598201339 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35eed9d640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 0x7f35d003d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e677fe640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009420 con 0x7f0e6806f8b0 2024-02-16T10:30:19.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 -- start start 2024-02-16T10:30:19.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8116b20 con 0x7f4ac806e560 2024-02-16T10:30:19.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35edd9b640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 0x7f35d0037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e677fe640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c450 tx=0x7f0e5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3435baf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40380/0 (socket says 172.21.15.107:40380) 2024-02-16T10:30:19.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4ac6ffd640 1 -- 172.21.15.107:0/2778820379 learned_addr learned my addr 172.21.15.107:0/2778820379 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3435baf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40386/0 (socket says 172.21.15.107:40386) 2024-02-16T10:30:19.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3435baf640 1 -- 172.21.15.107:0/3020553542 learned_addr learned my addr 172.21.15.107:0/3020553542 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e58005c20 con 0x7f0e6806f8b0 2024-02-16T10:30:19.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e58005d80 con 0x7f0e6806f8b0 2024-02-16T10:30:19.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68114b80 con 0x7f0e6806f8b0 2024-02-16T10:30:19.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e580071a0 con 0x7f0e6806f8b0 2024-02-16T10:30:19.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6812b960 con 0x7f0e6806f8b0 2024-02-16T10:30:19.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4ac6ffd640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00094d0 con 0x7f4ac806e560 2024-02-16T10:30:19.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4ac6ffd640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c480 tx=0x7f4ab800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35d003dca0 con 0x7f35d003b190 2024-02-16T10:30:19.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ab8005150 con 0x7f4ac806e560 2024-02-16T10:30:19.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80052b0 con 0x7f4ac806e560 2024-02-16T10:30:19.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f4acd71d640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac8115b80 con 0x7f4ac806e560 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3435baf640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0094d0 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3435baf640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f342c01a0d0 tx=0x7f342c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c0b6420 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c0b6580 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343011ade0 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c0b6840 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343011b020 con 0x7f343012e380 2024-02-16T10:30:19.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.113+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e6812cb30 con 0x7f0e6806f8b0 2024-02-16T10:30:19.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ab8007030 con 0x7f4ac806e560 2024-02-16T10:30:19.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4acd71d640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac81311b0 con 0x7f4ac806e560 2024-02-16T10:30:19.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f343006e420 con 0x7f343012e380 2024-02-16T10:30:19.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4acd71d640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ac8062980 con 0x7f4ac806e560 2024-02-16T10:30:19.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f342c0b2040 con 0x7f343012e380 2024-02-16T10:30:19.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4ab8007190 con 0x7f4ac806e560 2024-02-16T10:30:19.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 0x7f3414037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f342c0e22a0 con 0x7f343012e380 2024-02-16T10:30:19.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 0x7f4aa8037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0e58007300 con 0x7f0e6806f8b0 2024-02-16T10:30:19.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4ab8018680 con 0x7f4ac806e560 2024-02-16T10:30:19.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 0x7f341403d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f341403dca0 con 0x7f341403b190 2024-02-16T10:30:19.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342c0e4890 con 0x7f343012e380 2024-02-16T10:30:19.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 0x7f4aa803d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4aa803dac0 con 0x7f4aa803afb0 2024-02-16T10:30:19.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab80074e0 con 0x7f4ac806e560 2024-02-16T10:30:19.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 0x7f0e54037f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0e58047e60 con 0x7f0e6806f8b0 2024-02-16T10:30:19.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 0x7f0e5403d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e5403dcf0 con 0x7f0e5403b1e0 2024-02-16T10:30:19.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e58048190 con 0x7f0e6806f8b0 2024-02-16T10:30:19.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34353ae640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 0x7f3414037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abe7fc640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 0x7f4aa8037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4ac77fe640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 0x7f4aa803d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e66ffd640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 0x7f0e54037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34363b0640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 0x7f341403d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e67fff640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 0x7f0e5403d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4ac77fe640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 0x7f4aa803d3f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34353ae640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 0x7f3414037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3420000f70 tx=0x7f3420007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f34363b0640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 0x7f341403d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f4abe7fc640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 0x7f4aa8037e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00af000 tx=0x7f4ab0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e67fff640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 0x7f0e5403d620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.117+0000 7f0e66ffd640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 0x7f0e54037f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0b2000 tx=0x7f0e5c0b7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.121+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4aa803dac0 con 0x7f4aa803afb0 2024-02-16T10:30:19.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.121+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f341403dca0 con 0x7f341403b190 2024-02-16T10:30:19.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.121+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e5403dcf0 con 0x7f0e5403b1e0 2024-02-16T10:30:19.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4acd71d640 1 -- 172.21.15.107:0/2778820379 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ac81361e0 con 0x7f4aa803afb0 2024-02-16T10:30:19.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3430119cb0 con 0x7f341403b190 2024-02-16T10:30:19.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abffff640 1 -- 172.21.15.107:0/2778820379 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ac81361e0 con 0x7f4aa803afb0 2024-02-16T10:30:19.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 msgr2=0x7f4aa803d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 0x7f4aa803d3f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 msgr2=0x7f4aa8037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 0x7f4aa8037e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00af000 tx=0x7f4ab0008040 comp rx=0 tx=0).stop 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 msgr2=0x7f4ac8113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c480 tx=0x7f4ab800c940 comp rx=0 tx=0).stop 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 shutdown_connections 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7f4aa803afb0 0x7f4aa803d3f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4aa80359a0 0x7f4aa8037e60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f34267fc640 1 -- 172.21.15.107:0/3020553542 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3430119cb0 con 0x7f341403b190 2024-02-16T10:30:19.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 --2- 172.21.15.107:0/2778820379 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac806e560 0x7f4ac8113af0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.133+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 >> 172.21.15.107:0/2778820379 conn(0x7f4ac809c630 msgr2=0x7f4ac8098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 shutdown_connections 2024-02-16T10:30:19.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f4abd7fa640 1 -- 172.21.15.107:0/2778820379 wait complete. 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 msgr2=0x7f341403d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 0x7f341403d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 msgr2=0x7f3414037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 0x7f3414037ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3420000f70 tx=0x7f3420007a40 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 msgr2=0x7f343012d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f342c01a0d0 tx=0x7f342c01ace0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 shutdown_connections 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f341403b190 0x7f341403d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3414035a10 0x7f3414037ed0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 --2- 172.21.15.107:0/3020553542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f343012e380 0x7f343012d3a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 >> 172.21.15.107:0/3020553542 conn(0x7f343009ce90 msgr2=0x7f3430115a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 shutdown_connections 2024-02-16T10:30:19.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f3437e13640 1 -- 172.21.15.107:0/3020553542 wait complete. 2024-02-16T10:30:19.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.137+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35f0099760 con 0x7f35d003b190 2024-02-16T10:30:19.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35deffd640 1 -- 172.21.15.107:0/2536623 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35e8011040 con 0x7f35d003b190 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 msgr2=0x7f35d003d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 0x7f35d003d5d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 msgr2=0x7f35d0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 0x7f35d0037ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4007980 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 msgr2=0x7f35f0129360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35e0019fa0 tx=0x7f35e001abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 shutdown_connections 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35d003b190 0x7f35d003d5d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f35d0035a10 0x7f35d0037ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 --2- 172.21.15.107:0/2536623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f35f0098a30 0x7f35f0129360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 >> 172.21.15.107:0/2536623 conn(0x7f35f009c460 msgr2=0x7f35f012d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 shutdown_connections 2024-02-16T10:30:19.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.141+0000 7f35f48d1640 1 -- 172.21.15.107:0/2536623 wait complete. 2024-02-16T10:30:19.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.145+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e68062980 con 0x7f0e5403b1e0 2024-02-16T10:30:19.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e4ffff640 1 -- 172.21.15.107:0/3598201339 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e68062980 con 0x7f0e5403b1e0 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 msgr2=0x7f0e5403d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 0x7f0e5403d620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 msgr2=0x7f0e54037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 0x7f0e54037f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0b2000 tx=0x7f0e5c0b7040 comp rx=0 tx=0).stop 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 msgr2=0x7f0e68121110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c450 tx=0x7f0e5800c910 comp rx=0 tx=0).stop 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 shutdown_connections 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e5403b1e0 0x7f0e5403d620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0e54035a60 0x7f0e54037f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 --2- 172.21.15.107:0/3598201339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e6806f8b0 0x7f0e68121110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 >> 172.21.15.107:0/3598201339 conn(0x7f0e6809a1c0 msgr2=0x7f0e6812a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 shutdown_connections 2024-02-16T10:30:19.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.149+0000 7f0e6de1e640 1 -- 172.21.15.107:0/3598201339 wait complete. 2024-02-16T10:30:19.173 INFO:teuthology.orchestra.run.smithi107.stdout:38654705670 2024-02-16T10:30:19.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T10:30:19.174 INFO:teuthology.orchestra.run.smithi107.stdout:38654705668 2024-02-16T10:30:19.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T10:30:19.175 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-02-16T10:30:19.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T10:30:19.177 INFO:teuthology.orchestra.run.smithi107.stdout:38654705670 2024-02-16T10:30:19.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T10:30:19.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.273+0000 7fc05d1f2640 1 Processor -- start 2024-02-16T10:30:19.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.273+0000 7fc05d1f2640 1 -- start start 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc05d1f2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc058098a30 0x7fc058098e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc05d1f2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05809afd0 con 0x7fc058099350 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc05d1f2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05809ac30 con 0x7fc058098a30 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc05659c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc058099350 0x7fc058128b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52274/0 (socket says 172.21.15.107:52274) 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc05659c640 1 -- 172.21.15.107:0/4282836364 learned_addr learned my addr 172.21.15.107:0/4282836364 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc056d9d640 1 --2- 172.21.15.107:0/4282836364 >> v2:172.21.15.107:3300/0 conn(0x7fc058098a30 0x7fc058098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc056d9d640 1 -- 172.21.15.107:0/4282836364 >> v1:172.21.15.107:6789/0 conn(0x7fc058099350 legacy=0x7fc058128b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc055d9b640 1 -- 172.21.15.107:0/4282836364 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790003866 0 0) 0x7fc05809afd0 con 0x7fc058099350 2024-02-16T10:30:19.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.277+0000 7fc056d9d640 1 -- 172.21.15.107:0/4282836364 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05809b780 con 0x7fc058098a30 2024-02-16T10:30:19.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc056d9d640 1 --2- 172.21.15.107:0/4282836364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc058098e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc048009740 tx=0x7fc04801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bb218fec451af6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc055d9b640 1 -- 172.21.15.107:0/4282836364 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480ab530 con 0x7fc058098a30 2024-02-16T10:30:19.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc055d9b640 1 -- 172.21.15.107:0/4282836364 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0480a7050 con 0x7fc058098a30 2024-02-16T10:30:19.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc055d9b640 1 -- 172.21.15.107:0/4282836364 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480ab7e0 con 0x7fc058098a30 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- 172.21.15.107:0/4282836364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 msgr2=0x7fc058098e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/4282836364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc058098e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc048009740 tx=0x7fc04801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- 172.21.15.107:0/4282836364 shutdown_connections 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/4282836364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc058098e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- 172.21.15.107:0/4282836364 >> 172.21.15.107:0/4282836364 conn(0x7fc05809c2f0 msgr2=0x7fc058071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- 172.21.15.107:0/4282836364 shutdown_connections 2024-02-16T10:30:19.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- 172.21.15.107:0/4282836364 wait complete. 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 Processor -- start 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- start start 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc05d1f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc058118360 con 0x7fc058098a30 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc056d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc056d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40414/0 (socket says 172.21.15.107:40414) 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc056d9d640 1 -- 172.21.15.107:0/944006651 learned_addr learned my addr 172.21.15.107:0/944006651 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.281+0000 7fc056d9d640 1 -- 172.21.15.107:0/944006651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048009420 con 0x7fc058098a30 2024-02-16T10:30:19.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc056d9d640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc048019fa0 tx=0x7fc04801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480b7580 con 0x7fc058098a30 2024-02-16T10:30:19.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0480b76e0 con 0x7fc058098a30 2024-02-16T10:30:19.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc058126ae0 con 0x7fc058098a30 2024-02-16T10:30:19.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480b7980 con 0x7fc058098a30 2024-02-16T10:30:19.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc058117f30 con 0x7fc058098a30 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc0480b7ae0 con 0x7fc058098a30 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058062980 con 0x7fc058098a30 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 0x7fc044037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc0480e2b50 con 0x7fc058098a30 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc05659c640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 0x7fc044037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.285+0000 7fc05659c640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 0x7fc044037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc04c007fd0 tx=0x7fc04c007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.289+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0480c79e0 con 0x7fc058098a30 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f390d497640 1 Processor -- start 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f390d497640 1 -- start start 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f390d497640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f390806e560 0x7f390806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f390d497640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390806f9e0 con 0x7f390806ee80 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f390d497640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390806c6a0 con 0x7f390806e560 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f3906ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f390806e560 0x7f390806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f39067fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f390806ee80 0x7f390812dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52278/0 (socket says 172.21.15.107:52278) 2024-02-16T10:30:19.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f39067fc640 1 -- 172.21.15.107:0/3483954831 learned_addr learned my addr 172.21.15.107:0/3483954831 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a32d04640 1 Processor -- start 2024-02-16T10:30:19.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a32d04640 1 -- start start 2024-02-16T10:30:19.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f3906ffd640 1 -- 172.21.15.107:0/3483954831 >> v1:172.21.15.107:6789/0 conn(0x7f390806ee80 legacy=0x7f390812dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f3906ffd640 1 -- 172.21.15.107:0/3483954831 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390806d1b0 con 0x7f390806e560 2024-02-16T10:30:19.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a32d04640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6a2c06c440 0x7f6a2c06c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a32d04640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c071b90 con 0x7f6a2c06cd60 2024-02-16T10:30:19.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a32d04640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c06ed70 con 0x7f6a2c06c440 2024-02-16T10:30:19.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a2bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6a2c06cd60 0x7f6a2c12dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52294/0 (socket says 172.21.15.107:52294) 2024-02-16T10:30:19.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a2bfff640 1 -- 172.21.15.107:0/252418562 learned_addr learned my addr 172.21.15.107:0/252418562 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a30aa0640 1 --2- 172.21.15.107:0/252418562 >> v2:172.21.15.107:3300/0 conn(0x7f6a2c06c440 0x7f6a2c06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a30aa0640 1 -- 172.21.15.107:0/252418562 >> v1:172.21.15.107:6789/0 conn(0x7f6a2c06cd60 legacy=0x7f6a2c12dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a2b7fe640 1 -- 172.21.15.107:0/252418562 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518403927 0 0) 0x7f6a2c071b90 con 0x7f6a2c06cd60 2024-02-16T10:30:19.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.317+0000 7f6a30aa0640 1 -- 172.21.15.107:0/252418562 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c09aca0 con 0x7f6a2c06c440 2024-02-16T10:30:19.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812c879640 1 Processor -- start 2024-02-16T10:30:19.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812c879640 1 -- start start 2024-02-16T10:30:19.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3906ffd640 1 --2- 172.21.15.107:0/3483954831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390806e940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f390806d3a0 tx=0x7f38f801c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9578ed539668b980 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3905ffb640 1 -- 172.21.15.107:0/3483954831 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38f80ab530 con 0x7f390806e560 2024-02-16T10:30:19.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3905ffb640 1 -- 172.21.15.107:0/3483954831 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f80a7050 con 0x7f390806e560 2024-02-16T10:30:19.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3905ffb640 1 -- 172.21.15.107:0/3483954831 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38f80ab7e0 con 0x7f390806e560 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812c879640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f812806ec70 0x7f812806f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812c879640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812806feb0 con 0x7f812806f590 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812c879640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812809aca0 con 0x7f812806ec70 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f812806ec70 0x7f812806f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f8125d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f812806f590 0x7f812812ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52304/0 (socket says 172.21.15.107:52304) 2024-02-16T10:30:19.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f8125d9b640 1 -- 172.21.15.107:0/1387004498 learned_addr learned my addr 172.21.15.107:0/1387004498 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:19.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a30aa0640 1 --2- 172.21.15.107:0/252418562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06c440 0x7f6a2c06c820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009740 tx=0x7f6a2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b625a5f56ad1617e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812659c640 1 -- 172.21.15.107:0/1387004498 >> v1:172.21.15.107:6789/0 conn(0x7f812806f590 legacy=0x7f812812ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812659c640 1 -- 172.21.15.107:0/1387004498 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128071510 con 0x7f812806ec70 2024-02-16T10:30:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a2b7fe640 1 -- 172.21.15.107:0/252418562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a200ab530 con 0x7f6a2c06c440 2024-02-16T10:30:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a2b7fe640 1 -- 172.21.15.107:0/252418562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200a7050 con 0x7f6a2c06c440 2024-02-16T10:30:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a2b7fe640 1 -- 172.21.15.107:0/252418562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a200ab7e0 con 0x7f6a2c06c440 2024-02-16T10:30:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- 172.21.15.107:0/3483954831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 msgr2=0x7f390806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 --2- 172.21.15.107:0/3483954831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390806e940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f390806d3a0 tx=0x7f38f801c200 comp rx=0 tx=0).stop 2024-02-16T10:30:19.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- 172.21.15.107:0/3483954831 shutdown_connections 2024-02-16T10:30:19.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 --2- 172.21.15.107:0/3483954831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390806e940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- 172.21.15.107:0/3483954831 >> 172.21.15.107:0/3483954831 conn(0x7f390809c620 msgr2=0x7f390809ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- 172.21.15.107:0/3483954831 shutdown_connections 2024-02-16T10:30:19.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- 172.21.15.107:0/3483954831 wait complete. 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- 172.21.15.107:0/252418562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06c440 msgr2=0x7f6a2c06c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 --2- 172.21.15.107:0/252418562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06c440 0x7f6a2c06c820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009740 tx=0x7f6a2001c400 comp rx=0 tx=0).stop 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- 172.21.15.107:0/252418562 shutdown_connections 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 --2- 172.21.15.107:0/252418562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06c440 0x7f6a2c06c820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- 172.21.15.107:0/252418562 >> 172.21.15.107:0/252418562 conn(0x7f6a2c09cf80 msgr2=0x7f6a2c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- 172.21.15.107:0/252418562 shutdown_connections 2024-02-16T10:30:19.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- 172.21.15.107:0/252418562 wait complete. 2024-02-16T10:30:19.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 Processor -- start 2024-02-16T10:30:19.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- start start 2024-02-16T10:30:19.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f390d497640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390811e230 con 0x7f390806e560 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3906ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3906ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40454/0 (socket says 172.21.15.107:40454) 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3906ffd640 1 -- 172.21.15.107:0/3694125601 learned_addr learned my addr 172.21.15.107:0/3694125601 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 Processor -- start 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f6a32d04640 1 -- start start 2024-02-16T10:30:19.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f812659c640 1 --2- 172.21.15.107:0/1387004498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f812806f050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8118009740 tx=0x7f811801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bb8fc620ca7de7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.321+0000 7f3906ffd640 1 -- 172.21.15.107:0/3694125601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8009420 con 0x7f390806e560 2024-02-16T10:30:19.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812559a640 1 -- 172.21.15.107:0/1387004498 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180ab530 con 0x7f812806ec70 2024-02-16T10:30:19.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812559a640 1 -- 172.21.15.107:0/1387004498 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81180a7050 con 0x7f812806ec70 2024-02-16T10:30:19.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812559a640 1 -- 172.21.15.107:0/1387004498 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180ab7e0 con 0x7f812806ec70 2024-02-16T10:30:19.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f3906ffd640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38f8018e10 tx=0x7f38f801aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a32d04640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a32d04640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c11dfb0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38f80b7660 con 0x7f390806e560 2024-02-16T10:30:19.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f80b77c0 con 0x7f390806e560 2024-02-16T10:30:19.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390811bda0 con 0x7f390806e560 2024-02-16T10:30:19.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a30aa0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38f80b7aa0 con 0x7f390806e560 2024-02-16T10:30:19.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390811d250 con 0x7f390806e560 2024-02-16T10:30:19.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a30aa0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40462/0 (socket says 172.21.15.107:40462) 2024-02-16T10:30:19.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a30aa0640 1 -- 172.21.15.107:0/3390403637 learned_addr learned my addr 172.21.15.107:0/3390403637 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- 172.21.15.107:0/1387004498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 msgr2=0x7f812806f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 --2- 172.21.15.107:0/1387004498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f812806f050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8118009740 tx=0x7f811801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- 172.21.15.107:0/1387004498 shutdown_connections 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 --2- 172.21.15.107:0/1387004498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f812806f050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- 172.21.15.107:0/1387004498 >> 172.21.15.107:0/1387004498 conn(0x7f812809ce90 msgr2=0x7f812806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- 172.21.15.107:0/1387004498 shutdown_connections 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- 172.21.15.107:0/1387004498 wait complete. 2024-02-16T10:30:19.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a30aa0640 1 -- 172.21.15.107:0/3390403637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20009420 con 0x7f6a2c06cd60 2024-02-16T10:30:19.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390811e370 con 0x7f390806e560 2024-02-16T10:30:19.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a30aa0640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a20019010 tx=0x7f6a2001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a200b7580 con 0x7f6a2c06cd60 2024-02-16T10:30:19.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200b76e0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c11c770 con 0x7f6a2c06cd60 2024-02-16T10:30:19.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 Processor -- start 2024-02-16T10:30:19.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a200b79c0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c11d6e0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f38f80b7c00 con 0x7f390806e560 2024-02-16T10:30:19.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f38ef7fe640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 0x7f38f4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- start start 2024-02-16T10:30:19.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812c879640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8128117000 con 0x7f812806ec70 2024-02-16T10:30:19.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f39067fc640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 0x7f38f4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40470/0 (socket says 172.21.15.107:40470) 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812659c640 1 -- 172.21.15.107:0/2332252448 learned_addr learned my addr 172.21.15.107:0/2332252448 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812659c640 1 -- 172.21.15.107:0/2332252448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118009420 con 0x7f812806ec70 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f812659c640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81180ae040 tx=0x7f811801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f39067fc640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 0x7f38f4037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005890 tx=0x7f38fc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.325+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c11c2d0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180b7450 con 0x7f812806ec70 2024-02-16T10:30:19.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81180b75b0 con 0x7f812806ec70 2024-02-16T10:30:19.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180b7890 con 0x7f812806ec70 2024-02-16T10:30:19.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81281172c0 con 0x7f812806ec70 2024-02-16T10:30:19.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8128115540 con 0x7f812806ec70 2024-02-16T10:30:19.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6a200b7d30 con 0x7f6a2c06cd60 2024-02-16T10:30:19.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f6a297fa640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 0x7f6a10037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6a200e3010 con 0x7f6a2c06cd60 2024-02-16T10:30:19.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.329+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8128062980 con 0x7f812806ec70 2024-02-16T10:30:19.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.333+0000 7f6a2bfff640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 0x7f6a10037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.333+0000 7f6a2bfff640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 0x7f6a10037ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a18007fd0 tx=0x7f6a18007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.333+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a200bfe20 con 0x7f6a2c06cd60 2024-02-16T10:30:19.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.333+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f81180b79f0 con 0x7f812806ec70 2024-02-16T10:30:19.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f38f80e0e80 con 0x7f390806e560 2024-02-16T10:30:19.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f8116ffd640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 0x7f8108037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:19.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38f80bd2c0 con 0x7f390806e560 2024-02-16T10:30:19.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f81180e2b60 con 0x7f812806ec70 2024-02-16T10:30:19.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f8125d9b640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 0x7f8108037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:19.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.337+0000 7f8125d9b640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 0x7f8108037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f811c001610 tx=0x7f811c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:19.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.341+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f81180bf770 con 0x7f812806ec70 2024-02-16T10:30:19.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.449+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc058131a10 con 0x7fc058098a30 2024-02-16T10:30:19.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.449+0000 7fc03f7fe640 1 -- 172.21.15.107:0/944006651 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0480bb070 con 0x7fc058098a30 2024-02-16T10:30:19.458 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-02-16T10:30:19.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 msgr2=0x7fc044037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 0x7fc044037ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc04c007fd0 tx=0x7fc04c007980 comp rx=0 tx=0).stop 2024-02-16T10:30:19.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 msgr2=0x7fc0581156b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc048019fa0 tx=0x7fc04801abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 shutdown_connections 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc044035a10 0x7fc044037ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 --2- 172.21.15.107:0/944006651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc058098a30 0x7fc0581156b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 >> 172.21.15.107:0/944006651 conn(0x7fc05809c2f0 msgr2=0x7fc05812b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 shutdown_connections 2024-02-16T10:30:19.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.453+0000 7fc05d1f2640 1 -- 172.21.15.107:0/944006651 wait complete. 2024-02-16T10:30:19.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-02-16T10:30:19.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.493+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3908062980 con 0x7f390806e560 2024-02-16T10:30:19.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.493+0000 7f38ef7fe640 1 -- 172.21.15.107:0/3694125601 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38f80b0020 con 0x7f390806e560 2024-02-16T10:30:19.501 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 msgr2=0x7f38f4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 0x7f38f4037ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005890 tx=0x7f38fc007ab0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 msgr2=0x7f390811aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38f8018e10 tx=0x7f38f801aa40 comp rx=0 tx=0).stop 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 shutdown_connections 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f38f4035a10 0x7f38f4037ed0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005890 tx=0x7f38fc007ab0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 --2- 172.21.15.107:0/3694125601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390806e560 0x7f390811aba0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 >> 172.21.15.107:0/3694125601 conn(0x7f390809c620 msgr2=0x7f390812fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 shutdown_connections 2024-02-16T10:30:19.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.497+0000 7f390d497640 1 -- 172.21.15.107:0/3694125601 wait complete. 2024-02-16T10:30:19.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-02-16T10:30:19.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.509+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a2c06f8f0 con 0x7f6a2c06cd60 2024-02-16T10:30:19.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a297fa640 1 -- 172.21.15.107:0/3390403637 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a200bb070 con 0x7f6a2c06cd60 2024-02-16T10:30:19.518 INFO:teuthology.orchestra.run.smithi107.stdout:38654705668 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 msgr2=0x7f6a10037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 0x7f6a10037ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a18007fd0 tx=0x7f6a18007980 comp rx=0 tx=0).stop 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 msgr2=0x7f6a2c12a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a20019010 tx=0x7f6a2001ac40 comp rx=0 tx=0).stop 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 shutdown_connections 2024-02-16T10:30:19.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6a10035a10 0x7f6a10037ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 --2- 172.21.15.107:0/3390403637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6a2c06cd60 0x7f6a2c12a5e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 >> 172.21.15.107:0/3390403637 conn(0x7f6a2c06c440 msgr2=0x7f6a2c12fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 shutdown_connections 2024-02-16T10:30:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.513+0000 7f6a32d04640 1 -- 172.21.15.107:0/3390403637 wait complete. 2024-02-16T10:30:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8128073f80 con 0x7f812806ec70 2024-02-16T10:30:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f8116ffd640 1 -- 172.21.15.107:0/2332252448 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81180b0020 con 0x7f812806ec70 2024-02-16T10:30:19.523 INFO:teuthology.orchestra.run.smithi107.stdout:38654705667 2024-02-16T10:30:19.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 msgr2=0x7f8108037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 0x7f8108037ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f811c001610 tx=0x7f811c007ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 msgr2=0x7f8128113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81180ae040 tx=0x7f811801abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 shutdown_connections 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8108035a10 0x7f8108037ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 --2- 172.21.15.107:0/2332252448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f812806ec70 0x7f8128113a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 >> 172.21.15.107:0/2332252448 conn(0x7f812809ce90 msgr2=0x7f812812e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 shutdown_connections 2024-02-16T10:30:19.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:19.517+0000 7f812c879640 1 -- 172.21.15.107:0/2332252448 wait complete. 2024-02-16T10:30:19.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-02-16T10:30:19.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-02-16T10:30:20.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-16T10:30:20.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-16T10:30:20.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-16T10:30:20.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.593+0000 7f4b29ab7640 1 Processor -- start 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.593+0000 7f4b29ab7640 1 -- start start 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.593+0000 7f4b29ab7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b2412d1d0 0x7f4b2412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.593+0000 7f4b29ab7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2409cea0 con 0x7f4b2406c440 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.593+0000 7f4b29ab7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2406f310 con 0x7f4b2412d1d0 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b237fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b2412d1d0 0x7f4b2412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b22ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b2406c440 0x7f4b2406c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52316/0 (socket says 172.21.15.107:52316) 2024-02-16T10:30:20.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b22ffd640 1 -- 172.21.15.107:0/2089088138 learned_addr learned my addr 172.21.15.107:0/2089088138 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:20.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b237fe640 1 -- 172.21.15.107:0/2089088138 >> v1:172.21.15.107:6789/0 conn(0x7f4b2406c440 legacy=0x7f4b2406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b237fe640 1 -- 172.21.15.107:0/2089088138 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2412daf0 con 0x7f4b2412d1d0 2024-02-16T10:30:20.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b237fe640 1 --2- 172.21.15.107:0/2089088138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2412d1d0 0x7f4b2412d5b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009740 tx=0x7f4b1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6120218d8476c746 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b227fc640 1 -- 172.21.15.107:0/2089088138 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b140a8050 con 0x7f4b2412d1d0 2024-02-16T10:30:20.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b227fc640 1 -- 172.21.15.107:0/2089088138 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140ac520 con 0x7f4b2412d1d0 2024-02-16T10:30:20.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.597+0000 7f4b227fc640 1 -- 172.21.15.107:0/2089088138 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b140ac7e0 con 0x7f4b2412d1d0 2024-02-16T10:30:20.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/2089088138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2412d1d0 msgr2=0x7f4b2412d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/2089088138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2412d1d0 0x7f4b2412d5b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009740 tx=0x7f4b1401c370 comp rx=0 tx=0).stop 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/2089088138 shutdown_connections 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/2089088138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2412d1d0 0x7f4b2412d5b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/2089088138 >> 172.21.15.107:0/2089088138 conn(0x7f4b24099ce0 msgr2=0x7f4b2409c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/2089088138 shutdown_connections 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/2089088138 wait complete. 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 Processor -- start 2024-02-16T10:30:20.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- start start 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2411f1a0 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40496/0 (socket says 172.21.15.107:40496) 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b237fe640 1 -- 172.21.15.107:0/634911047 learned_addr learned my addr 172.21.15.107:0/634911047 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b237fe640 1 -- 172.21.15.107:0/634911047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14009420 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b237fe640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4b1401aa20 tx=0x7f4b1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b140b8660 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140b87c0 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b140b8a60 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2411d960 con 0x7f4b2406c440 2024-02-16T10:30:20.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.601+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2411e5f0 con 0x7f4b2406c440 2024-02-16T10:30:20.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b24062980 con 0x7f4b2406c440 2024-02-16T10:30:20.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b140b8bc0 con 0x7f4b2406c440 2024-02-16T10:30:20.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b0bfff640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4b140e2630 con 0x7f4b2406c440 2024-02-16T10:30:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b22ffd640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.605+0000 7f4b22ffd640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b18001610 tx=0x7f4b18007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.613+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b140c89f0 con 0x7f4b2406c440 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0399cf1640 1 Processor -- start 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0399cf1640 1 -- start start 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0399cf1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f039412e840 0x7f039406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0399cf1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940700c0 con 0x7f039412e460 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0399cf1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0394070730 con 0x7f039412e840 2024-02-16T10:30:20.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f039412e840 0x7f039406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f039412e840 0x7f039406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40508/0 (socket says 172.21.15.107:40508) 2024-02-16T10:30:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 -- 172.21.15.107:0/2229339000 learned_addr learned my addr 172.21.15.107:0/2229339000 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 -- 172.21.15.107:0/2229339000 >> v1:172.21.15.107:6789/0 conn(0x7f039412e460 legacy=0x7f039406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0392ffd640 1 -- 172.21.15.107:0/2229339000 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482972929 0 0) 0x7f03940700c0 con 0x7f039412e460 2024-02-16T10:30:20.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 -- 172.21.15.107:0/2229339000 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394070fd0 con 0x7f039412e840 2024-02-16T10:30:20.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f038affd640 1 --2- 172.21.15.107:0/2229339000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e840 0x7f039406e550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097f0 tx=0x7f037c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea72615e4d0b2a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0392ffd640 1 -- 172.21.15.107:0/2229339000 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c0ac570 con 0x7f039412e840 2024-02-16T10:30:20.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0392ffd640 1 -- 172.21.15.107:0/2229339000 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c0ac6d0 con 0x7f039412e840 2024-02-16T10:30:20.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.633+0000 7f0392ffd640 1 -- 172.21.15.107:0/2229339000 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c0ac990 con 0x7f039412e840 2024-02-16T10:30:20.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/2229339000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e840 msgr2=0x7f039406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 --2- 172.21.15.107:0/2229339000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e840 0x7f039406e550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097f0 tx=0x7f037c01c400 comp rx=0 tx=0).stop 2024-02-16T10:30:20.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/2229339000 shutdown_connections 2024-02-16T10:30:20.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 --2- 172.21.15.107:0/2229339000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e840 0x7f039406e550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/2229339000 >> 172.21.15.107:0/2229339000 conn(0x7f039409dd80 msgr2=0x7f039406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/2229339000 shutdown_connections 2024-02-16T10:30:20.643 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/2229339000 wait complete. 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 Processor -- start 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- start start 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0394118e80 con 0x7f039412e460 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f03937fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f03937fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40520/0 (socket says 172.21.15.107:40520) 2024-02-16T10:30:20.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f03937fe640 1 -- 172.21.15.107:0/3922307158 learned_addr learned my addr 172.21.15.107:0/3922307158 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f03937fe640 1 -- 172.21.15.107:0/3922307158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0094d0 con 0x7f039412e460 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f03937fe640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f038400c400 tx=0x7f038400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03840054d0 con 0x7f039412e460 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384003600 con 0x7f039412e460 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0394119e40 con 0x7f039412e460 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0384003960 con 0x7f039412e460 2024-02-16T10:30:20.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0394133010 con 0x7f039412e460 2024-02-16T10:30:20.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0384003b80 con 0x7f039412e460 2024-02-16T10:30:20.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.637+0000 7f0390ff9640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 0x7f0374037e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.641+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f038404ce20 con 0x7f039412e460 2024-02-16T10:30:20.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.641+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394133790 con 0x7f039412e460 2024-02-16T10:30:20.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.641+0000 7f038affd640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 0x7f0374037e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.641+0000 7f038affd640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 0x7f0374037e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ae000 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.645+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0384017070 con 0x7f039412e460 2024-02-16T10:30:20.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.669+0000 7f7bc4d55640 1 Processor -- start 2024-02-16T10:30:20.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.669+0000 7f7bc4d55640 1 -- start start 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7bc012e840 0x7f7bc006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00700c0 con 0x7f7bc012e460 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc0070730 con 0x7f7bc012e840 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbe59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7bc012e460 0x7f7bc006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52336/0 (socket says 172.21.15.107:52336) 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbe59c640 1 -- 172.21.15.107:0/3321076835 learned_addr learned my addr 172.21.15.107:0/3321076835 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbdd9b640 1 --2- 172.21.15.107:0/3321076835 >> v2:172.21.15.107:3300/0 conn(0x7f7bc012e840 0x7f7bc006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbd59a640 1 -- 172.21.15.107:0/3321076835 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665866238 0 0) 0x7f7bc00700c0 con 0x7f7bc012e460 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbd59a640 1 -- 172.21.15.107:0/3321076835 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba8003530 con 0x7f7bc012e460 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbdd9b640 1 -- 172.21.15.107:0/3321076835 >> v1:172.21.15.107:6789/0 conn(0x7f7bc012e460 legacy=0x7f7bc006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbdd9b640 1 -- 172.21.15.107:0/3321076835 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0070fd0 con 0x7f7bc012e840 2024-02-16T10:30:20.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbdd9b640 1 --2- 172.21.15.107:0/3321076835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e840 0x7f7bc006e550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009740 tx=0x7f7bb401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8632818422e2515a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbd59a640 1 -- 172.21.15.107:0/3321076835 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb40ab530 con 0x7f7bc012e840 2024-02-16T10:30:20.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbd59a640 1 -- 172.21.15.107:0/3321076835 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb40a7050 con 0x7f7bc012e840 2024-02-16T10:30:20.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bbd59a640 1 -- 172.21.15.107:0/3321076835 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb40ab7c0 con 0x7f7bc012e840 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- 172.21.15.107:0/3321076835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e840 msgr2=0x7f7bc006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/3321076835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e840 0x7f7bc006e550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009740 tx=0x7f7bb401c360 comp rx=0 tx=0).stop 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- 172.21.15.107:0/3321076835 shutdown_connections 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/3321076835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e840 0x7f7bc006e550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- 172.21.15.107:0/3321076835 >> 172.21.15.107:0/3321076835 conn(0x7f7bc009dd80 msgr2=0x7f7bc006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- 172.21.15.107:0/3321076835 shutdown_connections 2024-02-16T10:30:20.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.673+0000 7f7bc4d55640 1 -- 172.21.15.107:0/3321076835 wait complete. 2024-02-16T10:30:20.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 Processor -- start 2024-02-16T10:30:20.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 -- start start 2024-02-16T10:30:20.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc011ec90 con 0x7f7bc012e460 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40534/0 (socket says 172.21.15.107:40534) 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbe59c640 1 -- 172.21.15.107:0/1311159827 learned_addr learned my addr 172.21.15.107:0/1311159827 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbe59c640 1 -- 172.21.15.107:0/1311159827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4009420 con 0x7f7bc012e460 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbe59c640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c450 tx=0x7f7bb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb0005c20 con 0x7f7bc012e460 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0005d80 con 0x7f7bc012e460 2024-02-16T10:30:20.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc012d620 con 0x7f7bc012e460 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb00071a0 con 0x7f7bc012e460 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc011e4d0 con 0x7f7bc012e460 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7bb00073c0 con 0x7f7bc012e460 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 0x7f7ba0037eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f7bb0049470 con 0x7f7bc012e460 2024-02-16T10:30:20.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bbdd9b640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 0x7f7ba0037eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.677+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc011fd70 con 0x7f7bc012e460 2024-02-16T10:30:20.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.681+0000 7f7bbdd9b640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 0x7f7ba0037eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ad000 tx=0x7f7bb40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.681+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7bb0017030 con 0x7f7bc012e460 2024-02-16T10:30:20.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58ebc6640 1 Processor -- start 2024-02-16T10:30:20.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58ebc6640 1 -- start start 2024-02-16T10:30:20.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58ebc6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff588098a30 0x7ff588098e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58ebc6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58809afd0 con 0x7ff588099350 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58ebc6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58809ac30 con 0x7ff588098a30 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58c962640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff588098a30 0x7ff588098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff587fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff588099350 0x7ff588128b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52338/0 (socket says 172.21.15.107:52338) 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff587fff640 1 -- 172.21.15.107:0/620999877 learned_addr learned my addr 172.21.15.107:0/620999877 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58c962640 1 -- 172.21.15.107:0/620999877 >> v1:172.21.15.107:6789/0 conn(0x7ff588099350 legacy=0x7ff588128b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.701+0000 7ff58c962640 1 -- 172.21.15.107:0/620999877 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58809b780 con 0x7ff588098a30 2024-02-16T10:30:20.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 --2- 172.21.15.107:0/620999877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588098a30 0x7ff588098e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009740 tx=0x7ff57c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3e019b62c2d0fd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5877fe640 1 -- 172.21.15.107:0/620999877 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0ab530 con 0x7ff588098a30 2024-02-16T10:30:20.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5877fe640 1 -- 172.21.15.107:0/620999877 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0a7050 con 0x7ff588098a30 2024-02-16T10:30:20.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5877fe640 1 -- 172.21.15.107:0/620999877 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0ab7e0 con 0x7ff588098a30 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/620999877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588098a30 msgr2=0x7ff588098e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/620999877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588098a30 0x7ff588098e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009740 tx=0x7ff57c01c370 comp rx=0 tx=0).stop 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/620999877 shutdown_connections 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/620999877 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588098a30 0x7ff588098e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/620999877 >> 172.21.15.107:0/620999877 conn(0x7ff58809c2f0 msgr2=0x7ff588071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/620999877 shutdown_connections 2024-02-16T10:30:20.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/620999877 wait complete. 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 Processor -- start 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- start start 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58811abf0 con 0x7ff588099350 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40556/0 (socket says 172.21.15.107:40556) 2024-02-16T10:30:20.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 -- 172.21.15.107:0/1261878109 learned_addr learned my addr 172.21.15.107:0/1261878109 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:20.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 -- 172.21.15.107:0/1261878109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c009420 con 0x7ff588099350 2024-02-16T10:30:20.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58c962640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009740 tx=0x7ff57c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0b7580 con 0x7ff588099350 2024-02-16T10:30:20.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0b76e0 con 0x7ff588099350 2024-02-16T10:30:20.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58811a7f0 con 0x7ff588099350 2024-02-16T10:30:20.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.705+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c0b79a0 con 0x7ff588099350 2024-02-16T10:30:20.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff588119fc0 con 0x7ff588099350 2024-02-16T10:30:20.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff57c0b7b00 con 0x7ff588099350 2024-02-16T10:30:20.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff5857fa640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 0x7ff56c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:20.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff57c0e2880 con 0x7ff588099350 2024-02-16T10:30:20.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff588062980 con 0x7ff588099350 2024-02-16T10:30:20.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff587fff640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 0x7ff56c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:20.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.709+0000 7ff587fff640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 0x7ff56c037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff574005890 tx=0x7ff574007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:20.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.717+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff57c0bb020 con 0x7ff588099350 2024-02-16T10:30:20.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0394062980 con 0x7f039412e460 2024-02-16T10:30:20.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0390ff9640 1 -- 172.21.15.107:0/3922307158 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f038400e280 con 0x7f039412e460 2024-02-16T10:30:20.811 INFO:teuthology.orchestra.run.smithi107.stdout:38654705670 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 msgr2=0x7f0374037e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 0x7f0374037e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ae000 tx=0x7f037c008040 comp rx=0 tx=0).stop 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 msgr2=0x7f0394116cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f038400c400 tx=0x7f038400c8c0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 shutdown_connections 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f03740359a0 0x7f0374037e60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 --2- 172.21.15.107:0/3922307158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f039412e460 0x7f0394116cb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 >> 172.21.15.107:0/3922307158 conn(0x7f039409dd80 msgr2=0x7f039409e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 shutdown_connections 2024-02-16T10:30:20.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.805+0000 7f0399cf1640 1 -- 172.21.15.107:0/3922307158 wait complete. 2024-02-16T10:30:20.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-02-16T10:30:20.828 DEBUG:teuthology.parallel:result is None 2024-02-16T10:30:20.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7bc011f530 con 0x7f7bc012e460 2024-02-16T10:30:20.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7baeffd640 1 -- 172.21.15.107:0/1311159827 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7bb0034090 con 0x7f7bc012e460 2024-02-16T10:30:20.847 INFO:teuthology.orchestra.run.smithi107.stdout:38654705668 2024-02-16T10:30:20.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 msgr2=0x7f7ba0037eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 0x7f7ba0037eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ad000 tx=0x7f7bb40a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 msgr2=0x7f7bc012c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c450 tx=0x7f7bb000c910 comp rx=0 tx=0).stop 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 shutdown_connections 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ba00359f0 0x7f7ba0037eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 --2- 172.21.15.107:0/1311159827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc012e460 0x7f7bc012c7e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 >> 172.21.15.107:0/1311159827 conn(0x7f7bc009dd80 msgr2=0x7f7bc01320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 shutdown_connections 2024-02-16T10:30:20.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.841+0000 7f7bc4d55640 1 -- 172.21.15.107:0/1311159827 wait complete. 2024-02-16T10:30:20.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2024-02-16T10:30:20.865 DEBUG:teuthology.parallel:result is None 2024-02-16T10:30:20.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.877+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b24133770 con 0x7f4b2406c440 2024-02-16T10:30:20.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b0bfff640 1 -- 172.21.15.107:0/634911047 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b140b1020 con 0x7f4b2406c440 2024-02-16T10:30:20.886 INFO:teuthology.orchestra.run.smithi107.stdout:38654705670 2024-02-16T10:30:20.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 msgr2=0x7f4b10037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b18001610 tx=0x7f4b18007ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 msgr2=0x7f4b2412b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4b1401aa20 tx=0x7f4b1401abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 shutdown_connections 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 --2- 172.21.15.107:0/634911047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2406c440 0x7f4b2412b7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 >> 172.21.15.107:0/634911047 conn(0x7f4b24099ce0 msgr2=0x7f4b241300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 shutdown_connections 2024-02-16T10:30:20.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.881+0000 7f4b29ab7640 1 -- 172.21.15.107:0/634911047 wait complete. 2024-02-16T10:30:20.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-02-16T10:30:20.903 DEBUG:teuthology.parallel:result is None 2024-02-16T10:30:20.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5880671f0 con 0x7ff588099350 2024-02-16T10:30:20.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff5857fa640 1 -- 172.21.15.107:0/1261878109 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff57c0b0070 con 0x7ff588099350 2024-02-16T10:30:20.944 INFO:teuthology.orchestra.run.smithi107.stdout:38654705669 2024-02-16T10:30:20.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 msgr2=0x7ff56c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 0x7ff56c037ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff574005890 tx=0x7ff574007a90 comp rx=0 tx=0).stop 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 msgr2=0x7ff58806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009740 tx=0x7ff57c01abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 shutdown_connections 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff56c035a10 0x7ff56c037ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 --2- 172.21.15.107:0/1261878109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff588099350 0x7ff58806d580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 >> 172.21.15.107:0/1261878109 conn(0x7ff58809c2f0 msgr2=0x7ff588127670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 shutdown_connections 2024-02-16T10:30:20.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:20.937+0000 7ff58ebc6640 1 -- 172.21.15.107:0/1261878109 wait complete. 2024-02-16T10:30:20.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-02-16T10:30:20.960 DEBUG:teuthology.parallel:result is None 2024-02-16T10:30:20.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T10:30:20.960 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:30:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.105+0000 7f769d534640 1 Processor -- start 2024-02-16T10:30:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.105+0000 7f769d534640 1 -- start start 2024-02-16T10:30:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f769d534640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f769812e750 0x7f769806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f769d534640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769809e070 con 0x7f769812e370 2024-02-16T10:30:21.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f769d534640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7698125110 con 0x7f769812e750 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f76967fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f769812e750 0x7f769806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7696ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f769812e370 0x7f769806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52350/0 (socket says 172.21.15.107:52350) 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7696ffd640 1 -- 172.21.15.107:0/2023984353 learned_addr learned my addr 172.21.15.107:0/2023984353 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f76967fc640 1 -- 172.21.15.107:0/2023984353 >> v1:172.21.15.107:6789/0 conn(0x7f769812e370 legacy=0x7f769806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7695ffb640 1 -- 172.21.15.107:0/2023984353 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132613964 0 0) 0x7f769809e070 con 0x7f769812e370 2024-02-16T10:30:21.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f76967fc640 1 -- 172.21.15.107:0/2023984353 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769812df40 con 0x7f769812e750 2024-02-16T10:30:21.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f76967fc640 1 --2- 172.21.15.107:0/2023984353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e750 0x7f769806dc60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7688009740 tx=0x7f768801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a31828be81fca2d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7695ffb640 1 -- 172.21.15.107:0/2023984353 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76880ab530 con 0x7f769812e750 2024-02-16T10:30:21.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7695ffb640 1 -- 172.21.15.107:0/2023984353 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76880a7050 con 0x7f769812e750 2024-02-16T10:30:21.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.109+0000 7f7695ffb640 1 -- 172.21.15.107:0/2023984353 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76880ab7e0 con 0x7f769812e750 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/2023984353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e750 msgr2=0x7f769806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 --2- 172.21.15.107:0/2023984353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e750 0x7f769806dc60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7688009740 tx=0x7f768801c370 comp rx=0 tx=0).stop 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/2023984353 shutdown_connections 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 --2- 172.21.15.107:0/2023984353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e750 0x7f769806dc60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/2023984353 >> 172.21.15.107:0/2023984353 conn(0x7f769809c460 msgr2=0x7f7698071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/2023984353 shutdown_connections 2024-02-16T10:30:21.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/2023984353 wait complete. 2024-02-16T10:30:21.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 Processor -- start 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- start start 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698071200 con 0x7f769812e370 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f7696ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f7696ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40566/0 (socket says 172.21.15.107:40566) 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f7696ffd640 1 -- 172.21.15.107:0/3409766723 learned_addr learned my addr 172.21.15.107:0/3409766723 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:21.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f7696ffd640 1 -- 172.21.15.107:0/3409766723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688009420 con 0x7f769812e370 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f7696ffd640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c420 tx=0x7f768c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f768c0074d0 con 0x7f769812e370 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c007630 con 0x7f769812e370 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7698099d20 con 0x7f769812e370 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f768c004960 con 0x7f769812e370 2024-02-16T10:30:21.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7698127b60 con 0x7f769812e370 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76980992f0 con 0x7f769812e370 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f768c004ac0 con 0x7f769812e370 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 0x7f7684037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.113+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f768c0472a0 con 0x7f769812e370 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.117+0000 7f76967fc640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 0x7f7684037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.117+0000 7f76967fc640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 0x7f7684037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76880ad000 tx=0x7f7688008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.121+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f768c01ad70 con 0x7f769812e370 2024-02-16T10:30:21.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.265+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7698062980 con 0x7f7684035a10 2024-02-16T10:30:21.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f767f7fe640 1 -- 172.21.15.107:0/3409766723 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34672 (secure 0 0 0) 0x7f7698062980 con 0x7f7684035a10 2024-02-16T10:30:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:21.276 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:30:21.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 msgr2=0x7f7684037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 0x7f7684037ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76880ad000 tx=0x7f7688008040 comp rx=0 tx=0).stop 2024-02-16T10:30:21.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 msgr2=0x7f76981260b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c420 tx=0x7f768c00c8e0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 shutdown_connections 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7684035a10 0x7f7684037ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 --2- 172.21.15.107:0/3409766723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f769812e370 0x7f76981260b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 >> 172.21.15.107:0/3409766723 conn(0x7f769809c460 msgr2=0x7f7698122520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 shutdown_connections 2024-02-16T10:30:21.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.269+0000 7f769d534640 1 -- 172.21.15.107:0/3409766723 wait complete. 2024-02-16T10:30:21.292 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-16T10:30:19.810881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109748,"kb_used_data":1664,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377612,"statfs":{"total":386547056640,"available":386434674688,"internally_reserved":0,"allocated":1703936,"data_stored":1336536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.819034"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093960+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:30:19.093960+0000","last_peered":"2024-02-16T10:30:19.093960+0000","last_clean":"2024-02-16T10:30:19.093960+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:30:19.093960+0000","last_undegraded":"2024-02-16T10:30:19.093960+0000","last_fullsized":"2024-02-16T10:30:19.093960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.001650+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:30:19.001650+0000","last_peered":"2024-02-16T10:30:19.001650+0000","last_clean":"2024-02-16T10:30:19.001650+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:30:19.001650+0000","last_undegraded":"2024-02-16T10:30:19.001650+0000","last_fullsized":"2024-02-16T10:30:19.001650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094325+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:30:19.094325+0000","last_peered":"2024-02-16T10:30:19.094325+0000","last_clean":"2024-02-16T10:30:19.094325+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:30:19.094325+0000","last_undegraded":"2024-02-16T10:30:19.094325+0000","last_fullsized":"2024-02-16T10:30:19.094325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.001471+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:30:19.001471+0000","last_peered":"2024-02-16T10:30:19.001471+0000","last_clean":"2024-02-16T10:30:19.001471+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:30:19.001471+0000","last_undegraded":"2024-02-16T10:30:19.001471+0000","last_fullsized":"2024-02-16T10:30:19.001471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093906+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:30:19.093906+0000","last_peered":"2024-02-16T10:30:19.093906+0000","last_clean":"2024-02-16T10:30:19.093906+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:30:19.093906+0000","last_undegraded":"2024-02-16T10:30:19.093906+0000","last_fullsized":"2024-02-16T10:30:19.093906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094525+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:30:19.094525+0000","last_peered":"2024-02-16T10:30:19.094525+0000","last_clean":"2024-02-16T10:30:19.094525+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:30:19.094525+0000","last_undegraded":"2024-02-16T10:30:19.094525+0000","last_fullsized":"2024-02-16T10:30:19.094525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093831+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:30:19.093831+0000","last_peered":"2024-02-16T10:30:19.093831+0000","last_clean":"2024-02-16T10:30:19.093831+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:30:19.093831+0000","last_undegraded":"2024-02-16T10:30:19.093831+0000","last_fullsized":"2024-02-16T10:30:19.093831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093914+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:30:19.093914+0000","last_peered":"2024-02-16T10:30:19.093914+0000","last_clean":"2024-02-16T10:30:19.093914+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:30:19.093914+0000","last_undegraded":"2024-02-16T10:30:19.093914+0000","last_fullsized":"2024-02-16T10:30:19.093914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094350+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:30:19.094350+0000","last_peered":"2024-02-16T10:30:19.094350+0000","last_clean":"2024-02-16T10:30:19.094350+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:30:19.094350+0000","last_undegraded":"2024-02-16T10:30:19.094350+0000","last_fullsized":"2024-02-16T10:30:19.094350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":626285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:30:21.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:30:21.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f3004fb8640 1 Processor -- start 2024-02-16T10:30:21.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f3004fb8640 1 -- start start 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f3004fb8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f300012e460 0x7f300012e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f3004fb8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300012ed80 con 0x7f300006de40 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f3004fb8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3000070730 con 0x7f300012e460 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f2ffe59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f300012e460 0x7f300012e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f2ffdd9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f300006de40 0x7f300006e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52362/0 (socket says 172.21.15.107:52362) 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.393+0000 7f2ffdd9b640 1 -- 172.21.15.107:0/1962159504 learned_addr learned my addr 172.21.15.107:0/1962159504 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffe59c640 1 -- 172.21.15.107:0/1962159504 >> v1:172.21.15.107:6789/0 conn(0x7f300006de40 legacy=0x7f300006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffe59c640 1 -- 172.21.15.107:0/1962159504 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000700c0 con 0x7f300012e460 2024-02-16T10:30:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffe59c640 1 --2- 172.21.15.107:0/1962159504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300012e460 0x7f300012e840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009740 tx=0x7f2ff001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3163297104df839f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffd59a640 1 -- 172.21.15.107:0/1962159504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ff00ab530 con 0x7f300012e460 2024-02-16T10:30:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffd59a640 1 -- 172.21.15.107:0/1962159504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00a7050 con 0x7f300012e460 2024-02-16T10:30:21.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f2ffd59a640 1 -- 172.21.15.107:0/1962159504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ff00ab7e0 con 0x7f300012e460 2024-02-16T10:30:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- 172.21.15.107:0/1962159504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300012e460 msgr2=0x7f300012e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1962159504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300012e460 0x7f300012e840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009740 tx=0x7f2ff001c370 comp rx=0 tx=0).stop 2024-02-16T10:30:21.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- 172.21.15.107:0/1962159504 shutdown_connections 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1962159504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300012e460 0x7f300012e840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- 172.21.15.107:0/1962159504 >> 172.21.15.107:0/1962159504 conn(0x7f300009dd80 msgr2=0x7f300006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- 172.21.15.107:0/1962159504 shutdown_connections 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- 172.21.15.107:0/1962159504 wait complete. 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 Processor -- start 2024-02-16T10:30:21.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- start start 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.397+0000 7f3004fb8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000120420 con 0x7f300006de40 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40588/0 (socket says 172.21.15.107:40588) 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffe59c640 1 -- 172.21.15.107:0/1421448143 learned_addr learned my addr 172.21.15.107:0/1421448143 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffe59c640 1 -- 172.21.15.107:0/1421448143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009420 con 0x7f300006de40 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffe59c640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0018f80 tx=0x7f2ff001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ff00b7580 con 0x7f300006de40 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff00b7700 con 0x7f300006de40 2024-02-16T10:30:21.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300011ebb0 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ff00b79e0 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300011f7d0 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2ff00b7b40 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 0x7f2fe0037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300011fa80 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f2ff00e2370 con 0x7f300006de40 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffdd9b640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 0x7f2fe0037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.401+0000 7f2ffdd9b640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 0x7f2fe0037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001610 tx=0x7f2ff4007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.405+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ff00b5400 con 0x7f300006de40 2024-02-16T10:30:21.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.549+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3000071b20 con 0x7f2fe0035a10 2024-02-16T10:30:21.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.549+0000 7f2feeffd640 1 -- 172.21.15.107:0/1421448143 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34672 (secure 0 0 0) 0x7f2ff4001300 con 0x7f2fe0035a10 2024-02-16T10:30:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:21.559 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:30:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 msgr2=0x7f2fe0037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 0x7f2fe0037ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4001610 tx=0x7f2ff4007ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 msgr2=0x7f300012cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0018f80 tx=0x7f2ff001abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 shutdown_connections 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0035a10 0x7f2fe0037ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 --2- 172.21.15.107:0/1421448143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f300006de40 0x7f300012cbb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 >> 172.21.15.107:0/1421448143 conn(0x7f300009dd80 msgr2=0x7f300012f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 shutdown_connections 2024-02-16T10:30:21.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.553+0000 7f3004fb8640 1 -- 172.21.15.107:0/1421448143 wait complete. 2024-02-16T10:30:21.575 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-02-16T10:30:19.810881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109748,"kb_used_data":1664,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377612,"statfs":{"total":386547056640,"available":386434674688,"internally_reserved":0,"allocated":1703936,"data_stored":1336536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.819034"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093960+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:30:19.093960+0000","last_peered":"2024-02-16T10:30:19.093960+0000","last_clean":"2024-02-16T10:30:19.093960+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:30:19.093960+0000","last_undegraded":"2024-02-16T10:30:19.093960+0000","last_fullsized":"2024-02-16T10:30:19.093960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.001650+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:30:19.001650+0000","last_peered":"2024-02-16T10:30:19.001650+0000","last_clean":"2024-02-16T10:30:19.001650+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:30:19.001650+0000","last_undegraded":"2024-02-16T10:30:19.001650+0000","last_fullsized":"2024-02-16T10:30:19.001650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094325+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:30:19.094325+0000","last_peered":"2024-02-16T10:30:19.094325+0000","last_clean":"2024-02-16T10:30:19.094325+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:30:19.094325+0000","last_undegraded":"2024-02-16T10:30:19.094325+0000","last_fullsized":"2024-02-16T10:30:19.094325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.001471+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:30:19.001471+0000","last_peered":"2024-02-16T10:30:19.001471+0000","last_clean":"2024-02-16T10:30:19.001471+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:30:19.001471+0000","last_undegraded":"2024-02-16T10:30:19.001471+0000","last_fullsized":"2024-02-16T10:30:19.001471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093906+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:30:19.093906+0000","last_peered":"2024-02-16T10:30:19.093906+0000","last_clean":"2024-02-16T10:30:19.093906+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:30:19.093906+0000","last_undegraded":"2024-02-16T10:30:19.093906+0000","last_fullsized":"2024-02-16T10:30:19.093906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094525+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:30:19.094525+0000","last_peered":"2024-02-16T10:30:19.094525+0000","last_clean":"2024-02-16T10:30:19.094525+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:30:19.094525+0000","last_undegraded":"2024-02-16T10:30:19.094525+0000","last_fullsized":"2024-02-16T10:30:19.094525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093831+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:30:19.093831+0000","last_peered":"2024-02-16T10:30:19.093831+0000","last_clean":"2024-02-16T10:30:19.093831+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:30:19.093831+0000","last_undegraded":"2024-02-16T10:30:19.093831+0000","last_fullsized":"2024-02-16T10:30:19.093831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.093914+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:30:19.093914+0000","last_peered":"2024-02-16T10:30:19.093914+0000","last_clean":"2024-02-16T10:30:19.093914+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:30:19.093914+0000","last_undegraded":"2024-02-16T10:30:19.093914+0000","last_fullsized":"2024-02-16T10:30:19.093914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-16T10:30:19.094350+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:30:19.094350+0000","last_peered":"2024-02-16T10:30:19.094350+0000","last_clean":"2024-02-16T10:30:19.094350+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:30:19.094350+0000","last_undegraded":"2024-02-16T10:30:19.094350+0000","last_fullsized":"2024-02-16T10:30:19.094350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":626285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:30:21.576 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T10:30:21.576 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-16T10:30:21.576 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-16T10:30:21.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-16T10:30:21.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2cc7c3640 1 Processor -- start 2024-02-16T10:30:21.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2cc7c3640 1 -- start start 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2cc7c3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa2c412e840 0x7fa2c406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2cc7c3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c40700c0 con 0x7fa2c412e460 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2cc7c3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c4070730 con 0x7fa2c412e840 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2c9d5e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa2c412e840 0x7fa2c406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2ca55f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa2c412e460 0x7fa2c406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52378/0 (socket says 172.21.15.107:52378) 2024-02-16T10:30:21.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2ca55f640 1 -- 172.21.15.107:0/1225975476 learned_addr learned my addr 172.21.15.107:0/1225975476 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:30:21.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2c9d5e640 1 -- 172.21.15.107:0/1225975476 >> v1:172.21.15.107:6789/0 conn(0x7fa2c412e460 legacy=0x7fa2c406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.673+0000 7fa2c9d5e640 1 -- 172.21.15.107:0/1225975476 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4070fd0 con 0x7fa2c412e840 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2c9d5e640 1 --2- 172.21.15.107:0/1225975476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e840 0x7fa2c406e550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009740 tx=0x7fa2b401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee9c5abcfbbf225 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2c955d640 1 -- 172.21.15.107:0/1225975476 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2b40ab530 con 0x7fa2c412e840 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2c955d640 1 -- 172.21.15.107:0/1225975476 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b40a7050 con 0x7fa2c412e840 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2c955d640 1 -- 172.21.15.107:0/1225975476 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2b40ab7e0 con 0x7fa2c412e840 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/1225975476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e840 msgr2=0x7fa2c406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/1225975476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e840 0x7fa2c406e550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009740 tx=0x7fa2b401c340 comp rx=0 tx=0).stop 2024-02-16T10:30:21.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/1225975476 shutdown_connections 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/1225975476 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e840 0x7fa2c406e550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/1225975476 >> 172.21.15.107:0/1225975476 conn(0x7fa2c409dd80 msgr2=0x7fa2c406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/1225975476 shutdown_connections 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/1225975476 wait complete. 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 Processor -- start 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- start start 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c411fa00 con 0x7fa2c412e460 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2ca55f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2ca55f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40600/0 (socket says 172.21.15.107:40600) 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2ca55f640 1 -- 172.21.15.107:0/75115940 learned_addr learned my addr 172.21.15.107:0/75115940 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2ca55f640 1 -- 172.21.15.107:0/75115940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b4009420 con 0x7fa2c412e460 2024-02-16T10:30:21.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2ca55f640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000c480 tx=0x7fa2c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c0005c20 con 0x7fa2c412e460 2024-02-16T10:30:21.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c0005d80 con 0x7fa2c412e460 2024-02-16T10:30:21.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c411f720 con 0x7fa2c412e460 2024-02-16T10:30:21.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c00071a0 con 0x7fa2c412e460 2024-02-16T10:30:21.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.677+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c411ea90 con 0x7fa2c412e460 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c411fb40 con 0x7fa2c412e460 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa2c0007300 con 0x7fa2c412e460 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2baffd640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 0x7fa2a8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa2c0047250 con 0x7fa2c412e460 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2c9d5e640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 0x7fa2a8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:21.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.681+0000 7fa2c9d5e640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 0x7fa2a8037ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40ad000 tx=0x7fa2b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:21.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.685+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2c411fb40 con 0x7fa2c412e460 2024-02-16T10:30:21.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.861+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa2c411fb40 con 0x7fa2c412e460 2024-02-16T10:30:21.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.861+0000 7fa2baffd640 1 -- 172.21.15.107:0/75115940 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa2c411fb40 con 0x7fa2c412e460 2024-02-16T10:30:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:30:21.869 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-16T10:30:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 msgr2=0x7fa2a8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 0x7fa2a8037ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40ad000 tx=0x7fa2b4008040 comp rx=0 tx=0).stop 2024-02-16T10:30:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 msgr2=0x7fa2c412ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000c480 tx=0x7fa2c000c940 comp rx=0 tx=0).stop 2024-02-16T10:30:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 shutdown_connections 2024-02-16T10:30:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa2a8035a10 0x7fa2a8037ed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 --2- 172.21.15.107:0/75115940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2c412e460 0x7fa2c412ca90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 >> 172.21.15.107:0/75115940 conn(0x7fa2c409dd80 msgr2=0x7fa2c4132250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 shutdown_connections 2024-02-16T10:30:21.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:30:21.865+0000 7fa2cc7c3640 1 -- 172.21.15.107:0/75115940 wait complete. 2024-02-16T10:30:21.886 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-16T10:30:21.886 INFO:teuthology.run_tasks:Running task rgw... 2024-02-16T10:30:21.902 DEBUG:tasks.rgw:config is {'client.0': None} 2024-02-16T10:30:21.902 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-02-16T10:30:21.902 INFO:tasks.rgw:Creating data pools 2024-02-16T10:30:21.902 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-02-16T10:30:21.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-02-16T10:30:22.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3eab5e9640 1 Processor -- start 2024-02-16T10:30:22.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3eab5e9640 1 -- start start 2024-02-16T10:30:22.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3eab5e9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ea41182b0 0x7f3ea411a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:22.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3eab5e9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea411abe0 con 0x7f3ea410dfe0 2024-02-16T10:30:22.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3eab5e9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea411bd80 con 0x7f3ea41182b0 2024-02-16T10:30:22.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3ea8b84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ea41182b0 0x7f3ea411a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:22.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3ea8b84640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3ea41182b0 0x7f3ea411a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45932/0 (socket says 172.21.15.138:45932) 2024-02-16T10:30:22.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3ea8b84640 1 -- 172.21.15.138:0/1053940547 learned_addr learned my addr 172.21.15.138:0/1053940547 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:22.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3ea8b84640 1 -- 172.21.15.138:0/1053940547 >> v1:172.21.15.107:6789/0 conn(0x7f3ea410dfe0 legacy=0x7f3ea410e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:22.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.028+0000 7f3ea8b84640 1 -- 172.21.15.138:0/1053940547 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea411bec0 con 0x7f3ea41182b0 2024-02-16T10:30:22.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3ea8b84640 1 --2- 172.21.15.138:0/1053940547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea41182b0 0x7f3ea411a6a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3e980097f0 tx=0x7f3e9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4769ad10381c8679 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:22.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3e97fff640 1 -- 172.21.15.138:0/1053940547 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e980ab580 con 0x7f3ea41182b0 2024-02-16T10:30:22.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3e97fff640 1 -- 172.21.15.138:0/1053940547 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e980ab6e0 con 0x7f3ea41182b0 2024-02-16T10:30:22.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3e97fff640 1 -- 172.21.15.138:0/1053940547 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e980ab9a0 con 0x7f3ea41182b0 2024-02-16T10:30:22.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- 172.21.15.138:0/1053940547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea41182b0 msgr2=0x7f3ea411a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/1053940547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea41182b0 0x7f3ea411a6a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3e980097f0 tx=0x7f3e9801c430 comp rx=0 tx=0).stop 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- 172.21.15.138:0/1053940547 shutdown_connections 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/1053940547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea41182b0 0x7f3ea411a6a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- 172.21.15.138:0/1053940547 >> 172.21.15.138:0/1053940547 conn(0x7f3ea406e940 msgr2=0x7f3ea4070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- 172.21.15.138:0/1053940547 shutdown_connections 2024-02-16T10:30:22.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- 172.21.15.138:0/1053940547 wait complete. 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 Processor -- start 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- start start 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3eab5e9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea41ac800 con 0x7f3ea410dfe0 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3ea9385640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3ea9385640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45946/0 (socket says 172.21.15.138:45946) 2024-02-16T10:30:22.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.032+0000 7f3ea9385640 1 -- 172.21.15.138:0/4064090976 learned_addr learned my addr 172.21.15.138:0/4064090976 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:22.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3ea9385640 1 -- 172.21.15.138:0/4064090976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980094d0 con 0x7f3ea410dfe0 2024-02-16T10:30:22.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3ea9385640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000c450 tx=0x7f3ea000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:22.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea0005150 con 0x7f3ea410dfe0 2024-02-16T10:30:22.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea41aca00 con 0x7f3ea410dfe0 2024-02-16T10:30:22.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea00052b0 con 0x7f3ea410dfe0 2024-02-16T10:30:22.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ea0007030 con 0x7f3ea410dfe0 2024-02-16T10:30:22.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea41a6320 con 0x7f3ea410dfe0 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4062980 con 0x7f3ea410dfe0 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3ea0028b70 con 0x7f3ea410dfe0 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 0x7f3e88037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f3ea0047370 con 0x7f3ea410dfe0 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3ea8b84640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 0x7f3e88037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:22.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.036+0000 7f3ea8b84640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 0x7f3e88037ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e980af000 tx=0x7f3e98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:22.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.048+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ea00067e0 con 0x7f3ea410dfe0 2024-02-16T10:30:22.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:22.212+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) v1 -- 0x7f3ea41182b0 con 0x7f3ea410dfe0 2024-02-16T10:30:23.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.004+0000 7f3e95ffb640 1 -- 172.21.15.138:0/4064090976 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v17) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3ea002d0f0 con 0x7f3ea410dfe0 2024-02-16T10:30:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 msgr2=0x7f3e88037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 0x7f3e88037ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e980af000 tx=0x7f3e98008040 comp rx=0 tx=0).stop 2024-02-16T10:30:23.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 msgr2=0x7f3ea41ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000c450 tx=0x7f3ea000c910 comp rx=0 tx=0).stop 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 shutdown_connections 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3e88035a10 0x7f3e88037ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 --2- 172.21.15.138:0/4064090976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3ea410dfe0 0x7f3ea41ac230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 >> 172.21.15.138:0/4064090976 conn(0x7f3ea406e940 msgr2=0x7f3ea4115160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 shutdown_connections 2024-02-16T10:30:23.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.008+0000 7f3eab5e9640 1 -- 172.21.15.138:0/4064090976 wait complete. 2024-02-16T10:30:23.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-02-16T10:30:23.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.156+0000 7f898a9a9640 1 Processor -- start 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.156+0000 7f898a9a9640 1 -- start start 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.156+0000 7f898a9a9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8984116850 0x7f8984118c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.156+0000 7f898a9a9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8984119180 con 0x7f8984113b50 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.156+0000 7f898a9a9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898411a340 con 0x7f8984116850 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8984116850 0x7f8984118c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8984116850 0x7f8984118c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45954/0 (socket says 172.21.15.138:45954) 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 -- 172.21.15.138:0/1493790496 learned_addr learned my addr 172.21.15.138:0/1493790496 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:23.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 -- 172.21.15.138:0/1493790496 >> v1:172.21.15.107:6789/0 conn(0x7f8984113b50 legacy=0x7f8984113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:23.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 -- 172.21.15.138:0/1493790496 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984072a90 con 0x7f8984116850 2024-02-16T10:30:23.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f89837fe640 1 --2- 172.21.15.138:0/1493790496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984116850 0x7f8984118c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f897400ba90 tx=0x7f897401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddaeaf1678347a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:23.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f8982ffd640 1 -- 172.21.15.138:0/1493790496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89740a7b00 con 0x7f8984116850 2024-02-16T10:30:23.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f8982ffd640 1 -- 172.21.15.138:0/1493790496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89740a7c60 con 0x7f8984116850 2024-02-16T10:30:23.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.160+0000 7f8982ffd640 1 -- 172.21.15.138:0/1493790496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89740af440 con 0x7f8984116850 2024-02-16T10:30:23.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/1493790496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984116850 msgr2=0x7f8984118c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 --2- 172.21.15.138:0/1493790496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984116850 0x7f8984118c40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f897400ba90 tx=0x7f897401eae0 comp rx=0 tx=0).stop 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/1493790496 shutdown_connections 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 --2- 172.21.15.138:0/1493790496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984116850 0x7f8984118c40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/1493790496 >> 172.21.15.138:0/1493790496 conn(0x7f898406e940 msgr2=0x7f8984070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/1493790496 shutdown_connections 2024-02-16T10:30:23.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/1493790496 wait complete. 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 Processor -- start 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- start start 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841a5020 con 0x7f8984113b50 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8983fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45960/0 (socket says 172.21.15.138:45960) 2024-02-16T10:30:23.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8983fff640 1 -- 172.21.15.138:0/3672841188 learned_addr learned my addr 172.21.15.138:0/3672841188 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:23.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8983fff640 1 -- 172.21.15.138:0/3672841188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897400b770 con 0x7f8984113b50 2024-02-16T10:30:23.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8983fff640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c3b0 tx=0x7f896c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:23.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f896c005200 con 0x7f8984113b50 2024-02-16T10:30:23.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89841a5220 con 0x7f8984113b50 2024-02-16T10:30:23.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c005380 con 0x7f8984113b50 2024-02-16T10:30:23.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f896c007020 con 0x7f8984113b50 2024-02-16T10:30:23.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89841a91a0 con 0x7f8984113b50 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.164+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984062980 con 0x7f8984113b50 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.168+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f896c007180 con 0x7f8984113b50 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.168+0000 7f8980ff9640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 0x7f8964037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.168+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3797+0+0 (secure 0 0 0) 0x7f896c0477d0 con 0x7f8984113b50 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.168+0000 7f89837fe640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 0x7f8964037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:23.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.168+0000 7f89837fe640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 0x7f8964037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89740b1000 tx=0x7f89740a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:23.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.180+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f896c019c30 con 0x7f8984113b50 2024-02-16T10:30:23.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:23.336+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f8984119ec0 con 0x7f8984113b50 2024-02-16T10:30:25.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f8980ff9640 1 -- 172.21.15.138:0/3672841188 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) v1 ==== 227+0+0 (secure 0 0 0) 0x7f896c020030 con 0x7f8984113b50 2024-02-16T10:30:25.019 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.data' created 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 msgr2=0x7f8964037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 0x7f8964037e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89740b1000 tx=0x7f89740a9070 comp rx=0 tx=0).stop 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 msgr2=0x7f89841a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c3b0 tx=0x7f896c00c870 comp rx=0 tx=0).stop 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 shutdown_connections 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f89640359c0 0x7f8964037e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:25.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 --2- 172.21.15.138:0/3672841188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8984113b50 0x7f89841a4ae0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:25.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.012+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 >> 172.21.15.138:0/3672841188 conn(0x7f898406e940 msgr2=0x7f8984117110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:25.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.016+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 shutdown_connections 2024-02-16T10:30:25.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.016+0000 7f898a9a9640 1 -- 172.21.15.138:0/3672841188 wait complete. 2024-02-16T10:30:25.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-02-16T10:30:25.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd8229a640 1 Processor -- start 2024-02-16T10:30:25.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd8229a640 1 -- start start 2024-02-16T10:30:25.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd8229a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd7c1165c0 0x7efd7c1169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:25.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd8229a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c117000 con 0x7efd7c1114b0 2024-02-16T10:30:25.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd8229a640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c112050 con 0x7efd7c1165c0 2024-02-16T10:30:25.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd7bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efd7c1165c0 0x7efd7c1169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:25.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd7b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efd7c1114b0 0x7efd7c111940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:47360/0 (socket says 172.21.15.138:47360) 2024-02-16T10:30:25.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd7b7fe640 1 -- 172.21.15.138:0/3197994925 learned_addr learned my addr 172.21.15.138:0/3197994925 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:25.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd7bfff640 1 -- 172.21.15.138:0/3197994925 >> v1:172.21.15.107:6789/0 conn(0x7efd7c1114b0 legacy=0x7efd7c111940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:25.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.168+0000 7efd7bfff640 1 -- 172.21.15.138:0/3197994925 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c1121c0 con 0x7efd7c1165c0 2024-02-16T10:30:25.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd7bfff640 1 --2- 172.21.15.138:0/3197994925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1165c0 0x7efd7c1169a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009740 tx=0x7efd6c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41e2b1e00cc9d36 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:25.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd7affd640 1 -- 172.21.15.138:0/3197994925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c0a8050 con 0x7efd7c1165c0 2024-02-16T10:30:25.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd7affd640 1 -- 172.21.15.138:0/3197994925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c0ac520 con 0x7efd7c1165c0 2024-02-16T10:30:25.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd7affd640 1 -- 172.21.15.138:0/3197994925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c0ac7e0 con 0x7efd7c1165c0 2024-02-16T10:30:25.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- 172.21.15.138:0/3197994925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1165c0 msgr2=0x7efd7c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 --2- 172.21.15.138:0/3197994925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1165c0 0x7efd7c1169a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009740 tx=0x7efd6c01c370 comp rx=0 tx=0).stop 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- 172.21.15.138:0/3197994925 shutdown_connections 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 --2- 172.21.15.138:0/3197994925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1165c0 0x7efd7c1169a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- 172.21.15.138:0/3197994925 >> 172.21.15.138:0/3197994925 conn(0x7efd7c06de10 msgr2=0x7efd7c10fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- 172.21.15.138:0/3197994925 shutdown_connections 2024-02-16T10:30:25.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- 172.21.15.138:0/3197994925 wait complete. 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 Processor -- start 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.172+0000 7efd8229a640 1 -- start start 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd8229a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd8229a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c1a8f60 con 0x7efd7c1114b0 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45976/0 (socket says 172.21.15.138:45976) 2024-02-16T10:30:25.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd7bfff640 1 -- 172.21.15.138:0/844967956 learned_addr learned my addr 172.21.15.138:0/844967956 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:25.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd7bfff640 1 -- 172.21.15.138:0/844967956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c009420 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd7bfff640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01aa20 tx=0x7efd6c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c0ab8d0 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c0aba30 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c1a9160 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6c0abd10 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c1ad130 con 0x7efd7c1114b0 2024-02-16T10:30:25.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c1a9580 con 0x7efd7c1114b0 2024-02-16T10:30:25.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efd6c0b8450 con 0x7efd7c1114b0 2024-02-16T10:30:25.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 0x7efd68037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:25.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.176+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4272+0+0 (secure 0 0 0) 0x7efd6c0e3080 con 0x7efd7c1114b0 2024-02-16T10:30:25.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.180+0000 7efd7b7fe640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 0x7efd68037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:25.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.180+0000 7efd7b7fe640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 0x7efd68037ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f70 tx=0x7efd70007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:25.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.192+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd6c0c9570 con 0x7efd7c1114b0 2024-02-16T10:30:25.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:25.348+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7efd7c0629f0 con 0x7efd7c1114b0 2024-02-16T10:30:26.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.020+0000 7efd78ff9640 1 -- 172.21.15.138:0/844967956 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) v1 ==== 185+0+0 (secure 0 0 0) 0x7efd7c0629f0 con 0x7efd7c1114b0 2024-02-16T10:30:26.031 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 msgr2=0x7efd68037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 0x7efd68037ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd70000f70 tx=0x7efd70007a90 comp rx=0 tx=0).stop 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 msgr2=0x7efd7c1a8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01aa20 tx=0x7efd6c01abb0 comp rx=0 tx=0).stop 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 shutdown_connections 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efd68035a10 0x7efd68037ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:26.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 --2- 172.21.15.138:0/844967956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd7c1114b0 0x7efd7c1a8a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:26.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 >> 172.21.15.138:0/844967956 conn(0x7efd7c06de10 msgr2=0x7efd7c11c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:26.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 shutdown_connections 2024-02-16T10:30:26.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.024+0000 7efd8229a640 1 -- 172.21.15.138:0/844967956 wait complete. 2024-02-16T10:30:26.077 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-02-16T10:30:26.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9eaa9da640 1 Processor -- start 2024-02-16T10:30:26.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9eaa9da640 1 -- start start 2024-02-16T10:30:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9eaa9da640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ea4118260 0x7f9ea411a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9eaa9da640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea411ab90 con 0x7f9ea410dfe0 2024-02-16T10:30:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9eaa9da640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea411bd30 con 0x7f9ea4118260 2024-02-16T10:30:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9ea37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ea4118260 0x7f9ea411a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:26.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9ea37fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ea4118260 0x7f9ea411a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45984/0 (socket says 172.21.15.138:45984) 2024-02-16T10:30:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9ea37fe640 1 -- 172.21.15.138:0/4196001163 learned_addr learned my addr 172.21.15.138:0/4196001163 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9ea37fe640 1 -- 172.21.15.138:0/4196001163 >> v1:172.21.15.107:6789/0 conn(0x7f9ea410dfe0 legacy=0x7f9ea410e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:26.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.200+0000 7f9ea37fe640 1 -- 172.21.15.138:0/4196001163 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea411be70 con 0x7f9ea4118260 2024-02-16T10:30:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea37fe640 1 --2- 172.21.15.138:0/4196001163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea4118260 0x7f9ea411a650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097f0 tx=0x7f9e9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33d2b747cede1cf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea2ffd640 1 -- 172.21.15.138:0/4196001163 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e980ab580 con 0x7f9ea4118260 2024-02-16T10:30:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea2ffd640 1 -- 172.21.15.138:0/4196001163 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e980ab6e0 con 0x7f9ea4118260 2024-02-16T10:30:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea2ffd640 1 -- 172.21.15.138:0/4196001163 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e980ab9a0 con 0x7f9ea4118260 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- 172.21.15.138:0/4196001163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea4118260 msgr2=0x7f9ea411a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/4196001163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea4118260 0x7f9ea411a650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097f0 tx=0x7f9e9801c430 comp rx=0 tx=0).stop 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- 172.21.15.138:0/4196001163 shutdown_connections 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/4196001163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea4118260 0x7f9ea411a650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- 172.21.15.138:0/4196001163 >> 172.21.15.138:0/4196001163 conn(0x7f9ea406eb40 msgr2=0x7f9ea4070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- 172.21.15.138:0/4196001163 shutdown_connections 2024-02-16T10:30:26.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- 172.21.15.138:0/4196001163 wait complete. 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 Processor -- start 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- start start 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9eaa9da640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea41ac8a0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45990/0 (socket says 172.21.15.138:45990) 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea3fff640 1 -- 172.21.15.138:0/3553025776 learned_addr learned my addr 172.21.15.138:0/3553025776 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea3fff640 1 -- 172.21.15.138:0/3553025776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980094d0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.204+0000 7f9ea3fff640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c6f0 tx=0x7f9e9c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e9c006b60 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c006ce0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea41acaa0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9e9c00a870 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea41a6370 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea4062980 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9e9c00aaa0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 0x7f9e90037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4283+0+0 (secure 0 0 0) 0x7f9e9c047fa0 con 0x7f9ea410dfe0 2024-02-16T10:30:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea37fe640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 0x7f9e90037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:26.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.208+0000 7f9ea37fe640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 0x7f9e90037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:26.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.220+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e9c011380 con 0x7f9ea410dfe0 2024-02-16T10:30:26.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:26.380+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f9ea4118260 con 0x7f9ea410dfe0 2024-02-16T10:30:27.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.028+0000 7f9ea0ff9640 1 -- 172.21.15.138:0/3553025776 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9e9c016070 con 0x7f9ea410dfe0 2024-02-16T10:30:27.038 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.index' created 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 msgr2=0x7f9e90037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 0x7f9e90037e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 msgr2=0x7f9ea41ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c6f0 tx=0x7f9e9c00cbb0 comp rx=0 tx=0).stop 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 shutdown_connections 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9e900359c0 0x7f9e90037e80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 --2- 172.21.15.138:0/3553025776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ea410dfe0 0x7f9ea41ac2d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 >> 172.21.15.138:0/3553025776 conn(0x7f9ea406eb40 msgr2=0x7f9ea4117350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 shutdown_connections 2024-02-16T10:30:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.032+0000 7f9eaa9da640 1 -- 172.21.15.138:0/3553025776 wait complete. 2024-02-16T10:30:27.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-02-16T10:30:27.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa677c25640 1 Processor -- start 2024-02-16T10:30:27.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa677c25640 1 -- start start 2024-02-16T10:30:27.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa677c25640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa670118260 0x7fa67011a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:27.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa677c25640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67011ab90 con 0x7fa67010dfe0 2024-02-16T10:30:27.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa677c25640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67011bd30 con 0x7fa670118260 2024-02-16T10:30:27.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa6751c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa670118260 0x7fa67011a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:27.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa6751c0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa670118260 0x7fa67011a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45996/0 (socket says 172.21.15.138:45996) 2024-02-16T10:30:27.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa6751c0640 1 -- 172.21.15.138:0/1230804945 learned_addr learned my addr 172.21.15.138:0/1230804945 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:27.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa6751c0640 1 -- 172.21.15.138:0/1230804945 >> v1:172.21.15.107:6789/0 conn(0x7fa67010dfe0 legacy=0x7fa67010e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:27.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.188+0000 7fa6751c0640 1 -- 172.21.15.138:0/1230804945 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67011be70 con 0x7fa670118260 2024-02-16T10:30:27.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6751c0640 1 --2- 172.21.15.138:0/1230804945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa670118260 0x7fa67011a650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097f0 tx=0x7fa66c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84318edf9271fe3f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:27.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6749bf640 1 -- 172.21.15.138:0/1230804945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0ab580 con 0x7fa670118260 2024-02-16T10:30:27.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6749bf640 1 -- 172.21.15.138:0/1230804945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0ab6e0 con 0x7fa670118260 2024-02-16T10:30:27.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6749bf640 1 -- 172.21.15.138:0/1230804945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0ab9a0 con 0x7fa670118260 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- 172.21.15.138:0/1230804945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa670118260 msgr2=0x7fa67011a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 --2- 172.21.15.138:0/1230804945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa670118260 0x7fa67011a650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097f0 tx=0x7fa66c01c430 comp rx=0 tx=0).stop 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- 172.21.15.138:0/1230804945 shutdown_connections 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 --2- 172.21.15.138:0/1230804945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa670118260 0x7fa67011a650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- 172.21.15.138:0/1230804945 >> 172.21.15.138:0/1230804945 conn(0x7fa67006eb40 msgr2=0x7fa670070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- 172.21.15.138:0/1230804945 shutdown_connections 2024-02-16T10:30:27.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- 172.21.15.138:0/1230804945 wait complete. 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 Processor -- start 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- start start 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa677c25640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6701ac8a0 con 0x7fa67010dfe0 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6759c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6759c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46012/0 (socket says 172.21.15.138:46012) 2024-02-16T10:30:27.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.192+0000 7fa6759c1640 1 -- 172.21.15.138:0/1105426889 learned_addr learned my addr 172.21.15.138:0/1105426889 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:27.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6759c1640 1 -- 172.21.15.138:0/1105426889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0094d0 con 0x7fa67010dfe0 2024-02-16T10:30:27.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6759c1640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c3b0 tx=0x7fa66000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:27.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa660005200 con 0x7fa67010dfe0 2024-02-16T10:30:27.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660005380 con 0x7fa67010dfe0 2024-02-16T10:30:27.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6701aca40 con 0x7fa67010dfe0 2024-02-16T10:30:27.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa660007020 con 0x7fa67010dfe0 2024-02-16T10:30:27.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6701a6370 con 0x7fa67010dfe0 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa670062980 con 0x7fa67010dfe0 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa660007180 con 0x7fa67010dfe0 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 0x7fa654037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4647+0+0 (secure 0 0 0) 0x7fa660047ab0 con 0x7fa67010dfe0 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6751c0640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 0x7fa654037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:27.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.196+0000 7fa6751c0640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 0x7fa654037e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:27.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.212+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa660019c30 con 0x7fa67010dfe0 2024-02-16T10:30:27.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:27.368+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7fa670118260 con 0x7fa67010dfe0 2024-02-16T10:30:28.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.036+0000 7fa6667fc640 1 -- 172.21.15.138:0/1105426889 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa660020070 con 0x7fa67010dfe0 2024-02-16T10:30:28.043 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 msgr2=0x7fa654037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 0x7fa654037e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 msgr2=0x7fa6701ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c3b0 tx=0x7fa66000c870 comp rx=0 tx=0).stop 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 shutdown_connections 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa6540359c0 0x7fa654037e80 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 --2- 172.21.15.138:0/1105426889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa67010dfe0 0x7fa6701ac2d0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c3b0 tx=0x7fa66000c870 comp rx=0 tx=0).stop 2024-02-16T10:30:28.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.040+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 >> 172.21.15.138:0/1105426889 conn(0x7fa67006eb40 msgr2=0x7fa670117350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:28.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.044+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 shutdown_connections 2024-02-16T10:30:28.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:28.044+0000 7fa677c25640 1 -- 172.21.15.138:0/1105426889 wait complete. 2024-02-16T10:30:28.092 DEBUG:tasks.rgw:Pools created 2024-02-16T10:30:28.092 INFO:tasks.rgw:Starting rgw... 2024-02-16T10:30:28.092 INFO:tasks.rgw:rgw client.0 config is {} 2024-02-16T10:30:28.092 INFO:tasks.rgw:Using beast as radosgw frontend 2024-02-16T10:30:28.092 INFO:tasks.rgw.client.0:Restarting daemon 2024-02-16T10:30:28.093 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-02-16T10:30:28.095 INFO:tasks.rgw.client.0:Started 2024-02-16T10:30:28.095 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:28.095 DEBUG:teuthology.orchestra.run.smithi138:> curl http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:28.126 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:30:28.126 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:30:28.127 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:30:28.127 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:30:28.127 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:30:29.128 DEBUG:teuthology.orchestra.run.smithi138:> curl http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:29.140 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:30:29.140 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:30:29.140 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:30:29.140 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:30:29.141 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:30:31.142 DEBUG:teuthology.orchestra.run.smithi138:> curl http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:31.153 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:30:31.154 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:30:31.154 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:30:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:30:31.154 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:30:35.156 DEBUG:teuthology.orchestra.run.smithi138:> curl http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:35.169 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-02-16T10:30:35.170 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:30:35.170 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:30:35.170 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-02-16T10:30:35.170 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-02-16T10:30:43.172 DEBUG:teuthology.orchestra.run.smithi138:> curl http://smithi138.front.sepia.ceph.com:80/ 2024-02-16T10:30:43.184 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-02-16T10:30:43.184 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-02-16T10:30:43.188 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 61494 0 --:--:-- --:--:-- --:--:-- 71333 2024-02-16T10:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout:anonymous 2024-02-16T10:30:43.188 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-02-16T10:30:44.317 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-02-16T10:30:44.318 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T10:30:44.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T10:30:44.318 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T10:30:44.355 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8fbe4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560e31f1da0 0x5560e31f4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8fbe4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5560e3137b40 con 0x5560e315f700 2024-02-16T10:30:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8fbe4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5560e30fed30 con 0x5560e31f1da0 2024-02-16T10:30:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8cefe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560e31f1da0 0x5560e31f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8cefe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5560e31f1da0 0x5560e31f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35546/0 (socket says 172.21.15.138:35546) 2024-02-16T10:30:44.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3754257203 learned_addr learned my addr 172.21.15.138:0/3754257203 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.348+0000 7f0e8d6ff640 1 --1- 172.21.15.138:0/3754257203 >> v1:172.21.15.107:6789/0 conn(0x5560e315f700 0x5560e31f0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53186/0 (socket says 172.21.15.138:53186) 2024-02-16T10:30:44.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3754257203 >> v1:172.21.15.107:6789/0 conn(0x5560e315f700 legacy=0x5560e31f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3754257203 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e31f56e0 con 0x5560e31f1da0 2024-02-16T10:30:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/3754257203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e31f4190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400a5c0 tx=0x7f0e8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee6d539cdd81b2e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e7ffff640 1 -- 172.21.15.138:0/3754257203 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e840aa470 con 0x5560e31f1da0 2024-02-16T10:30:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e7ffff640 1 -- 172.21.15.138:0/3754257203 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e840aa5d0 con 0x5560e31f1da0 2024-02-16T10:30:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e7ffff640 1 -- 172.21.15.138:0/3754257203 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e840aa890 con 0x5560e31f1da0 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3754257203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 msgr2=0x5560e31f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3754257203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e31f4190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400a5c0 tx=0x7f0e8401b340 comp rx=0 tx=0).stop 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3754257203 shutdown_connections 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3754257203 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e31f4190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3754257203 >> 172.21.15.138:0/3754257203 conn(0x5560e31e5d60 msgr2=0x5560e31e8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3754257203 shutdown_connections 2024-02-16T10:30:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.352+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3754257203 wait complete. 2024-02-16T10:30:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8fbe4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8fbe4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e30fbfc0 con 0x5560e315f700 2024-02-16T10:30:44.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8d6ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8d6ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35552/0 (socket says 172.21.15.138:35552) 2024-02-16T10:30:44.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.368+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/448874122 learned_addr learned my addr 172.21.15.138:0/448874122 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/448874122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84005df0 con 0x5560e315f700 2024-02-16T10:30:44.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/448874122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e88006fb0 tx=0x7f0e88001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48ea2c80e8b2264 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0d7b606640 1 -- 172.21.15.138:0/448874122 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88013420 con 0x5560e315f700 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0d7b606640 1 -- 172.21.15.138:0/448874122 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88013580 con 0x5560e315f700 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0d7b606640 1 -- 172.21.15.138:0/448874122 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88013860 con 0x5560e315f700 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/448874122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 msgr2=0x5560e32d7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/448874122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e88006fb0 tx=0x7f0e88001940 comp rx=0 tx=0).stop 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/448874122 shutdown_connections 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/448874122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e315f700 0x5560e32d7970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/448874122 >> 172.21.15.138:0/448874122 conn(0x5560e31e5d60 msgr2=0x5560e32d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/448874122 shutdown_connections 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/448874122 wait complete. 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8fbe4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e30f77a0 con 0x5560e31f1da0 2024-02-16T10:30:44.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35556/0 (socket says 172.21.15.138:35556) 2024-02-16T10:30:44.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/1671547054 learned_addr learned my addr 172.21.15.138:0/1671547054 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e3137b40 con 0x5560e31f1da0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800f000 tx=0x7f0e88000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.372+0000 7f0d79e03640 1 -- 172.21.15.138:0/1671547054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88003670 con 0x5560e31f1da0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0d79e03640 1 -- 172.21.15.138:0/1671547054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880037d0 con 0x5560e31f1da0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560e32df1b0 con 0x5560e31f1da0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0d79e03640 1 -- 172.21.15.138:0/1671547054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88003ab0 con 0x5560e31f1da0 2024-02-16T10:30:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560e32df660 con 0x5560e31f1da0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0d79e03640 1 -- 172.21.15.138:0/1671547054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0e88003c10 con 0x5560e31f1da0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0d79e03640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 0x7f0d740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0d79e03640 1 -- 172.21.15.138:0/1671547054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0e880493a0 con 0x5560e31f1da0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 0x7f0d740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 0x5560e32e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e32e6230 con 0x5560e32e3900 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 0x5560e32e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 0x7f0d740367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e840ae000 tx=0x7f0e840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 0x5560e32e5cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 -- 172.21.15.138:0/1671547054 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e800083f0 con 0x5560e32e3900 2024-02-16T10:30:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e32e6610 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 -- 172.21.15.138:0/1671547054 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e800083f0 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e32e7ec0 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 -- 172.21.15.138:0/1671547054 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f0e800083f0 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e32e7000 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8df00640 1 -- 172.21.15.138:0/1671547054 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e800083f0 con 0x5560e32e3900 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 0x5560e32eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.376+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e32eb890 con 0x5560e32e7920 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 0x5560e32eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 0x5560e32eb240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/1671547054 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0e88024020 con 0x5560e32e7920 2024-02-16T10:30:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e308ff20 con 0x5560e32f97c0 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35564/0 (socket says 172.21.15.138:35564) 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8df00640 1 -- 172.21.15.138:0/3503110213 learned_addr learned my addr 172.21.15.138:0/3503110213 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8df00640 1 -- 172.21.15.138:0/3503110213 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e32fa120 con 0x5560e32f97c0 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8df00640 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5560e32e0050 tx=0x7f0e8000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0d72ffd640 1 -- 172.21.15.138:0/3503110213 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e8000f040 con 0x5560e32f97c0 2024-02-16T10:30:44.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0d72ffd640 1 -- 172.21.15.138:0/3503110213 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80019550 con 0x5560e32f97c0 2024-02-16T10:30:44.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560e32fa370 con 0x5560e32f97c0 2024-02-16T10:30:44.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0d72ffd640 1 -- 172.21.15.138:0/3503110213 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e800197f0 con 0x5560e32f97c0 2024-02-16T10:30:44.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.380+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560e32faec0 con 0x5560e32f97c0 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d72ffd640 1 -- 172.21.15.138:0/3503110213 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0e80019950 con 0x5560e32f97c0 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d72ffd640 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 0x7f0d64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d72ffd640 1 -- 172.21.15.138:0/3503110213 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0e8004b7d0 con 0x5560e32f97c0 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 0x7f0d64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 0x7f0d64036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5560e32e7360 tx=0x7f0e88006930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e3083790 con 0x5560e3306700 2024-02-16T10:30:44.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35566/0 (socket says 172.21.15.138:35566) 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8df00640 1 -- 172.21.15.138:0/4009175745 learned_addr learned my addr 172.21.15.138:0/4009175745 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8df00640 1 -- 172.21.15.138:0/4009175745 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e33070f0 con 0x5560e3306700 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8df00640 1 --2- 172.21.15.138:0/4009175745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e80049bf0 tx=0x7f0e80007440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d6cc1ec68e5828 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d70ff9640 1 -- 172.21.15.138:0/4009175745 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e80022580 con 0x5560e3306700 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d70ff9640 1 -- 172.21.15.138:0/4009175745 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8003a3c0 con 0x5560e3306700 2024-02-16T10:30:44.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0d70ff9640 1 -- 172.21.15.138:0/4009175745 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e8003baf0 con 0x5560e3306700 2024-02-16T10:30:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/4009175745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 msgr2=0x5560e3306b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/4009175745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e80049bf0 tx=0x7f0e80007440 comp rx=0 tx=0).stop 2024-02-16T10:30:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/4009175745 shutdown_connections 2024-02-16T10:30:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/4009175745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e3306b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/4009175745 >> 172.21.15.138:0/4009175745 conn(0x5560e3301280 msgr2=0x5560e3302160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/4009175745 shutdown_connections 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/4009175745 wait complete. 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 Processor -- start 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- start start 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.384+0000 7f0e8fbe4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e330d950 con 0x5560e3306700 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8df00640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35576/0 (socket says 172.21.15.138:35576) 2024-02-16T10:30:44.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 learned_addr learned my addr 172.21.15.138:0/3108594729 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e32faec0 con 0x5560e3306700 2024-02-16T10:30:44.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8df00640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e80019fd0 tx=0x7f0e80049b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 -- 172.21.15.138:0/3108594729 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e80033070 con 0x5560e3306700 2024-02-16T10:30:44.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 -- 172.21.15.138:0/3108594729 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80017b20 con 0x5560e3306700 2024-02-16T10:30:44.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560e330db50 con 0x5560e3306700 2024-02-16T10:30:44.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 -- 172.21.15.138:0/3108594729 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e80017dc0 con 0x5560e3306700 2024-02-16T10:30:44.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560e330df80 con 0x5560e3306700 2024-02-16T10:30:44.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 -- 172.21.15.138:0/3108594729 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0e8004b0d0 con 0x5560e3306700 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d580342b0 0x7f0d58036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0d62ffd640 1 -- 172.21.15.138:0/3108594729 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f0e8002dc90 con 0x5560e3306700 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d580342b0 0x7f0d58036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e3318b70 0x5560e331b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331b780 con 0x5560e3318b70 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e3318b70 0x5560e331b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d580342b0 0x7f0d58036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e8801db30 tx=0x7f0e88033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.388+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e3318b70 0x5560e331b030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 realm 2024-02-16T10:30:44.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331bb70 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331c3c0 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331c720 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331c060 con 0x5560e3318b70 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 20 searching for the correct realm 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5560e331e970 0x5560e3320dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8df00640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5560e331e970 0x5560e3320dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8df00640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5560e331e970 0x5560e3320dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8df00640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e80044050 0x7f0e8003b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e80044050 0x7f0e8003b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e80044050 0x7f0e8003b4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8d6ff640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f0e88056040 0x7f0e88028640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.392+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f0e88056040 0x7f0e88028640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f0e88056040 0x7f0e88028640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.396+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.400+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e331e970 2024-02-16T10:30:44.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e88056040 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.404+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x5560e3318b70 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321490 con 0x7f0e80044050 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d580 con 0x5560e3318b70 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d200 con 0x5560e3318b70 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331de50 con 0x7f0e80044050 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 zone default found 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 4 Realm: () 2024-02-16T10:30:44.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 zonegroup default 2024-02-16T10:30:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3321920 con 0x7f0e88056040 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e33237a0 con 0x5560e331e970 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3323b00 con 0x5560e331e970 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 started sync module instance, tier type = 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.408+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3322d70 con 0x7f0e80044050 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874616936656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3323e60 con 0x7f0e80044050 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3324860 con 0x5560e3318b70 2024-02-16T10:30:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874616936656] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874616943456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3324c10 con 0x5560e3318b70 2024-02-16T10:30:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.412+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3325580 con 0x5560e331e970 2024-02-16T10:30:44.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874616943456] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874616938848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3325580 con 0x5560e331e970 2024-02-16T10:30:44.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3325fb0 con 0x7f0e80044050 2024-02-16T10:30:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874616949456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e33271f0 con 0x5560e3318b70 2024-02-16T10:30:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.416+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874616938848] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874616949456] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874616951648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e33250e0 con 0x5560e3318b70 2024-02-16T10:30:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3327a40 con 0x7f0e88056040 2024-02-16T10:30:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874616951648] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874616954064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e33279a0 con 0x7f0e88056040 2024-02-16T10:30:44.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.420+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3328310 con 0x7f0e88056040 2024-02-16T10:30:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.424+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874616954064] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.424+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.424+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874616956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3328310 con 0x7f0e88056040 2024-02-16T10:30:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.424+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3328c80 con 0x7f0e88056040 2024-02-16T10:30:44.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.424+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874616956432] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874616958576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3328e60 con 0x7f0e88056040 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=0 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=1 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=2 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=3 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=4 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=5 2024-02-16T10:30:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=6 2024-02-16T10:30:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874616958576] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 20 add_watcher() i=7 2024-02-16T10:30:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e332c090 con 0x5560e3318b70 2024-02-16T10:30:44.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.428+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874616974016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3328ec0 con 0x5560e3318b70 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874616974016] v31'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 5 note: GC not initialized 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0d427e4640 20 reqs_thread_entry: start 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 20 Filter name: none 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0cb3fff640 20 reqs_thread_entry: start 2024-02-16T10:30:44.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6f0 con 0x5560e331e970 2024-02-16T10:30:44.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3323b00 con 0x5560e331e970 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3323b00 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d580 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d580 con 0x7f0e80044050 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.432+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.436+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.440+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e88056040 2024-02-16T10:30:44.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e3318b70 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x5560e331e970 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3326800 con 0x7f0e80044050 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.444+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874616974016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e3323b00 con 0x5560e3318b70 2024-02-16T10:30:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93874616974016] v31'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874616936656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d580 con 0x7f0e80044050 2024-02-16T10:30:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93874616936656] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8fbe4980 20 remove_watcher() i=0 2024-02-16T10:30:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8fbe4980 2 removed watcher, disabling cache 2024-02-16T10:30:44.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.448+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874616943456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d530 con 0x5560e3318b70 2024-02-16T10:30:44.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93874616943456] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8fbe4980 20 remove_watcher() i=1 2024-02-16T10:30:44.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874616938848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e331d530 con 0x5560e331e970 2024-02-16T10:30:44.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8df00640 1 -- 172.21.15.138:0/3108594729 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93874616938848] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e80041070 con 0x5560e331e970 2024-02-16T10:30:44.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8fbe4980 20 remove_watcher() i=2 2024-02-16T10:30:44.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.452+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874616949456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6b0 con 0x7f0e80044050 2024-02-16T10:30:44.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8d6ff640 1 -- 172.21.15.138:0/3108594729 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93874616949456] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e88024020 con 0x7f0e80044050 2024-02-16T10:30:44.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8fbe4980 20 remove_watcher() i=3 2024-02-16T10:30:44.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874616951648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6b0 con 0x5560e3318b70 2024-02-16T10:30:44.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93874616951648] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x5560e3318b70 2024-02-16T10:30:44.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8fbe4980 20 remove_watcher() i=4 2024-02-16T10:30:44.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.456+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874616954064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6b0 con 0x7f0e88056040 2024-02-16T10:30:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93874616954064] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8fbe4980 20 remove_watcher() i=5 2024-02-16T10:30:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874616956432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6b0 con 0x7f0e88056040 2024-02-16T10:30:44.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93874616956432] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8fbe4980 20 remove_watcher() i=6 2024-02-16T10:30:44.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.460+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874616958576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5560e334d6b0 con 0x7f0e88056040 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93874616958576] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e840b0020 con 0x7f0e88056040 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 20 remove_watcher() i=7 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f0e88056040 msgr2=0x7f0e88028640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f0e88056040 0x7f0e88028640 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e3318b70 msgr2=0x5560e331b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e3318b70 0x5560e331b030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e80044050 msgr2=0x7f0e8003b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0e80044050 0x7f0e8003b4d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5560e331e970 msgr2=0x5560e3320dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5560e331e970 0x5560e3320dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d580342b0 msgr2=0x7f0d58036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d580342b0 0x7f0d58036770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e8801db30 tx=0x7f0e88033000 comp rx=0 tx=0).stop 2024-02-16T10:30:44.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 msgr2=0x5560e330d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0e80019fd0 tx=0x7f0e80049b50 comp rx=0 tx=0).stop 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8cefe640 1 -- 172.21.15.138:0/3108594729 reap_dead start 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 shutdown_connections 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3108594729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e3306700 0x5560e330d410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 >> 172.21.15.138:0/3108594729 conn(0x5560e3301280 msgr2=0x5560e3302160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 shutdown_connections 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3108594729 wait complete. 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 msgr2=0x7f0d64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 0x7f0d64036770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5560e32e7360 tx=0x7f0e88006930 comp rx=0 tx=0).stop 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 msgr2=0x5560e32f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5560e32e0050 tx=0x7f0e8000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 shutdown_connections 2024-02-16T10:30:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d640342b0 0x7f0d64036770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/3503110213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e32f97c0 0x5560e32f9be0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 >> 172.21.15.138:0/3503110213 conn(0x5560e32ee5d0 msgr2=0x5560e32ef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 shutdown_connections 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/3503110213 wait complete. 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 msgr2=0x5560e32e5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 0x5560e32e5cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 msgr2=0x5560e32eb240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 0x5560e32eb240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 msgr2=0x7f0d740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 0x7f0d740367c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e840ae000 tx=0x7f0e840a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 msgr2=0x5560e32dec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800f000 tx=0x7f0e88000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 shutdown_connections 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5560e32e7920 0x5560e32eb240 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5560e32e3900 0x5560e32e5cf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0d74034300 0x7f0d740367c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 --2- 172.21.15.138:0/1671547054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5560e31f1da0 0x5560e32dec70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 >> 172.21.15.138:0/1671547054 conn(0x5560e31e5d60 msgr2=0x5560e32d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 shutdown_connections 2024-02-16T10:30:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.464+0000 7f0e8fbe4980 1 -- 172.21.15.138:0/1671547054 wait complete. 2024-02-16T10:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-02-16T10:30:44.483 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:30:44.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-02-16T10:30:44.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-02-16T10:30:44.484 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-02-16T10:30:44.561 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:44.561 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b4858980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e327ffaf90 0x55e328089290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b4858980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e327fd2b50 con 0x55e3280897d0 2024-02-16T10:30:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b4858980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e327f99d30 con 0x55e327ffaf90 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b1b72640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55e3280897d0 0x55e32808bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53192/0 (socket says 172.21.15.138:53192) 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b1b72640 1 -- 172.21.15.138:0/830484180 learned_addr learned my addr 172.21.15.138:0/830484180 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b2373640 1 --2- 172.21.15.138:0/830484180 >> v2:172.21.15.107:3300/0 conn(0x55e327ffaf90 0x55e328089290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b1371640 1 -- 172.21.15.138:0/830484180 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109554483 0 0) 0x55e327fd2b50 con 0x55e3280897d0 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b1371640 1 -- 172.21.15.138:0/830484180 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c001e20 con 0x55e3280897d0 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b2373640 1 -- 172.21.15.138:0/830484180 >> v1:172.21.15.107:6789/0 conn(0x55e3280897d0 legacy=0x55e32808bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.556+0000 7f76b2373640 1 -- 172.21.15.138:0/830484180 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e32808e380 con 0x55e327ffaf90 2024-02-16T10:30:44.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b2373640 1 --2- 172.21.15.138:0/830484180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e328089290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76a400a480 tx=0x7f76a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b02f5b772d5220 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b1371640 1 -- 172.21.15.138:0/830484180 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a40ab540 con 0x55e327ffaf90 2024-02-16T10:30:44.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b1371640 1 -- 172.21.15.138:0/830484180 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40ab6a0 con 0x55e327ffaf90 2024-02-16T10:30:44.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b1371640 1 -- 172.21.15.138:0/830484180 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a40ab960 con 0x55e327ffaf90 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 -- 172.21.15.138:0/830484180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 msgr2=0x55e328089290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 --2- 172.21.15.138:0/830484180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e328089290 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76a400a480 tx=0x7f76a401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 -- 172.21.15.138:0/830484180 shutdown_connections 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 --2- 172.21.15.138:0/830484180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e328089290 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 -- 172.21.15.138:0/830484180 >> 172.21.15.138:0/830484180 conn(0x55e328080db0 msgr2=0x55e3280831d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 -- 172.21.15.138:0/830484180 shutdown_connections 2024-02-16T10:30:44.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.560+0000 7f76b4858980 1 -- 172.21.15.138:0/830484180 wait complete. 2024-02-16T10:30:44.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b4858980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b4858980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e327f96fc0 con 0x55e327ffaf90 2024-02-16T10:30:44.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b2373640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b2373640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35602/0 (socket says 172.21.15.138:35602) 2024-02-16T10:30:44.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b2373640 1 -- 172.21.15.138:0/1253934569 learned_addr learned my addr 172.21.15.138:0/1253934569 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b2373640 1 -- 172.21.15.138:0/1253934569 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4005d30 con 0x55e327ffaf90 2024-02-16T10:30:44.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f76b2373640 1 --2- 172.21.15.138:0/1253934569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000c10 tx=0x7f76a4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70475e09f9c2084e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f75a0608640 1 -- 172.21.15.138:0/1253934569 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a400a050 con 0x55e327ffaf90 2024-02-16T10:30:44.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f75a0608640 1 -- 172.21.15.138:0/1253934569 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400a1b0 con 0x55e327ffaf90 2024-02-16T10:30:44.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.576+0000 7f75a0608640 1 -- 172.21.15.138:0/1253934569 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a40ab810 con 0x55e327ffaf90 2024-02-16T10:30:44.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/1253934569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 msgr2=0x55e3280869f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 --2- 172.21.15.138:0/1253934569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000c10 tx=0x7f76a4003030 comp rx=0 tx=0).stop 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/1253934569 shutdown_connections 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 --2- 172.21.15.138:0/1253934569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e327ffaf90 0x55e3280869f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/1253934569 >> 172.21.15.138:0/1253934569 conn(0x55e328080db0 msgr2=0x55e32816c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/1253934569 shutdown_connections 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/1253934569 wait complete. 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e327f927a0 con 0x55e3280897d0 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b2373640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b2373640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35616/0 (socket says 172.21.15.138:35616) 2024-02-16T10:30:44.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b2373640 1 -- 172.21.15.138:0/3145380448 learned_addr learned my addr 172.21.15.138:0/3145380448 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b2373640 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e32808e380 con 0x55e3280897d0 2024-02-16T10:30:44.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b2373640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76a4018eb0 tx=0x7f76a4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 -- 172.21.15.138:0/3145380448 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a40c3070 con 0x55e3280897d0 2024-02-16T10:30:44.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e328179c80 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 -- 172.21.15.138:0/3145380448 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400a320 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 -- 172.21.15.138:0/3145380448 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76a40098e0 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e32817a130 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 -- 172.21.15.138:0/3145380448 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f76a40b2030 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 0x7f7598036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f759ee05640 1 -- 172.21.15.138:0/3145380448 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f76a40e3720 con 0x55e3280897d0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.580+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 0x7f7598036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 0x55e328180770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e328180cb0 con 0x55e32817e380 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 0x55e328180770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 0x7f7598036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76a8000f70 tx=0x7f76a80010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 0x55e328180770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 -- 172.21.15.138:0/3145380448 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e328181080 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 -- 172.21.15.138:0/3145380448 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e328182930 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 -- 172.21.15.138:0/3145380448 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e328181b30 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 -- 172.21.15.138:0/3145380448 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e32817e380 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 0x55e328185cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e328186300 con 0x55e328182450 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2373640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 0x55e328185cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2373640 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 0x55e328185cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2373640 1 -- 172.21.15.138:0/3145380448 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f76a40d0c10 con 0x55e328182450 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b4858980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e327f2af20 con 0x55e3281942a0 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.584+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35630/0 (socket says 172.21.15.138:35630) 2024-02-16T10:30:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 -- 172.21.15.138:0/1604842029 learned_addr learned my addr 172.21.15.138:0/1604842029 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 -- 172.21.15.138:0/1604842029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e328194c00 con 0x55e3281942a0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55e327ffa890 tx=0x7f76ac018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 -- 172.21.15.138:0/1604842029 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac01d070 con 0x55e3281942a0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 -- 172.21.15.138:0/1604842029 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac014450 con 0x55e3281942a0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e328194e50 con 0x55e3281942a0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 -- 172.21.15.138:0/1604842029 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac0146f0 con 0x55e3281942a0 2024-02-16T10:30:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3281959a0 con 0x55e3281942a0 2024-02-16T10:30:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 -- 172.21.15.138:0/1604842029 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f76ac020020 con 0x55e3281942a0 2024-02-16T10:30:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 0x7f758c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f7597fff640 1 -- 172.21.15.138:0/1604842029 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f76ac04b190 con 0x55e3281942a0 2024-02-16T10:30:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2373640 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 0x7f758c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2373640 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 0x7f758c036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55e328181570 tx=0x7f76a40e1a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b4858980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e327f1e790 con 0x55e3281a1240 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35636/0 (socket says 172.21.15.138:35636) 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.588+0000 7f76b2b74640 1 -- 172.21.15.138:0/2325761974 learned_addr learned my addr 172.21.15.138:0/2325761974 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 -- 172.21.15.138:0/2325761974 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3281a1c30 con 0x55e3281a1240 2024-02-16T10:30:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 --2- 172.21.15.138:0/2325761974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0494c0 tx=0x7f76ac0480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc4ade5ffd8bfbc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7595ffb640 1 -- 172.21.15.138:0/2325761974 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac013630 con 0x55e3281a1240 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7595ffb640 1 -- 172.21.15.138:0/2325761974 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac03b050 con 0x55e3281a1240 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7595ffb640 1 -- 172.21.15.138:0/2325761974 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac012560 con 0x55e3281a1240 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/2325761974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 msgr2=0x55e3281a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 --2- 172.21.15.138:0/2325761974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0494c0 tx=0x7f76ac0480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/2325761974 shutdown_connections 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 --2- 172.21.15.138:0/2325761974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a1660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/2325761974 >> 172.21.15.138:0/2325761974 conn(0x55e32819bdc0 msgr2=0x55e32819cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/2325761974 shutdown_connections 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/2325761974 wait complete. 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 Processor -- start 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- start start 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3281a8500 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35652/0 (socket says 172.21.15.138:35652) 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 learned_addr learned my addr 172.21.15.138:0/3106142960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3281959a0 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76ac012f90 tx=0x7f76ac049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7583fff640 1 -- 172.21.15.138:0/3106142960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac034070 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7583fff640 1 -- 172.21.15.138:0/3106142960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac02be80 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f7583fff640 1 -- 172.21.15.138:0/3106142960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ac013630 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3281a8700 con 0x55e3281a1240 2024-02-16T10:30:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.592+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3281a8b30 con 0x55e3281a1240 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f7583fff640 1 -- 172.21.15.138:0/3106142960 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f76ac013800 con 0x55e3281a1240 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f7583fff640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f757c034260 0x7f757c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f7583fff640 1 -- 172.21.15.138:0/3106142960 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f76ac04ccd0 con 0x55e3281a1240 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b2373640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f757c034260 0x7f757c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3281b36b0 0x55e3281b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b62c0 con 0x55e3281b36b0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3281b36b0 0x55e3281b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b2373640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f757c034260 0x7f757c036720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76a40a4470 tx=0x7f76a40e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3281b36b0 0x55e3281b5b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 realm 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b2b60 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b6d40 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b75c0 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b7920 con 0x55e3281b36b0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 20 searching for the correct realm 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3281b99f0 0x55e3281bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.596+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3281b99f0 0x55e3281bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3281b99f0 0x55e3281bbeb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2b74640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f76ac014850 0x7f76ac017030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2373640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f76ac014850 0x7f76ac017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2373640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f76ac014850 0x7f76ac017030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2373640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x55e327ffaf90 0x7f76a40e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x55e327ffaf90 0x7f76a40e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x55e327ffaf90 0x7f76a40e30b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.600+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.604+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.608+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b99f0 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e327ffaf90 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x55e3281b36b0 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc580 con 0x7f76ac014850 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b8fd0 con 0x55e3281b36b0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.612+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b87c0 con 0x55e3281b36b0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281b87c0 con 0x7f76ac014850 2024-02-16T10:30:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 zone default found 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 4 Realm: () 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 zonegroup default 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bc9c0 con 0x55e327ffaf90 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281be780 con 0x55e3281b99f0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281beb60 con 0x55e3281b99f0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 started sync module instance, tier type = 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bdc10 con 0x7f76ac014850 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434118850416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281be410 con 0x7f76ac014850 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.616+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bf590 con 0x55e3281b36b0 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434118850416] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434118856944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281bf510 con 0x55e3281b36b0 2024-02-16T10:30:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c02e0 con 0x55e3281b99f0 2024-02-16T10:30:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434118860256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c02a0 con 0x55e3281b99f0 2024-02-16T10:30:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c11e0 con 0x7f76ac014850 2024-02-16T10:30:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.620+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434118856944] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434118864128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c1590 con 0x7f76ac014850 2024-02-16T10:30:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c1f00 con 0x55e3281b36b0 2024-02-16T10:30:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434118860256] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434118867552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c1e80 con 0x55e3281b36b0 2024-02-16T10:30:44.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c2bf0 con 0x55e327ffaf90 2024-02-16T10:30:44.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.624+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434118864128] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434118867552] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434118859072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c2700 con 0x55e327ffaf90 2024-02-16T10:30:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c3440 con 0x55e327ffaf90 2024-02-16T10:30:44.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434118872992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c2700 con 0x55e327ffaf90 2024-02-16T10:30:44.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c3e70 con 0x55e327ffaf90 2024-02-16T10:30:44.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.628+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434118859072] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434118872992] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434118869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c39d0 con 0x55e327ffaf90 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=0 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=1 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=2 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=3 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=4 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=5 2024-02-16T10:30:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=6 2024-02-16T10:30:44.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434118869376] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 20 add_watcher() i=7 2024-02-16T10:30:44.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:44.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c6ea0 con 0x55e3281b36b0 2024-02-16T10:30:44.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.632+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434118875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281c4290 con 0x55e3281b36b0 2024-02-16T10:30:44.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434118875600] v31'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f7568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b4858980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:44.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b4858980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:44.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cf2a0 con 0x55e3281b36b0 2024-02-16T10:30:44.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.636+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cf350 con 0x55e327ffaf90 2024-02-16T10:30:44.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cfe50 con 0x55e3281b99f0 2024-02-16T10:30:44.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cd370 con 0x55e3281b36b0 2024-02-16T10:30:44.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.640+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cd370 con 0x7f76ac014850 2024-02-16T10:30:44.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d0be0 con 0x55e3281b99f0 2024-02-16T10:30:44.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d1130 con 0x55e3281b36b0 2024-02-16T10:30:44.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.644+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d11c0 con 0x55e327ffaf90 2024-02-16T10:30:44.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.648+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.648+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cd180 con 0x7f76ac014850 2024-02-16T10:30:44.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d17b0 con 0x55e3281b99f0 2024-02-16T10:30:44.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d1ce0 con 0x7f76ac014850 2024-02-16T10:30:44.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.652+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d2210 con 0x55e327ffaf90 2024-02-16T10:30:44.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.656+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.656+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d2210 con 0x7f76ac014850 2024-02-16T10:30:44.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.656+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.656+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e327ffaf90 2024-02-16T10:30:44.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.660+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.660+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b36b0 2024-02-16T10:30:44.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.660+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.660+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.660+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.664+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x7f76ac014850 2024-02-16T10:30:44.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.664+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.664+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.664+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.664+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b36b0 2024-02-16T10:30:44.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.668+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.668+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b36b0 2024-02-16T10:30:44.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.668+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.668+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.668+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.672+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x7f76ac014850 2024-02-16T10:30:44.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.672+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.672+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.672+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.672+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.676+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e327ffaf90 2024-02-16T10:30:44.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.680+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.680+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.680+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.680+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e327ffaf90 2024-02-16T10:30:44.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.684+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.684+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e3281b99f0 2024-02-16T10:30:44.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.688+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.688+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x55e327ffaf90 2024-02-16T10:30:44.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.688+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.688+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281d26b0 con 0x7f76ac014850 2024-02-16T10:30:44.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f74e37fe640 20 reqs_thread_entry: start 2024-02-16T10:30:44.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:44.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 20 Filter name: none 2024-02-16T10:30:44.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f74e17fa640 20 reqs_thread_entry: start 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb220 con 0x7f76ac014850 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:30:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:30:44.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f7568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.692+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434118875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb220 con 0x55e3281b36b0 2024-02-16T10:30:44.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.696+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94434118875600] v31'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.696+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434118850416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb220 con 0x7f76ac014850 2024-02-16T10:30:44.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94434118850416] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b4858980 20 remove_watcher() i=0 2024-02-16T10:30:44.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b4858980 2 removed watcher, disabling cache 2024-02-16T10:30:44.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434118856944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e3281b36b0 2024-02-16T10:30:44.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94434118856944] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b4858980 20 remove_watcher() i=1 2024-02-16T10:30:44.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.700+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434118860256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e3281b99f0 2024-02-16T10:30:44.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b2b74640 1 -- 172.21.15.138:0/3106142960 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94434118860256] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76ac00a4d0 con 0x55e3281b99f0 2024-02-16T10:30:44.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b4858980 20 remove_watcher() i=2 2024-02-16T10:30:44.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434118864128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x7f76ac014850 2024-02-16T10:30:44.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b2373640 1 -- 172.21.15.138:0/3106142960 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94434118864128] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a40eb040 con 0x7f76ac014850 2024-02-16T10:30:44.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b4858980 20 remove_watcher() i=3 2024-02-16T10:30:44.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.704+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434118867552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e3281b36b0 2024-02-16T10:30:44.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94434118867552] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e3281b36b0 2024-02-16T10:30:44.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b4858980 20 remove_watcher() i=4 2024-02-16T10:30:44.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434118859072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e327ffaf90 2024-02-16T10:30:44.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94434118859072] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b4858980 20 remove_watcher() i=5 2024-02-16T10:30:44.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.708+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434118872992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e327ffaf90 2024-02-16T10:30:44.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94434118872992] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 20 remove_watcher() i=6 2024-02-16T10:30:44.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434118869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3281cb1e0 con 0x55e327ffaf90 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94434118869376] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76a800e640 con 0x55e327ffaf90 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 20 remove_watcher() i=7 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x55e327ffaf90 msgr2=0x7f76a40e30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x55e327ffaf90 0x7f76a40e30b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3281b36b0 msgr2=0x55e3281b5b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3281b36b0 0x55e3281b5b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f76ac014850 msgr2=0x7f76ac017030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f76ac014850 0x7f76ac017030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3281b99f0 msgr2=0x55e3281bbeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3281b99f0 0x55e3281bbeb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f757c034260 msgr2=0x7f757c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f757c034260 0x7f757c036720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76a40a4470 tx=0x7f76a40e4000 comp rx=0 tx=0).stop 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b1b72640 1 -- 172.21.15.138:0/3106142960 reap_dead start 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 msgr2=0x55e3281a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.712+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76ac012f90 tx=0x7f76ac049450 comp rx=0 tx=0).stop 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 shutdown_connections 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3106142960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281a1240 0x55e3281a7fc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 >> 172.21.15.138:0/3106142960 conn(0x55e32819bdc0 msgr2=0x55e32819cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 shutdown_connections 2024-02-16T10:30:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3106142960 wait complete. 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 msgr2=0x7f758c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 0x7f758c036770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55e328181570 tx=0x7f76a40e1a00 comp rx=0 tx=0).stop 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 msgr2=0x55e3281946c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55e327ffa890 tx=0x7f76ac018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 shutdown_connections 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f758c0342b0 0x7f758c036770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/1604842029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3281942a0 0x55e3281946c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 >> 172.21.15.138:0/1604842029 conn(0x55e3281890b0 msgr2=0x55e328189bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 shutdown_connections 2024-02-16T10:30:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/1604842029 wait complete. 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 msgr2=0x55e328180770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 0x55e328180770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 msgr2=0x55e328185cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 0x55e328185cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 msgr2=0x7f7598036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 0x7f7598036770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76a8000f70 tx=0x7f76a80010b0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 msgr2=0x55e328179740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76a4018eb0 tx=0x7f76a4018020 comp rx=0 tx=0).stop 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 shutdown_connections 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e328182450 0x55e328185cb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e32817e380 0x55e328180770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f75980342b0 0x7f7598036770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 --2- 172.21.15.138:0/3145380448 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3280897d0 0x55e328179740 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 >> 172.21.15.138:0/3145380448 conn(0x55e328080db0 msgr2=0x55e3280852f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 shutdown_connections 2024-02-16T10:30:44.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.716+0000 7f76b4858980 1 -- 172.21.15.138:0/3145380448 wait complete. 2024-02-16T10:30:44.737 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:30:44.737 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-02-16T10:30:44.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-02-16T10:30:44.738 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-02-16T10:30:44.813 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:44.814 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cf1ab6980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5637416f7db0 0x5637416fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cf1ab6980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56374163db50 con 0x563741665710 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cf1ab6980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563741604d30 con 0x5637416f7db0 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cef5d1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563741665710 0x5637416f6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53202/0 (socket says 172.21.15.138:53202) 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1ceedd0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5637416f7db0 0x5637416fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1cef5d1640 1 -- 172.21.15.138:0/480889356 learned_addr learned my addr 172.21.15.138:0/480889356 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:44.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1ceedd0640 1 -- 172.21.15.138:0/480889356 >> v1:172.21.15.107:6789/0 conn(0x563741665710 legacy=0x5637416f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.808+0000 7f1ceedd0640 1 -- 172.21.15.138:0/480889356 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637416fb6f0 con 0x5637416f7db0 2024-02-16T10:30:44.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/480889356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637416f7db0 0x5637416fa1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400a480 tx=0x7f1ce401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9910d245dab4c2e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cee5cf640 1 -- 172.21.15.138:0/480889356 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce40ab540 con 0x5637416f7db0 2024-02-16T10:30:44.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cee5cf640 1 -- 172.21.15.138:0/480889356 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce40ab6a0 con 0x5637416f7db0 2024-02-16T10:30:44.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cee5cf640 1 -- 172.21.15.138:0/480889356 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce40ab960 con 0x5637416f7db0 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/480889356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637416f7db0 msgr2=0x5637416fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/480889356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637416f7db0 0x5637416fa1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400a480 tx=0x7f1ce401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/480889356 shutdown_connections 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/480889356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637416f7db0 0x5637416fa1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/480889356 >> 172.21.15.138:0/480889356 conn(0x5637416ebd70 msgr2=0x5637416ee190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/480889356 shutdown_connections 2024-02-16T10:30:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.812+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/480889356 wait complete. 2024-02-16T10:30:44.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563741601fc0 con 0x563741665710 2024-02-16T10:30:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cef5d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cef5d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35656/0 (socket says 172.21.15.138:35656) 2024-02-16T10:30:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cef5d1640 1 -- 172.21.15.138:0/5401837 learned_addr learned my addr 172.21.15.138:0/5401837 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cef5d1640 1 -- 172.21.15.138:0/5401837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4005d30 con 0x563741665710 2024-02-16T10:30:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/5401837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001c90 tx=0x7f1ce000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d77c700cfc08d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1bdd60a640 1 -- 172.21.15.138:0/5401837 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce000e690 con 0x563741665710 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1bdd60a640 1 -- 172.21.15.138:0/5401837 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000e7f0 con 0x563741665710 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1bdd60a640 1 -- 172.21.15.138:0/5401837 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce000eaf0 con 0x563741665710 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/5401837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 msgr2=0x5637417dd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/5401837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001c90 tx=0x7f1ce000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/5401837 shutdown_connections 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/5401837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417dd9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/5401837 >> 172.21.15.138:0/5401837 conn(0x5637416ebd70 msgr2=0x5637417d9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/5401837 shutdown_connections 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.828+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/5401837 wait complete. 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637415fd7a0 con 0x563741665710 2024-02-16T10:30:44.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cef5d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cef5d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35666/0 (socket says 172.21.15.138:35666) 2024-02-16T10:30:44.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cef5d1640 1 -- 172.21.15.138:0/2166388903 learned_addr learned my addr 172.21.15.138:0/2166388903 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cef5d1640 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56374163db50 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001ee0 tx=0x7f1ce0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 -- 172.21.15.138:0/2166388903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce001f070 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 -- 172.21.15.138:0/2166388903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce001a4d0 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637417e5070 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 -- 172.21.15.138:0/2166388903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce001a770 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637417e5520 con 0x563741665710 2024-02-16T10:30:44.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 -- 172.21.15.138:0/2166388903 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ce000a040 con 0x563741665710 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 0x7f1bd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1bdbe07640 1 -- 172.21.15.138:0/2166388903 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1ce0049720 con 0x563741665710 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 0x7f1bd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 0x5637417eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637417ebd10 con 0x5637416f7db0 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.832+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 0x5637417eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 0x7f1bd4036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40ad000 tx=0x7f1ce40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 0x5637417eb7d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2166388903 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ce800a4d0 con 0x5637416f7db0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637417ec0d0 con 0x5637416f7db0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2166388903 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1ce800a4d0 con 0x5637416f7db0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637417ed980 con 0x5637416f7db0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2166388903 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1ce800a4d0 con 0x5637416f7db0 2024-02-16T10:30:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637417ecb80 con 0x5637416f7db0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2166388903 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1ce800a4d0 con 0x5637416f7db0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 0x5637417f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637417f1310 con 0x5637417ed4a0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 0x5637417f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 0x5637417f0d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cef5d1640 1 -- 172.21.15.138:0/2166388903 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1ce0014070 con 0x5637417ed4a0 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cf1ab6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563741595f20 con 0x5637417ff1d0 2024-02-16T10:30:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35678/0 (socket says 172.21.15.138:35678) 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.836+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1587851651 learned_addr learned my addr 172.21.15.138:0/1587851651 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1587851651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637417ffb30 con 0x5637417ff1d0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5637417e5bc0 tx=0x7f1ce80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 -- 172.21.15.138:0/1587851651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce801d070 con 0x5637417ff1d0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 -- 172.21.15.138:0/1587851651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8014580 con 0x5637417ff1d0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 -- 172.21.15.138:0/1587851651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce8014860 con 0x5637417ff1d0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5637417ffd80 con 0x5637417ff1d0 2024-02-16T10:30:44.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637418008d0 con 0x5637417ff1d0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 -- 172.21.15.138:0/1587851651 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ce8020020 con 0x5637417ff1d0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 0x7f1bc80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1bd9602640 1 -- 172.21.15.138:0/1587851651 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1ce804b160 con 0x5637417ff1d0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 0x7f1bc80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 0x7f1bc80367c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5637417ec5c0 tx=0x7f1ce0016ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cf1ab6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563741589790 con 0x56374180c130 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.840+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35690/0 (socket says 172.21.15.138:35690) 2024-02-16T10:30:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2281772678 learned_addr learned my addr 172.21.15.138:0/2281772678 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 -- 172.21.15.138:0/2281772678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56374180cb20 con 0x56374180c130 2024-02-16T10:30:44.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/2281772678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8049580 tx=0x7f1ce802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2ceb6f41768bb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd2ffd640 1 -- 172.21.15.138:0/2281772678 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce8016570 con 0x56374180c130 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd2ffd640 1 -- 172.21.15.138:0/2281772678 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce80149c0 con 0x56374180c130 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd2ffd640 1 -- 172.21.15.138:0/2281772678 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce80123a0 con 0x56374180c130 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2281772678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 msgr2=0x56374180c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2281772678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8049580 tx=0x7f1ce802bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2281772678 shutdown_connections 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2281772678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x56374180c550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2281772678 >> 172.21.15.138:0/2281772678 conn(0x563741806cb0 msgr2=0x563741807b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2281772678 shutdown_connections 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2281772678 wait complete. 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 Processor -- start 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- start start 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x563741812ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563741813400 con 0x56374180c130 2024-02-16T10:30:44.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x563741812ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x563741812ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35700/0 (socket says 172.21.15.138:35700) 2024-02-16T10:30:44.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 learned_addr learned my addr 172.21.15.138:0/1574008410 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637418008d0 con 0x56374180c130 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x563741812ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8048470 tx=0x7f1ce80494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd17fa640 1 -- 172.21.15.138:0/1574008410 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce8033070 con 0x56374180c130 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd17fa640 1 -- 172.21.15.138:0/1574008410 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce802b940 con 0x56374180c130 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563741813600 con 0x56374180c130 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.844+0000 7f1bd17fa640 1 -- 172.21.15.138:0/1574008410 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ce80133b0 con 0x56374180c130 2024-02-16T10:30:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563741813a30 con 0x56374180c130 2024-02-16T10:30:44.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1bd17fa640 1 -- 172.21.15.138:0/1574008410 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ce8013510 con 0x56374180c130 2024-02-16T10:30:44.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1bd17fa640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bb80342b0 0x7f1bb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1bd17fa640 1 -- 172.21.15.138:0/1574008410 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1ce804cca0 con 0x56374180c130 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bb80342b0 0x7f1bb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bb80342b0 0x7f1bb8036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000ef20 tx=0x7f1ce0016d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56374181e580 0x563741820a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741821190 con 0x56374181e580 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56374181e580 0x563741820a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56374181e580 0x563741820a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 realm 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741821580 con 0x56374181e580 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741821e00 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741822160 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.848+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741822960 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cf1ab6980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cf1ab6980 20 searching for the correct realm 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563741824810 0x563741826cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637418273a0 con 0x563741824810 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563741824810 0x563741826cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563741824810 0x563741826cd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce800a4d0 con 0x563741824810 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cefdd2640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1ce8014070 0x7f1ce803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce8014070 2024-02-16T10:30:44.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1ce8014070 0x7f1ce803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1ce8014070 0x7f1ce803b900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cef5d1640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ce0055040 0x7f1ce0049a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ce0055040 0x7f1ce0049a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ce0055040 0x7f1ce0049a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.852+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce8014070 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce800a4d0 con 0x563741824810 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce8014070 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.856+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce8014070 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.860+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce8014070 2024-02-16T10:30:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x563741824810 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x7f1ce0055040 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce8038030 con 0x56374181e580 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.864+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1ce40da080 con 0x7f1ce8014070 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741823160 con 0x56374181e580 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741823510 con 0x56374181e580 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741823510 con 0x7f1ce8014070 2024-02-16T10:30:44.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 zone default found 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 4 Realm: () 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 zonegroup default 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741823de0 con 0x7f1ce0055040 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741829240 con 0x563741824810 2024-02-16T10:30:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741829620 con 0x563741824810 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 started sync module instance, tier type = 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637418286d0 con 0x7f1ce8014070 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.868+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94795322262064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741829a40 con 0x7f1ce8014070 2024-02-16T10:30:44.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182a240 con 0x56374181e580 2024-02-16T10:30:44.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94795322269088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182a820 con 0x56374181e580 2024-02-16T10:30:44.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182b2f0 con 0x563741824810 2024-02-16T10:30:44.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.872+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94795322262064] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94795322269088] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94795322273232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182b2b0 con 0x563741824810 2024-02-16T10:30:44.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182a3f0 con 0x7f1ce8014070 2024-02-16T10:30:44.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94795322275488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182bf60 con 0x7f1ce8014070 2024-02-16T10:30:44.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182c980 con 0x56374181e580 2024-02-16T10:30:44.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.876+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94795322273232] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.880+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.880+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94795322279008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182cd30 con 0x56374181e580 2024-02-16T10:30:44.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.880+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182d6a0 con 0x7f1ce0055040 2024-02-16T10:30:44.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.880+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94795322275488] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.884+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94795322279008] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.884+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.884+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94795322264240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182d200 con 0x7f1ce0055040 2024-02-16T10:30:44.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.884+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182def0 con 0x7f1ce0055040 2024-02-16T10:30:44.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.884+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94795322264240] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94795322276544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182d200 con 0x7f1ce0055040 2024-02-16T10:30:44.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182e390 con 0x7f1ce0055040 2024-02-16T10:30:44.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94795322285808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182e7f0 con 0x7f1ce0055040 2024-02-16T10:30:44.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=0 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=1 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=2 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=3 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=4 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=5 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94795322276544] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.888+0000 7f1cf1ab6980 20 add_watcher() i=6 2024-02-16T10:30:44.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94795322285808] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 20 add_watcher() i=7 2024-02-16T10:30:44.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:44.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182da50 con 0x56374181e580 2024-02-16T10:30:44.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94795322286864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182da50 con 0x56374181e580 2024-02-16T10:30:44.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94795322286864] v31'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1ba5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:44.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:44.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.892+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741839e00 con 0x56374181e580 2024-02-16T10:30:44.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.896+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.896+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183a2c0 con 0x7f1ce0055040 2024-02-16T10:30:44.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.896+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.896+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183a760 con 0x563741824810 2024-02-16T10:30:44.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.900+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.900+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741837ed0 con 0x56374181e580 2024-02-16T10:30:44.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.904+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.904+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741837ed0 con 0x7f1ce8014070 2024-02-16T10:30:44.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.904+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.904+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183b940 con 0x563741824810 2024-02-16T10:30:44.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.908+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.908+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741836ec0 con 0x56374181e580 2024-02-16T10:30:44.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.908+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.908+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637418374d0 con 0x7f1ce0055040 2024-02-16T10:30:44.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.912+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.912+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5637418374d0 con 0x7f1ce8014070 2024-02-16T10:30:44.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.912+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.912+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c4b0 con 0x563741824810 2024-02-16T10:30:44.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.916+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.916+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x7f1ce8014070 2024-02-16T10:30:44.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.916+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.916+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x7f1ce0055040 2024-02-16T10:30:44.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.920+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.920+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x7f1ce8014070 2024-02-16T10:30:44.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.920+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.920+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x7f1ce0055040 2024-02-16T10:30:44.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.924+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.924+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x56374181e580 2024-02-16T10:30:44.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183c9e0 con 0x563741824810 2024-02-16T10:30:44.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce8014070 2024-02-16T10:30:44.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.928+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.932+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.932+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x56374181e580 2024-02-16T10:30:44.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.932+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.932+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x56374181e580 2024-02-16T10:30:44.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.936+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.936+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.936+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.936+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce8014070 2024-02-16T10:30:44.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.940+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.940+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.940+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.940+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.944+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.944+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.944+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.944+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.948+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.948+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce0055040 2024-02-16T10:30:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.948+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.948+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.952+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.952+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce0055040 2024-02-16T10:30:44.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.952+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.952+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x563741824810 2024-02-16T10:30:44.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.956+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.956+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce0055040 2024-02-16T10:30:44.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.960+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.960+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183cba0 con 0x7f1ce8014070 2024-02-16T10:30:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.960+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1ba4fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 20 Filter name: none 2024-02-16T10:30:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1b1e7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:30:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 20 rados->read ofs=0 len=0 2024-02-16T10:30:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183ad80 con 0x7f1ce0055040 2024-02-16T10:30:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T10:30:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:30:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:30:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1ba5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.964+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94795322286864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183ad80 con 0x56374181e580 2024-02-16T10:30:44.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94795322286864] v31'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94795322262064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374183a8e0 con 0x7f1ce8014070 2024-02-16T10:30:44.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94795322262064] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1cf1ab6980 20 remove_watcher() i=0 2024-02-16T10:30:44.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1cf1ab6980 2 removed watcher, disabling cache 2024-02-16T10:30:44.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.968+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94795322269088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741828230 con 0x56374181e580 2024-02-16T10:30:44.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94795322269088] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 20 remove_watcher() i=1 2024-02-16T10:30:44.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94795322273232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741828230 con 0x563741824810 2024-02-16T10:30:44.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cefdd2640 1 -- 172.21.15.138:0/1574008410 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94795322273232] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce805f040 con 0x563741824810 2024-02-16T10:30:44.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 20 remove_watcher() i=2 2024-02-16T10:30:44.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94795322275488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182add0 con 0x7f1ce8014070 2024-02-16T10:30:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cef5d1640 1 -- 172.21.15.138:0/1574008410 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94795322275488] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce0014070 con 0x7f1ce8014070 2024-02-16T10:30:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 20 remove_watcher() i=3 2024-02-16T10:30:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.972+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94795322279008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741828230 con 0x56374181e580 2024-02-16T10:30:44.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94795322279008] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x56374181e580 2024-02-16T10:30:44.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1cf1ab6980 20 remove_watcher() i=4 2024-02-16T10:30:44.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94795322264240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56374182b6a0 con 0x7f1ce0055040 2024-02-16T10:30:44.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94795322264240] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1cf1ab6980 20 remove_watcher() i=5 2024-02-16T10:30:44.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.976+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94795322276544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741828230 con 0x7f1ce0055040 2024-02-16T10:30:44.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.980+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94795322276544] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.980+0000 7f1cf1ab6980 20 remove_watcher() i=6 2024-02-16T10:30:44.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.980+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94795322285808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563741828230 con 0x7f1ce0055040 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.980+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94795322285808] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ce40ab810 con 0x7f1ce0055040 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.980+0000 7f1cf1ab6980 20 remove_watcher() i=7 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ce0055040 msgr2=0x7f1ce0049a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ce0055040 0x7f1ce0049a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56374181e580 msgr2=0x563741820a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56374181e580 0x563741820a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1ce8014070 msgr2=0x7f1ce803b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1ce8014070 0x7f1ce803b900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563741824810 msgr2=0x563741826cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563741824810 0x563741826cd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bb80342b0 msgr2=0x7f1bb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bb80342b0 0x7f1bb8036770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000ef20 tx=0x7f1ce0016d10 comp rx=0 tx=0).stop 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 msgr2=0x563741812ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1574008410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56374180c130 0x563741812ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8048470 tx=0x7f1ce80494e0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 reap_dead start 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1ceedd0640 1 -- 172.21.15.138:0/1574008410 reap_dead start 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 shutdown_connections 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 >> 172.21.15.138:0/1574008410 conn(0x563741806cb0 msgr2=0x563741807b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 shutdown_connections 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1574008410 wait complete. 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 msgr2=0x7f1bc80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 0x7f1bc80367c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5637417ec5c0 tx=0x7f1ce0016ca0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 msgr2=0x5637417ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5637417e5bc0 tx=0x7f1ce80188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 shutdown_connections 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bc8034300 0x7f1bc80367c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/1587851651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5637417ff1d0 0x5637417ff5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 >> 172.21.15.138:0/1587851651 conn(0x5637417f4010 msgr2=0x5637417f4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 shutdown_connections 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/1587851651 wait complete. 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 msgr2=0x5637417eb7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 0x5637417eb7d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 msgr2=0x5637417f0d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 0x5637417f0d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 msgr2=0x7f1bd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 0x7f1bd4036770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40ad000 tx=0x7f1ce40a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 msgr2=0x5637417e4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0001ee0 tx=0x7f1ce0000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 shutdown_connections 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5637417ed4a0 0x5637417f0d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5637416f7db0 0x5637417eb7d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1bd40342b0 0x7f1bd4036770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 --2- 172.21.15.138:0/2166388903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563741665710 0x5637417e4b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 >> 172.21.15.138:0/2166388903 conn(0x5637416ebd70 msgr2=0x5637417d7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 shutdown_connections 2024-02-16T10:30:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:44.984+0000 7f1cf1ab6980 1 -- 172.21.15.138:0/2166388903 wait complete. 2024-02-16T10:30:45.005 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:30:45.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:45.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:45.006 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:30:45.079 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:45.079 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601ae82980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5583e6f26cd0 0x5583e6f290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601ae82980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5583e6e6cb50 con 0x5583e6f227d0 2024-02-16T10:30:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601ae82980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5583e6e33d30 con 0x5583e6f26cd0 2024-02-16T10:30:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601819c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5583e6f26cd0 0x5583e6f290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601819c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5583e6f26cd0 0x5583e6f290c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35712/0 (socket says 172.21.15.138:35712) 2024-02-16T10:30:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601819c640 1 -- 172.21.15.138:0/3013958495 learned_addr learned my addr 172.21.15.138:0/3013958495 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601819c640 1 -- 172.21.15.138:0/3013958495 >> v1:172.21.15.107:6789/0 conn(0x5583e6f227d0 legacy=0x5583e6f22bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.072+0000 7f601819c640 1 -- 172.21.15.138:0/3013958495 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583e6f2a610 con 0x5583e6f26cd0 2024-02-16T10:30:45.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601819c640 1 --2- 172.21.15.138:0/3013958495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f26cd0 0x5583e6f290c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a5c0 tx=0x7f600c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d21b9620da70bc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601799b640 1 -- 172.21.15.138:0/3013958495 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f600c0aa470 con 0x5583e6f26cd0 2024-02-16T10:30:45.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601799b640 1 -- 172.21.15.138:0/3013958495 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c0aa5d0 con 0x5583e6f26cd0 2024-02-16T10:30:45.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601799b640 1 -- 172.21.15.138:0/3013958495 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f600c0aa890 con 0x5583e6f26cd0 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 -- 172.21.15.138:0/3013958495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f26cd0 msgr2=0x5583e6f290c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 --2- 172.21.15.138:0/3013958495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f26cd0 0x5583e6f290c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a5c0 tx=0x7f600c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 -- 172.21.15.138:0/3013958495 shutdown_connections 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 --2- 172.21.15.138:0/3013958495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f26cd0 0x5583e6f290c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 -- 172.21.15.138:0/3013958495 >> 172.21.15.138:0/3013958495 conn(0x5583e6e95ef0 msgr2=0x5583e6e96300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 -- 172.21.15.138:0/3013958495 shutdown_connections 2024-02-16T10:30:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.076+0000 7f601ae82980 1 -- 172.21.15.138:0/3013958495 wait complete. 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601ae82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601ae82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583e6e30fc0 con 0x5583e6f227d0 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601899d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601899d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35728/0 (socket says 172.21.15.138:35728) 2024-02-16T10:30:45.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601899d640 1 -- 172.21.15.138:0/3499686632 learned_addr learned my addr 172.21.15.138:0/3499686632 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601899d640 1 -- 172.21.15.138:0/3499686632 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c005df0 con 0x5583e6f227d0 2024-02-16T10:30:45.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.092+0000 7f601899d640 1 --2- 172.21.15.138:0/3499686632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6008001d60 tx=0x7f600800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941be3ca15a299db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f06e0d640 1 -- 172.21.15.138:0/3499686632 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6008014070 con 0x5583e6f227d0 2024-02-16T10:30:45.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f06e0d640 1 -- 172.21.15.138:0/3499686632 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600800f540 con 0x5583e6f227d0 2024-02-16T10:30:45.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f06e0d640 1 -- 172.21.15.138:0/3499686632 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f600800f820 con 0x5583e6f227d0 2024-02-16T10:30:45.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3499686632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 msgr2=0x5583e700c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 --2- 172.21.15.138:0/3499686632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6008001d60 tx=0x7f600800b5c0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3499686632 shutdown_connections 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 --2- 172.21.15.138:0/3499686632 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e700c850 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3499686632 >> 172.21.15.138:0/3499686632 conn(0x5583e6e95ef0 msgr2=0x5583e70083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3499686632 shutdown_connections 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3499686632 wait complete. 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583e6e2c7a0 con 0x5583e6f227d0 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601899d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601899d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35738/0 (socket says 172.21.15.138:35738) 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601899d640 1 -- 172.21.15.138:0/3872548484 learned_addr learned my addr 172.21.15.138:0/3872548484 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601899d640 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583e6e6cb50 con 0x5583e6f227d0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601899d640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f600800f510 tx=0x7f6008000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f0560a640 1 -- 172.21.15.138:0/3872548484 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6008014050 con 0x5583e6f227d0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f0560a640 1 -- 172.21.15.138:0/3872548484 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008001300 con 0x5583e6f227d0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583e7013d00 con 0x5583e6f227d0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f5f0560a640 1 -- 172.21.15.138:0/3872548484 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f600801bb20 con 0x5583e6f227d0 2024-02-16T10:30:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.096+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583e7014210 con 0x5583e6f227d0 2024-02-16T10:30:45.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f5f0560a640 1 -- 172.21.15.138:0/3872548484 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6008022020 con 0x5583e6f227d0 2024-02-16T10:30:45.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f5f0560a640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 0x7f5f00036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f5f0560a640 1 -- 172.21.15.138:0/3872548484 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6008048f40 con 0x5583e6f227d0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601819c640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 0x7f5f00036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 0x5583e701a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e701a9f0 con 0x5583e6f26cd0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 0x5583e701a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601819c640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 0x7f5f00036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f600c0ae000 tx=0x7f600c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 0x5583e701a4b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 -- 172.21.15.138:0/3872548484 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e6f26cd0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7017bb0 con 0x5583e6f26cd0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 -- 172.21.15.138:0/3872548484 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e6f26cd0 2024-02-16T10:30:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e701c6f0 con 0x5583e6f26cd0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 -- 172.21.15.138:0/3872548484 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e6f26cd0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e701b830 con 0x5583e6f26cd0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601919e640 1 -- 172.21.15.138:0/3872548484 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e6f26cd0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 0x5583e701fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7020040 con 0x5583e701c150 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601899d640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 0x5583e701fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601899d640 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 0x5583e701fa70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.100+0000 7f601899d640 1 -- 172.21.15.138:0/3872548484 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6008016070 con 0x5583e701c150 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583e6dc4f20 con 0x5583e702df90 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35740/0 (socket says 172.21.15.138:35740) 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601919e640 1 -- 172.21.15.138:0/3129950627 learned_addr learned my addr 172.21.15.138:0/3129950627 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601919e640 1 -- 172.21.15.138:0/3129950627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583e702e8f0 con 0x5583e702df90 2024-02-16T10:30:45.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601919e640 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5583e70148a0 tx=0x7f60100188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 -- 172.21.15.138:0/3129950627 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f601001d070 con 0x5583e702df90 2024-02-16T10:30:45.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 -- 172.21.15.138:0/3129950627 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010014580 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 -- 172.21.15.138:0/3129950627 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6010014860 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583e702eb40 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583e702f690 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 -- 172.21.15.138:0/3129950627 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6010020020 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 0x7f5ef0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f5efe7fc640 1 -- 172.21.15.138:0/3129950627 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f601004b1a0 con 0x5583e702df90 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.104+0000 7f601899d640 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 0x7f5ef0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601899d640 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 0x7f5ef0036770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5583e701b270 tx=0x7f60080016c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583e6db8790 con 0x5583e703af30 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35752/0 (socket says 172.21.15.138:35752) 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 -- 172.21.15.138:0/1363225711 learned_addr learned my addr 172.21.15.138:0/1363225711 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 -- 172.21.15.138:0/1363225711 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583e703b900 con 0x5583e703af30 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 --2- 172.21.15.138:0/1363225711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6010049590 tx=0x7f601002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460d5d3c1693f5cc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f5eeffff640 1 -- 172.21.15.138:0/1363225711 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f601003b280 con 0x5583e703af30 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f5eeffff640 1 -- 172.21.15.138:0/1363225711 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601003b050 con 0x5583e703af30 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f5eeffff640 1 -- 172.21.15.138:0/1363225711 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6010014b10 con 0x5583e703af30 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- 172.21.15.138:0/1363225711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 msgr2=0x5583e703b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 --2- 172.21.15.138:0/1363225711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6010049590 tx=0x7f601002bf20 comp rx=0 tx=0).stop 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- 172.21.15.138:0/1363225711 shutdown_connections 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 --2- 172.21.15.138:0/1363225711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e703b330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- 172.21.15.138:0/1363225711 >> 172.21.15.138:0/1363225711 conn(0x5583e7035ab0 msgr2=0x5583e7036990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- 172.21.15.138:0/1363225711 shutdown_connections 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- 172.21.15.138:0/1363225711 wait complete. 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 Processor -- start 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- start start 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601ae82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583e70421d0 con 0x5583e703af30 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35764/0 (socket says 172.21.15.138:35764) 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.108+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 learned_addr learned my addr 172.21.15.138:0/538220436 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583e702f690 con 0x5583e703af30 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601919e640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f601004b110 tx=0x7f6010049520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 -- 172.21.15.138:0/538220436 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f601002b920 con 0x5583e703af30 2024-02-16T10:30:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5583e70423d0 con 0x5583e703af30 2024-02-16T10:30:45.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 -- 172.21.15.138:0/538220436 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601003b280 con 0x5583e703af30 2024-02-16T10:30:45.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 -- 172.21.15.138:0/538220436 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60100125b0 con 0x5583e703af30 2024-02-16T10:30:45.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583e7042800 con 0x5583e703af30 2024-02-16T10:30:45.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 -- 172.21.15.138:0/538220436 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6010012710 con 0x5583e703af30 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ee4034300 0x7f5ee40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f5eee7fc640 1 -- 172.21.15.138:0/538220436 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6010038c50 con 0x5583e703af30 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601899d640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ee4034300 0x7f5ee40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e704d3f0 0x5583e704f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7050000 con 0x5583e704d3f0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601819c640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e704d3f0 0x5583e704f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601899d640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ee4034300 0x7f5ee40367c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5583e7020400 tx=0x7f600800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601819c640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e704d3f0 0x5583e704f8b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 realm 2024-02-16T10:30:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70503f0 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.112+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7050c70 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7050fd0 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70517d0 con 0x5583e704d3f0 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 20 searching for the correct realm 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5583e7053680 0x5583e7055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601919e640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5583e7053680 0x5583e7055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601919e640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5583e7053680 0x5583e7055b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e7053680 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601919e640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6010014070 0x7f6010043840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601899d640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6010014070 0x7f6010043840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601899d640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6010014070 0x7f6010043840 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601899d640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6008047b40 0x7f600802da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601819c640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6008047b40 0x7f600802da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.116+0000 7f601819c640 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6008047b40 0x7f600802da60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e7053680 2024-02-16T10:30:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.120+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e7053680 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f601000a4d0 con 0x5583e7053680 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.124+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e7053680 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6008047b40 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x5583e704d3f0 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.128+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056210 con 0x7f6010014070 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70520d0 con 0x5583e704d3f0 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7052920 con 0x5583e704d3f0 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7052920 con 0x7f6010014070 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 zone default found 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 4 Realm: () 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 zonegroup default 2024-02-16T10:30:45.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7056650 con 0x7f6008047b40 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70584d0 con 0x5583e7053680 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7058830 con 0x5583e7053680 2024-02-16T10:30:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 started sync module instance, tier type = 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.132+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7057a50 con 0x7f6010014070 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025004971440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7058830 con 0x7f6010014070 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70591e0 con 0x5583e704d3f0 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025004971440] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025004973616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7059590 con 0x5583e704d3f0 2024-02-16T10:30:45.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.136+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7059f00 con 0x5583e7053680 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025004973616] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025004977408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7059f00 con 0x5583e7053680 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705a930 con 0x7f6010014070 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025004983376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705a870 con 0x7f6010014070 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705b800 con 0x5583e704d3f0 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.140+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025004977408] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025004983376] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025004985568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705b800 con 0x5583e704d3f0 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705b460 con 0x7f6008047b40 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025004985568] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025004980832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705b460 con 0x7f6008047b40 2024-02-16T10:30:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.144+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705c5c0 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025004980832] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025004990624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705c580 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705cef0 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025004993104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705d310 con 0x7f6008047b40 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=0 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=1 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=2 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=3 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=4 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=5 2024-02-16T10:30:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025004990624] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.148+0000 7f601ae82980 20 add_watcher() i=6 2024-02-16T10:30:45.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025004993104] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 20 add_watcher() i=7 2024-02-16T10:30:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705d310 con 0x5583e704d3f0 2024-02-16T10:30:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025004994160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e705d290 con 0x5583e704d3f0 2024-02-16T10:30:45.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025004994160] v31'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f5ecefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.152+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7068920 con 0x5583e704d3f0 2024-02-16T10:30:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.156+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.156+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7068980 con 0x7f6008047b40 2024-02-16T10:30:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.156+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.156+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7069030 con 0x5583e7053680 2024-02-16T10:30:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7069560 con 0x5583e704d3f0 2024-02-16T10:30:45.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7069a90 con 0x7f6010014070 2024-02-16T10:30:45.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.160+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7069fc0 con 0x5583e7053680 2024-02-16T10:30:45.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.164+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.164+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706a4f0 con 0x5583e704d3f0 2024-02-16T10:30:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.164+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.164+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706a990 con 0x7f6008047b40 2024-02-16T10:30:45.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.168+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.168+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7069fc0 con 0x7f6010014070 2024-02-16T10:30:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.168+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.168+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ab60 con 0x5583e7053680 2024-02-16T10:30:45.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706b090 con 0x7f6010014070 2024-02-16T10:30:45.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706b5c0 con 0x7f6008047b40 2024-02-16T10:30:45.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.172+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6010014070 2024-02-16T10:30:45.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.176+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.176+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6008047b40 2024-02-16T10:30:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.176+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.176+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e704d3f0 2024-02-16T10:30:45.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.180+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.180+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.180+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.180+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6010014070 2024-02-16T10:30:45.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e704d3f0 2024-02-16T10:30:45.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.184+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e704d3f0 2024-02-16T10:30:45.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.188+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.188+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.188+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.188+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6010014070 2024-02-16T10:30:45.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.192+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.196+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.196+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.196+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.196+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6008047b40 2024-02-16T10:30:45.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6008047b40 2024-02-16T10:30:45.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.200+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x5583e7053680 2024-02-16T10:30:45.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.204+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.204+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6008047b40 2024-02-16T10:30:45.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e706ba60 con 0x7f6010014070 2024-02-16T10:30:45.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f5ecdfe3640 20 reqs_thread_entry: start 2024-02-16T10:30:45.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:45.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 20 Filter name: none 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f5e3f7fe640 20 reqs_thread_entry: start 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066990 con 0x7f6008047b40 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.208+0000 7f601ae82980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:30:45.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.212+0000 7f5ecefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.212+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025004994160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066990 con 0x5583e704d3f0 2024-02-16T10:30:45.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.212+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94025004994160] v31'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.212+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025004971440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066990 con 0x7f6010014070 2024-02-16T10:30:45.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94025004971440] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601ae82980 20 remove_watcher() i=0 2024-02-16T10:30:45.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601ae82980 2 removed watcher, disabling cache 2024-02-16T10:30:45.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025004973616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x5583e704d3f0 2024-02-16T10:30:45.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94025004973616] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601ae82980 20 remove_watcher() i=1 2024-02-16T10:30:45.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.216+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025004977408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x5583e7053680 2024-02-16T10:30:45.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601919e640 1 -- 172.21.15.138:0/538220436 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94025004977408] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6010060040 con 0x5583e7053680 2024-02-16T10:30:45.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601ae82980 20 remove_watcher() i=2 2024-02-16T10:30:45.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025004983376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x7f6010014070 2024-02-16T10:30:45.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601899d640 1 -- 172.21.15.138:0/538220436 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94025004983376] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6008016070 con 0x7f6010014070 2024-02-16T10:30:45.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601ae82980 20 remove_watcher() i=3 2024-02-16T10:30:45.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.220+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025004985568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x5583e704d3f0 2024-02-16T10:30:45.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94025004985568] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x5583e704d3f0 2024-02-16T10:30:45.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601ae82980 20 remove_watcher() i=4 2024-02-16T10:30:45.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025004980832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x7f6008047b40 2024-02-16T10:30:45.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94025004980832] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601ae82980 20 remove_watcher() i=5 2024-02-16T10:30:45.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.224+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025004990624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e7066960 con 0x7f6008047b40 2024-02-16T10:30:45.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94025004990624] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 20 remove_watcher() i=6 2024-02-16T10:30:45.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025004993104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583e70575b0 con 0x7f6008047b40 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94025004993104] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f600c0b0020 con 0x7f6008047b40 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 20 remove_watcher() i=7 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6008047b40 msgr2=0x7f600802da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6008047b40 0x7f600802da60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e704d3f0 msgr2=0x5583e704f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e704d3f0 0x5583e704f8b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6010014070 msgr2=0x7f6010043840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6010014070 0x7f6010043840 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5583e7053680 msgr2=0x5583e7055b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5583e7053680 0x5583e7055b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ee4034300 msgr2=0x7f5ee40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ee4034300 0x7f5ee40367c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5583e7020400 tx=0x7f600800a000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 msgr2=0x5583e7041c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f601004b110 tx=0x7f6010049520 comp rx=0 tx=0).stop 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601819c640 1 -- 172.21.15.138:0/538220436 reap_dead start 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 shutdown_connections 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/538220436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e703af30 0x5583e7041c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 >> 172.21.15.138:0/538220436 conn(0x5583e7035ab0 msgr2=0x5583e7036990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 shutdown_connections 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/538220436 wait complete. 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 msgr2=0x7f5ef0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 0x7f5ef0036770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5583e701b270 tx=0x7f60080016c0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 msgr2=0x5583e702e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5583e70148a0 tx=0x7f60100188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 shutdown_connections 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ef00342b0 0x7f5ef0036770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3129950627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e702df90 0x5583e702e3b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 >> 172.21.15.138:0/3129950627 conn(0x5583e7022da0 msgr2=0x5583e70238b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 shutdown_connections 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3129950627 wait complete. 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 msgr2=0x5583e701a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 0x5583e701a4b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 msgr2=0x5583e701fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 0x5583e701fa70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 msgr2=0x7f5f00036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 0x7f5f00036770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f600c0ae000 tx=0x7f600c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 msgr2=0x5583e70137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.228+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f600800f510 tx=0x7f6008000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 shutdown_connections 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5583e701c150 0x5583e701fa70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5583e6f26cd0 0x5583e701a4b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5f000342b0 0x7f5f00036770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 --2- 172.21.15.138:0/3872548484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5583e6f227d0 0x5583e70137c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 >> 172.21.15.138:0/3872548484 conn(0x5583e6e95ef0 msgr2=0x5583e7006ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 shutdown_connections 2024-02-16T10:30:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.232+0000 7f601ae82980 1 -- 172.21.15.138:0/3872548484 wait complete. 2024-02-16T10:30:45.249 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:30:45.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:30:45.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:30:45.249 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:30:45.321 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:45.322 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:45.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667d3e8980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5567db1ab4a0 0x5567db2391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667d3e8980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5567db182b50 con 0x5567db1ac7e0 2024-02-16T10:30:45.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667d3e8980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5567db149d30 con 0x5567db1ab4a0 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667af03640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5567db1ac7e0 0x5567db1aad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53226/0 (socket says 172.21.15.138:53226) 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667af03640 1 -- 172.21.15.138:0/3128721860 learned_addr learned my addr 172.21.15.138:0/3128721860 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667a702640 1 --2- 172.21.15.138:0/3128721860 >> v2:172.21.15.107:3300/0 conn(0x5567db1ab4a0 0x5567db2391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f6679f01640 1 -- 172.21.15.138:0/3128721860 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192863040 0 0) 0x5567db182b50 con 0x5567db1ac7e0 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f6679f01640 1 -- 172.21.15.138:0/3128721860 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6664001e20 con 0x5567db1ac7e0 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667a702640 1 -- 172.21.15.138:0/3128721860 >> v1:172.21.15.107:6789/0 conn(0x5567db1ac7e0 legacy=0x5567db1aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.316+0000 7f667a702640 1 -- 172.21.15.138:0/3128721860 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567db1ab8b0 con 0x5567db1ab4a0 2024-02-16T10:30:45.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667a702640 1 --2- 172.21.15.138:0/3128721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db2391d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f667000a480 tx=0x7f667001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599fe7c4bbd4307a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f6679f01640 1 -- 172.21.15.138:0/3128721860 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66700aa530 con 0x5567db1ab4a0 2024-02-16T10:30:45.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f6679f01640 1 -- 172.21.15.138:0/3128721860 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66700a6050 con 0x5567db1ab4a0 2024-02-16T10:30:45.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f6679f01640 1 -- 172.21.15.138:0/3128721860 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66700aa7c0 con 0x5567db1ab4a0 2024-02-16T10:30:45.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 -- 172.21.15.138:0/3128721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 msgr2=0x5567db2391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3128721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db2391d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f667000a480 tx=0x7f667001b280 comp rx=0 tx=0).stop 2024-02-16T10:30:45.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 -- 172.21.15.138:0/3128721860 shutdown_connections 2024-02-16T10:30:45.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3128721860 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db2391d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 -- 172.21.15.138:0/3128721860 >> 172.21.15.138:0/3128721860 conn(0x5567db231eb0 msgr2=0x5567db2342d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 -- 172.21.15.138:0/3128721860 shutdown_connections 2024-02-16T10:30:45.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.320+0000 7f667d3e8980 1 -- 172.21.15.138:0/3128721860 wait complete. 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567db146fc0 con 0x5567db1ab4a0 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667af03640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667af03640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35784/0 (socket says 172.21.15.138:35784) 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667af03640 1 -- 172.21.15.138:0/2135153850 learned_addr learned my addr 172.21.15.138:0/2135153850 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667af03640 1 -- 172.21.15.138:0/2135153850 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670005d30 con 0x5567db1ab4a0 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667af03640 1 --2- 172.21.15.138:0/2135153850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f666c001c30 tx=0x7f666c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0275e1ad08c6acf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f6568e09640 1 -- 172.21.15.138:0/2135153850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c00e690 con 0x5567db1ab4a0 2024-02-16T10:30:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f6568e09640 1 -- 172.21.15.138:0/2135153850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00e7f0 con 0x5567db1ab4a0 2024-02-16T10:30:45.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f6568e09640 1 -- 172.21.15.138:0/2135153850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c00eb50 con 0x5567db1ab4a0 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- 172.21.15.138:0/2135153850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 msgr2=0x5567db326d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2135153850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f666c001c30 tx=0x7f666c00b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- 172.21.15.138:0/2135153850 shutdown_connections 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2135153850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db326d70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- 172.21.15.138:0/2135153850 >> 172.21.15.138:0/2135153850 conn(0x5567db231eb0 msgr2=0x5567db322900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- 172.21.15.138:0/2135153850 shutdown_connections 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 -- 172.21.15.138:0/2135153850 wait complete. 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.336+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567db1427a0 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667af03640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667af03640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35788/0 (socket says 172.21.15.138:35788) 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667af03640 1 -- 172.21.15.138:0/2596656535 learned_addr learned my addr 172.21.15.138:0/2596656535 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667af03640 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664001e20 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667af03640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b710 tx=0x7f666c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 -- 172.21.15.138:0/2596656535 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c01f070 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 -- 172.21.15.138:0/2596656535 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c01a2e0 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567db32e2e0 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 -- 172.21.15.138:0/2596656535 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f666c01a820 con 0x5567db1ab4a0 2024-02-16T10:30:45.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567db32e790 con 0x5567db1ab4a0 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 -- 172.21.15.138:0/2596656535 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f666c00a040 con 0x5567db1ab4a0 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 0x7f6560036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f6567606640 1 -- 172.21.15.138:0/2596656535 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f666c049810 con 0x5567db1ab4a0 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667a702640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 0x7f6560036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 0x5567db334a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db334f80 con 0x5567db1ac7e0 2024-02-16T10:30:45.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667b704640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 0x5567db334a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667a702640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 0x7f6560036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66700ac000 tx=0x7f66700a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.340+0000 7f667b704640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 0x5567db334a40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/2596656535 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db335340 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/2596656535 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db336bf0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/2596656535 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db335df0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/2596656535 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db1ac7e0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 0x5567db339f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db33a580 con 0x5567db336710 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667af03640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 0x5567db339f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667af03640 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 0x5567db339f70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667af03640 1 -- 172.21.15.138:0/2596656535 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f666c014070 con 0x5567db336710 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667d3e8980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567db0daf20 con 0x5567db348480 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35794/0 (socket says 172.21.15.138:35794) 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/3203396232 learned_addr learned my addr 172.21.15.138:0/3203396232 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.344+0000 7f667b704640 1 -- 172.21.15.138:0/3203396232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567db348de0 con 0x5567db348480 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5567db32ee30 tx=0x7f66740188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 -- 172.21.15.138:0/3203396232 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667401d070 con 0x5567db348480 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 -- 172.21.15.138:0/3203396232 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674014580 con 0x5567db348480 2024-02-16T10:30:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567db349030 con 0x5567db348480 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 -- 172.21.15.138:0/3203396232 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6674014860 con 0x5567db348480 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567db349b80 con 0x5567db348480 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 -- 172.21.15.138:0/3203396232 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6674020020 con 0x5567db348480 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 0x7f6554036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f6564e01640 1 -- 172.21.15.138:0/3203396232 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f667404b180 con 0x5567db348480 2024-02-16T10:30:45.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667af03640 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 0x7f6554036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667af03640 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 0x7f6554036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f666c047cc0 tx=0x7f666c02d440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667d3e8980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567db0ce790 con 0x5567db355420 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35808/0 (socket says 172.21.15.138:35808) 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 -- 172.21.15.138:0/1344665635 learned_addr learned my addr 172.21.15.138:0/1344665635 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 -- 172.21.15.138:0/1344665635 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567db355e10 con 0x5567db355420 2024-02-16T10:30:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.348+0000 7f667b704640 1 --2- 172.21.15.138:0/1344665635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6674049570 tx=0x7f667402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28911d107bd2852e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655e7fc640 1 -- 172.21.15.138:0/1344665635 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667403f030 con 0x5567db355420 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655e7fc640 1 -- 172.21.15.138:0/1344665635 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66740165c0 con 0x5567db355420 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655e7fc640 1 -- 172.21.15.138:0/1344665635 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6674014b30 con 0x5567db355420 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/1344665635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 msgr2=0x5567db355840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 --2- 172.21.15.138:0/1344665635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6674049570 tx=0x7f667402bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/1344665635 shutdown_connections 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 --2- 172.21.15.138:0/1344665635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db355840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/1344665635 >> 172.21.15.138:0/1344665635 conn(0x5567db34ffa0 msgr2=0x5567db350e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/1344665635 shutdown_connections 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/1344665635 wait complete. 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 Processor -- start 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- start start 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567db35c680 con 0x5567db355420 2024-02-16T10:30:45.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667b704640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35818/0 (socket says 172.21.15.138:35818) 2024-02-16T10:30:45.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 learned_addr learned my addr 172.21.15.138:0/240406461 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567db349b80 con 0x5567db355420 2024-02-16T10:30:45.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667b704640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6674016750 tx=0x7f6674049500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655cff9640 1 -- 172.21.15.138:0/240406461 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66740482f0 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655cff9640 1 -- 172.21.15.138:0/240406461 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667402b960 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f655cff9640 1 -- 172.21.15.138:0/240406461 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6674022950 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567db35c880 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.352+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567db35ccb0 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f655cff9640 1 -- 172.21.15.138:0/240406461 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6674042070 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f655cff9640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65440342b0 0x7f6544036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f655cff9640 1 -- 172.21.15.138:0/240406461 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6674040070 con 0x5567db355420 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667af03640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65440342b0 0x7f6544036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db3678b0 0x5567db369d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36a4c0 con 0x5567db3678b0 2024-02-16T10:30:45.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db3678b0 0x5567db369d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667af03640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65440342b0 0x7f6544036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5567db33a940 tx=0x7f666c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db3678b0 0x5567db369d70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 realm 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36a8b0 con 0x5567db3678b0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36b100 con 0x5567db3678b0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36b460 con 0x5567db3678b0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36bc60 con 0x5567db3678b0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 20 searching for the correct realm 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5567db36db10 0x5567db36ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667b704640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5567db36db10 0x5567db36ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.356+0000 7f667b704640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5567db36db10 0x5567db36ffd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667b704640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6674014070 0x7f6674045a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f6674014070 2024-02-16T10:30:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667af03640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6674014070 0x7f6674045a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667af03640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6674014070 0x7f6674045a10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667af03640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f666c03a070 0x7f666c0414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f666c03a070 0x7f666c0414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f666c03a070 0x7f666c0414d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.360+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f6674014070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f6674014070 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.364+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f6674014070 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.368+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f6674014070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db36db10 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x7f666c03a070 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370650 con 0x5567db3678b0 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f66700da080 con 0x7f6674014070 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36c590 con 0x5567db3678b0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36cde0 con 0x5567db3678b0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db36cde0 con 0x7f6674014070 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 zone default found 2024-02-16T10:30:45.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 4 Realm: () 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 zonegroup default 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db370a90 con 0x7f666c03a070 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.372+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db372870 con 0x5567db36db10 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db372c50 con 0x5567db36db10 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 20 started sync module instance, tier type = 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db371d00 con 0x7f6674014070 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93904547813472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db372500 con 0x7f6674014070 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3736c0 con 0x5567db3678b0 2024-02-16T10:30:45.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.376+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93904547813472] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93904547815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db373aa0 con 0x5567db3678b0 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db374410 con 0x5567db36db10 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93904547823472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db374830 con 0x5567db36db10 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3752b0 con 0x7f6674014070 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93904547815520] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93904547827120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db375660 con 0x7f6674014070 2024-02-16T10:30:45.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.380+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db376030 con 0x5567db3678b0 2024-02-16T10:30:45.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93904547823472] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93904547830576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3763e0 con 0x5567db3678b0 2024-02-16T10:30:45.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db376d50 con 0x7f666c03a070 2024-02-16T10:30:45.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93904547827120] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93904547820000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db376d50 con 0x7f666c03a070 2024-02-16T10:30:45.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.384+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db377710 con 0x7f666c03a070 2024-02-16T10:30:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.388+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93904547830576] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.388+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.388+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93904547824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db377710 con 0x7f666c03a070 2024-02-16T10:30:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.388+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db377f50 con 0x7f666c03a070 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93904547820000] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93904547834032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db378130 con 0x7f666c03a070 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=0 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=1 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=2 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=3 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=4 2024-02-16T10:30:45.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=5 2024-02-16T10:30:45.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93904547824528] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93904547834032] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=6 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 20 add_watcher() i=7 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db37b050 con 0x5567db3678b0 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.392+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93904547837072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3784c0 con 0x5567db3678b0 2024-02-16T10:30:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.396+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93904547837072] v31'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.396+0000 7f65317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.396+0000 7f667d3e8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.396+0000 7f667d3e8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.396+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db383460 con 0x5567db3678b0 2024-02-16T10:30:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db383920 con 0x7f666c03a070 2024-02-16T10:30:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db383dc0 con 0x5567db36db10 2024-02-16T10:30:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.400+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db381490 con 0x5567db3678b0 2024-02-16T10:30:45.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db381490 con 0x7f6674014070 2024-02-16T10:30:45.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db384dd0 con 0x5567db36db10 2024-02-16T10:30:45.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.404+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382050 con 0x5567db3678b0 2024-02-16T10:30:45.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.408+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.408+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382050 con 0x7f666c03a070 2024-02-16T10:30:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.408+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.408+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382140 con 0x7f6674014070 2024-02-16T10:30:45.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.412+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.412+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382910 con 0x5567db36db10 2024-02-16T10:30:45.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.412+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.412+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382910 con 0x7f6674014070 2024-02-16T10:30:45.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.416+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.416+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3863d0 con 0x7f666c03a070 2024-02-16T10:30:45.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.416+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.416+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3863d0 con 0x7f6674014070 2024-02-16T10:30:45.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.420+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.420+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db3866a0 con 0x7f666c03a070 2024-02-16T10:30:45.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.420+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.420+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382910 con 0x5567db3678b0 2024-02-16T10:30:45.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382910 con 0x5567db36db10 2024-02-16T10:30:45.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382ae0 con 0x7f6674014070 2024-02-16T10:30:45.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.424+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382ae0 con 0x5567db36db10 2024-02-16T10:30:45.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.428+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.428+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382ae0 con 0x5567db3678b0 2024-02-16T10:30:45.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.428+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.428+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382ae0 con 0x5567db3678b0 2024-02-16T10:30:45.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382ae0 con 0x5567db36db10 2024-02-16T10:30:45.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x7f6674014070 2024-02-16T10:30:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.432+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.436+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x7f666c03a070 2024-02-16T10:30:45.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.440+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x7f666c03a070 2024-02-16T10:30:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.444+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.444+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x5567db36db10 2024-02-16T10:30:45.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.444+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.444+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x7f666c03a070 2024-02-16T10:30:45.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.448+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.448+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db382b00 con 0x7f6674014070 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f64abfff640 20 reqs_thread_entry: start 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 20 Filter name: none 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f64a9ffb640 20 reqs_thread_entry: start 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x5567db3678b0 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, user does not exist 2024-02-16T10:30:45.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f65317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93904547837072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x5567db3678b0 2024-02-16T10:30:45.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93904547837072] v31'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.452+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93904547813472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x7f6674014070 2024-02-16T10:30:45.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93904547813472] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667d3e8980 20 remove_watcher() i=0 2024-02-16T10:30:45.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667d3e8980 2 removed watcher, disabling cache 2024-02-16T10:30:45.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93904547815520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x5567db3678b0 2024-02-16T10:30:45.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93904547815520] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667d3e8980 20 remove_watcher() i=1 2024-02-16T10:30:45.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.456+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93904547823472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x5567db36db10 2024-02-16T10:30:45.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667b704640 1 -- 172.21.15.138:0/240406461 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93904547823472] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f667400a4d0 con 0x5567db36db10 2024-02-16T10:30:45.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667d3e8980 20 remove_watcher() i=2 2024-02-16T10:30:45.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93904547827120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x7f6674014070 2024-02-16T10:30:45.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667af03640 1 -- 172.21.15.138:0/240406461 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93904547827120] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f666c014070 con 0x7f6674014070 2024-02-16T10:30:45.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667d3e8980 20 remove_watcher() i=3 2024-02-16T10:30:45.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.460+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93904547830576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x5567db3678b0 2024-02-16T10:30:45.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93904547830576] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x5567db3678b0 2024-02-16T10:30:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667d3e8980 20 remove_watcher() i=4 2024-02-16T10:30:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93904547820000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x7f666c03a070 2024-02-16T10:30:45.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93904547820000] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667d3e8980 20 remove_watcher() i=5 2024-02-16T10:30:45.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.464+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93904547824528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x7f666c03a070 2024-02-16T10:30:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93904547824528] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 20 remove_watcher() i=6 2024-02-16T10:30:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93904547834032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5567db331c70 con 0x7f666c03a070 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93904547834032] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66700bd040 con 0x7f666c03a070 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 20 remove_watcher() i=7 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f666c03a070 msgr2=0x7f666c0414d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f666c03a070 0x7f666c0414d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db3678b0 msgr2=0x5567db369d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db3678b0 0x5567db369d70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6674014070 msgr2=0x7f6674045a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6674014070 0x7f6674045a10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5567db36db10 msgr2=0x5567db36ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5567db36db10 0x5567db36ffd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65440342b0 msgr2=0x7f6544036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65440342b0 0x7f6544036770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5567db33a940 tx=0x7f666c030000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 msgr2=0x5567db35c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667a702640 1 -- 172.21.15.138:0/240406461 reap_dead start 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6674016750 tx=0x7f6674049500 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 shutdown_connections 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/240406461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db355420 0x5567db35c140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 >> 172.21.15.138:0/240406461 conn(0x5567db34ffa0 msgr2=0x5567db350e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 shutdown_connections 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/240406461 wait complete. 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 msgr2=0x7f6554036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 0x7f6554036770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f666c047cc0 tx=0x7f666c02d440 comp rx=0 tx=0).stop 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 msgr2=0x5567db3488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5567db32ee30 tx=0x7f66740188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 shutdown_connections 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65540342b0 0x7f6554036770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 --2- 172.21.15.138:0/3203396232 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db348480 0x5567db3488a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 >> 172.21.15.138:0/3203396232 conn(0x5567db33d2c0 msgr2=0x5567db33ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 shutdown_connections 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.468+0000 7f667d3e8980 1 -- 172.21.15.138:0/3203396232 wait complete. 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 msgr2=0x5567db334a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 0x5567db334a40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 msgr2=0x5567db339f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 0x5567db339f70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 msgr2=0x7f6560036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 0x7f6560036770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66700ac000 tx=0x7f66700a5000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 msgr2=0x5567db32dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f666c00b710 tx=0x7f666c000bd0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 shutdown_connections 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5567db336710 0x5567db339f70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5567db1ac7e0 0x5567db334a40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f65600342b0 0x7f6560036770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 --2- 172.21.15.138:0/2596656535 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5567db1ab4a0 0x5567db32dda0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 >> 172.21.15.138:0/2596656535 conn(0x5567db231eb0 msgr2=0x5567db321410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 shutdown_connections 2024-02-16T10:30:45.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.472+0000 7f667d3e8980 1 -- 172.21.15.138:0/2596656535 wait complete. 2024-02-16T10:30:45.489 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-16T10:30:45.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:30:45.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:30:45.490 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T10:30:45.569 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:45.569 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:45.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.560+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.560+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ed00b980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562393594d10 0x562393597100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ed00b980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5623934daaf0 con 0x562393590c40 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ed00b980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5623934a1d30 con 0x562393594d10 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562393594d10 0x562393597100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x562393594d10 0x562393597100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35832/0 (socket says 172.21.15.138:35832) 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 -- 172.21.15.138:0/1135445350 learned_addr learned my addr 172.21.15.138:0/1135445350 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 -- 172.21.15.138:0/1135445350 >> v1:172.21.15.107:6789/0 conn(0x562393590c40 legacy=0x562393591020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 -- 172.21.15.138:0/1135445350 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562393598650 con 0x562393594d10 2024-02-16T10:30:45.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3ea325640 1 --2- 172.21.15.138:0/1135445350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393594d10 0x562393597100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000a5c0 tx=0x7ff3e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7ed274205cf2bc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3e9b24640 1 -- 172.21.15.138:0/1135445350 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e00aa470 con 0x562393594d10 2024-02-16T10:30:45.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3e9b24640 1 -- 172.21.15.138:0/1135445350 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00aa5d0 con 0x562393594d10 2024-02-16T10:30:45.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.564+0000 7ff3e9b24640 1 -- 172.21.15.138:0/1135445350 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e00aa890 con 0x562393594d10 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1135445350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393594d10 msgr2=0x562393597100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1135445350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393594d10 0x562393597100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000a5c0 tx=0x7ff3e001b340 comp rx=0 tx=0).stop 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1135445350 shutdown_connections 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1135445350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393594d10 0x562393597100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1135445350 >> 172.21.15.138:0/1135445350 conn(0x562393503f00 msgr2=0x562393504310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1135445350 shutdown_connections 2024-02-16T10:30:45.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.568+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1135445350 wait complete. 2024-02-16T10:30:45.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.580+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.580+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.580+0000 7ff3ed00b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.580+0000 7ff3ed00b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239349efc0 con 0x562393590c40 2024-02-16T10:30:45.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35838/0 (socket says 172.21.15.138:35838) 2024-02-16T10:30:45.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 -- 172.21.15.138:0/1596816572 learned_addr learned my addr 172.21.15.138:0/1596816572 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 -- 172.21.15.138:0/1596816572 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0005df0 con 0x562393590c40 2024-02-16T10:30:45.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- 172.21.15.138:0/1596816572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fb0 tx=0x7ff3e4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887d33d285b809e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff2d8e09640 1 -- 172.21.15.138:0/1596816572 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e400f640 con 0x562393590c40 2024-02-16T10:30:45.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff2d8e09640 1 -- 172.21.15.138:0/1596816572 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400f7c0 con 0x562393590c40 2024-02-16T10:30:45.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff2d8e09640 1 -- 172.21.15.138:0/1596816572 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e400fae0 con 0x562393590c40 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1596816572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 msgr2=0x56239367a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1596816572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fb0 tx=0x7ff3e4001940 comp rx=0 tx=0).stop 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1596816572 shutdown_connections 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1596816572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x56239367a930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1596816572 >> 172.21.15.138:0/1596816572 conn(0x562393503f00 msgr2=0x5623936764c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1596816572 shutdown_connections 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1596816572 wait complete. 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3ed00b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239349a7a0 con 0x562393590c40 2024-02-16T10:30:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35848/0 (socket says 172.21.15.138:35848) 2024-02-16T10:30:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 -- 172.21.15.138:0/3996934867 learned_addr learned my addr 172.21.15.138:0/3996934867 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623934daaf0 con 0x562393590c40 2024-02-16T10:30:45.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.584+0000 7ff3eab26640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56239367b7c0 tx=0x7ff3e4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 -- 172.21.15.138:0/3996934867 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e4005450 con 0x562393590c40 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 -- 172.21.15.138:0/3996934867 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e40055b0 con 0x562393590c40 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 -- 172.21.15.138:0/3996934867 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e40058b0 con 0x562393590c40 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562393681e00 con 0x562393590c40 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623936822b0 con 0x562393590c40 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562393432f20 con 0x56239368e970 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eb327640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eb327640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35860/0 (socket says 172.21.15.138:35860) 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eb327640 1 -- 172.21.15.138:0/4042449262 learned_addr learned my addr 172.21.15.138:0/4042449262 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 -- 172.21.15.138:0/3996934867 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3e4005b20 con 0x562393590c40 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eb327640 1 -- 172.21.15.138:0/4042449262 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56239368f2d0 con 0x56239368e970 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 0x7ff2d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d7606640 1 -- 172.21.15.138:0/3996934867 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3e4049210 con 0x562393590c40 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eab26640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 0x7ff2d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eb327640 1 --2- 172.21.15.138:0/4042449262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00a440 tx=0x7ff3dc00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e931506424682a3d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d5602640 1 -- 172.21.15.138:0/4042449262 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc008850 con 0x56239368e970 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d5602640 1 -- 172.21.15.138:0/4042449262 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0089d0 con 0x56239368e970 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff2d5602640 1 -- 172.21.15.138:0/4042449262 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc008cb0 con 0x56239368e970 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3eab26640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 0x7ff2d0036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3e401dfd0 tx=0x7ff3e4025ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/4042449262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 msgr2=0x56239368ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/4042449262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00a440 tx=0x7ff3dc00a900 comp rx=0 tx=0).stop 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/4042449262 shutdown_connections 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/4042449262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x56239368ed90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/4042449262 >> 172.21.15.138:0/4042449262 conn(0x562393594d10 msgr2=0x562393689de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/4042449262 shutdown_connections 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.588+0000 7ff3ed00b980 1 -- 172.21.15.138:0/4042449262 wait complete. 2024-02-16T10:30:45.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x562393426790 con 0x56239368e970 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35870/0 (socket says 172.21.15.138:35870) 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 -- 172.21.15.138:0/1677929992 learned_addr learned my addr 172.21.15.138:0/1677929992 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 -- 172.21.15.138:0/1677929992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc005cd0 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x56239368f750 tx=0x7ff3dc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 -- 172.21.15.138:0/1677929992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc013ad0 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562393695e80 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 -- 172.21.15.138:0/1677929992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc013c30 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 -- 172.21.15.138:0/1677929992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc01e420 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562393696310 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 -- 172.21.15.138:0/1677929992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3dc01e650 con 0x56239368e970 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:45.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 0x7ff2c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff2cf7fe640 1 -- 172.21.15.138:0/1677929992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3dc049910 con 0x56239368e970 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3eb327640 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 0x7ff2c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 Processor -- start 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.592+0000 7ff3ed00b980 1 -- start start 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623936afe50 con 0x5623936af4f0 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eb327640 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 0x7ff2c4036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc013fd0 tx=0x7ff3dc023f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eab26640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35884/0 (socket says 172.21.15.138:35884) 2024-02-16T10:30:45.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eab26640 1 -- 172.21.15.138:0/3537753862 learned_addr learned my addr 172.21.15.138:0/3537753862 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eab26640 1 -- 172.21.15.138:0/3537753862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623936aff90 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eab26640 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4047630 tx=0x7ff3e4018b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 -- 172.21.15.138:0/3537753862 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e4018dc0 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 -- 172.21.15.138:0/3537753862 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e4033070 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623936b08f0 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 -- 172.21.15.138:0/3537753862 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3e4019d80 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623936b0d20 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 -- 172.21.15.138:0/3537753862 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff3e4018350 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 0x7ff224036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2aaffd640 1 -- 172.21.15.138:0/3537753862 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff3e4035070 con 0x5623936af4f0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ea325640 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 0x7ff224036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff2a8ff9640 20 reqs_thread_entry: start 2024-02-16T10:30:45.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 0x5623936b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5623936b6e00 con 0x5623936b44d0 2024-02-16T10:30:45.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3ea325640 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 0x7ff224036720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.596+0000 7ff3eb327640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 0x5623936b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3eb327640 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 0x5623936b68c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3eb327640 1 -- 172.21.15.138:0/3996934867 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff3dc01dc30 con 0x5623936b44d0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5623936b8270 con 0x5623936b44d0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3eb327640 1 -- 172.21.15.138:0/3996934867 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff3dc01dc30 con 0x5623936b44d0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5623936bcd00 con 0x5623936b44d0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3eb327640 1 -- 172.21.15.138:0/3996934867 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [stat,call,call,writefull 0~875] v31'3 uv3 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7ff3dc01dc30 con 0x5623936b44d0 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 msgr2=0x7ff2c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 0x7ff2c4036770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc013fd0 tx=0x7ff3dc023f90 comp rx=0 tx=0).stop 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 msgr2=0x562393695940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x56239368f750 tx=0x7ff3dc003000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 shutdown_connections 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2c40342b0 0x7ff2c4036770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/1677929992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56239368e970 0x562393695940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 >> 172.21.15.138:0/1677929992 conn(0x562393594d10 msgr2=0x562393689950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 shutdown_connections 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/1677929992 wait complete. 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 msgr2=0x7ff224036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 0x7ff224036720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ae000 tx=0x7ff3e00a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 msgr2=0x5623936af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4047630 tx=0x7ff3e4018b30 comp rx=0 tx=0).stop 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 shutdown_connections 2024-02-16T10:30:45.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff224034260 0x7ff224036720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3537753862 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5623936af4f0 0x5623936af910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.600+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 >> 172.21.15.138:0/3537753862 conn(0x5623936a4310 msgr2=0x5623936a4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 shutdown_connections 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3537753862 wait complete. 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 msgr2=0x5623936b68c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 0x5623936b68c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 msgr2=0x7ff2d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 0x7ff2d0036770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3e401dfd0 tx=0x7ff3e4025ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 msgr2=0x5623936818c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56239367b7c0 tx=0x7ff3e4000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 shutdown_connections 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5623936b44d0 0x5623936b68c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff2d00342b0 0x7ff2d0036770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 --2- 172.21.15.138:0/3996934867 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562393590c40 0x5623936818c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 >> 172.21.15.138:0/3996934867 conn(0x562393503f00 msgr2=0x562393674fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 shutdown_connections 2024-02-16T10:30:45.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.604+0000 7ff3ed00b980 1 -- 172.21.15.138:0/3996934867 wait complete. 2024-02-16T10:30:45.621 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:30:45.621 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:30:45.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T10:30:45.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T10:30:45.623 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T10:30:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:45.689 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff97a016980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c0c76f7da0 0x55c0c76fa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff97a016980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c0c763db40 con 0x55c0c7665700 2024-02-16T10:30:45.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff97a016980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c0c7604d30 con 0x55c0c76f7da0 2024-02-16T10:30:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c0c76f7da0 0x55c0c76fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55c0c76f7da0 0x55c0c76fa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35896/0 (socket says 172.21.15.138:35896) 2024-02-16T10:30:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 -- 172.21.15.138:0/1699639131 learned_addr learned my addr 172.21.15.138:0/1699639131 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 -- 172.21.15.138:0/1699639131 >> v1:172.21.15.107:6789/0 conn(0x55c0c7665700 legacy=0x55c0c76f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 -- 172.21.15.138:0/1699639131 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c76fb6e0 con 0x55c0c76f7da0 2024-02-16T10:30:45.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.684+0000 7ff977330640 1 --2- 172.21.15.138:0/1699639131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c76f7da0 0x55c0c76fa190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00a5c0 tx=0x7ff96c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3e441924dc93d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff976b2f640 1 -- 172.21.15.138:0/1699639131 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff96c0aa470 con 0x55c0c76f7da0 2024-02-16T10:30:45.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff976b2f640 1 -- 172.21.15.138:0/1699639131 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c0aa5d0 con 0x55c0c76f7da0 2024-02-16T10:30:45.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff976b2f640 1 -- 172.21.15.138:0/1699639131 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff96c0aa890 con 0x55c0c76f7da0 2024-02-16T10:30:45.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 -- 172.21.15.138:0/1699639131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c76f7da0 msgr2=0x55c0c76fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 --2- 172.21.15.138:0/1699639131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c76f7da0 0x55c0c76fa190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00a5c0 tx=0x7ff96c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:45.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 -- 172.21.15.138:0/1699639131 shutdown_connections 2024-02-16T10:30:45.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 --2- 172.21.15.138:0/1699639131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c76f7da0 0x55c0c76fa190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 -- 172.21.15.138:0/1699639131 >> 172.21.15.138:0/1699639131 conn(0x55c0c76ebd60 msgr2=0x55c0c76ee180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 -- 172.21.15.138:0/1699639131 shutdown_connections 2024-02-16T10:30:45.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.688+0000 7ff97a016980 1 -- 172.21.15.138:0/1699639131 wait complete. 2024-02-16T10:30:45.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c7601fc0 con 0x55c0c7665700 2024-02-16T10:30:45.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35900/0 (socket says 172.21.15.138:35900) 2024-02-16T10:30:45.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 -- 172.21.15.138:0/2909744810 learned_addr learned my addr 172.21.15.138:0/2909744810 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 -- 172.21.15.138:0/2909744810 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c005df0 con 0x55c0c7665700 2024-02-16T10:30:45.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 --2- 172.21.15.138:0/2909744810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff968001d60 tx=0x7ff96800b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b958092020211034 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff865e0b640 1 -- 172.21.15.138:0/2909744810 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff968014070 con 0x55c0c7665700 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff865e0b640 1 -- 172.21.15.138:0/2909744810 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800f540 con 0x55c0c7665700 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff865e0b640 1 -- 172.21.15.138:0/2909744810 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff96800f820 con 0x55c0c7665700 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- 172.21.15.138:0/2909744810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 msgr2=0x55c0c77e46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 --2- 172.21.15.138:0/2909744810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff968001d60 tx=0x7ff96800b5c0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- 172.21.15.138:0/2909744810 shutdown_connections 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 --2- 172.21.15.138:0/2909744810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e46f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- 172.21.15.138:0/2909744810 >> 172.21.15.138:0/2909744810 conn(0x55c0c76ebd60 msgr2=0x55c0c76f27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- 172.21.15.138:0/2909744810 shutdown_connections 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- 172.21.15.138:0/2909744810 wait complete. 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff97a016980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c75fd7a0 con 0x55c0c7665700 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35902/0 (socket says 172.21.15.138:35902) 2024-02-16T10:30:45.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.704+0000 7ff977b31640 1 -- 172.21.15.138:0/2334102628 learned_addr learned my addr 172.21.15.138:0/2334102628 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff977b31640 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c763db40 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff977b31640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff96800f510 tx=0x7ff968000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 -- 172.21.15.138:0/2334102628 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff968014050 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 -- 172.21.15.138:0/2334102628 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff968001300 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0c77e9380 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 -- 172.21.15.138:0/2334102628 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff96801bb20 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0c77e9890 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 -- 172.21.15.138:0/2334102628 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff968022020 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 0x7ff860036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff85ffff640 1 -- 172.21.15.138:0/2334102628 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff968048f40 con 0x55c0c7665700 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff977330640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 0x7ff860036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 0x55c0c77efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c77f0020 con 0x55c0c76f7da0 2024-02-16T10:30:45.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff978332640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 0x55c0c77efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff977330640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 0x7ff860036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0ae000 tx=0x7ff96c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff978332640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 0x55c0c77efae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff978332640 1 -- 172.21.15.138:0/2334102628 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff97000a4d0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c77f0410 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff978332640 1 -- 172.21.15.138:0/2334102628 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff97000a4d0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.708+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c77f1cc0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 -- 172.21.15.138:0/2334102628 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff97000a4d0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c77f0ec0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 -- 172.21.15.138:0/2334102628 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff97000a4d0 con 0x55c0c76f7da0 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 0x55c0c77f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c77f5690 con 0x55c0c77f17e0 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff977b31640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 0x55c0c77f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff977b31640 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 0x55c0c77f5040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff977b31640 1 -- 172.21.15.138:0/2334102628 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff968016070 con 0x55c0c77f17e0 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c7595f20 con 0x55c0c78035c0 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35916/0 (socket says 172.21.15.138:35916) 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 -- 172.21.15.138:0/4197375422 learned_addr learned my addr 172.21.15.138:0/4197375422 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 -- 172.21.15.138:0/4197375422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c7803f20 con 0x55c0c78035c0 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff978332640 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55c0c77ea220 tx=0x7ff970018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff85d7fa640 1 -- 172.21.15.138:0/4197375422 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff97001d070 con 0x55c0c78035c0 2024-02-16T10:30:45.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff85d7fa640 1 -- 172.21.15.138:0/4197375422 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970014450 con 0x55c0c78035c0 2024-02-16T10:30:45.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0c7804170 con 0x55c0c78035c0 2024-02-16T10:30:45.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff85d7fa640 1 -- 172.21.15.138:0/4197375422 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff970014730 con 0x55c0c78035c0 2024-02-16T10:30:45.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.712+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0c7804cc0 con 0x55c0c78035c0 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff85d7fa640 1 -- 172.21.15.138:0/4197375422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff970020020 con 0x55c0c78035c0 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff85d7fa640 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 0x7ff8500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff85d7fa640 1 -- 172.21.15.138:0/4197375422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff97004b0b0 con 0x55c0c78035c0 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff977b31640 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 0x7ff8500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff977b31640 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 0x7ff8500367c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55c0c77f0900 tx=0x7ff9680016c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c7589790 con 0x55c0c7810520 2024-02-16T10:30:45.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35932/0 (socket says 172.21.15.138:35932) 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff978332640 1 -- 172.21.15.138:0/1770785608 learned_addr learned my addr 172.21.15.138:0/1770785608 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff978332640 1 -- 172.21.15.138:0/1770785608 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c7810ef0 con 0x55c0c7810520 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff978332640 1 --2- 172.21.15.138:0/1770785608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff97000e010 tx=0x7ff970014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a006db0644121312 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff856ffd640 1 -- 172.21.15.138:0/1770785608 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff97002b480 con 0x55c0c7810520 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff856ffd640 1 -- 172.21.15.138:0/1770785608 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970012560 con 0x55c0c7810520 2024-02-16T10:30:45.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff856ffd640 1 -- 172.21.15.138:0/1770785608 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff970012840 con 0x55c0c7810520 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- 172.21.15.138:0/1770785608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 msgr2=0x55c0c7810920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 --2- 172.21.15.138:0/1770785608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff97000e010 tx=0x7ff970014f90 comp rx=0 tx=0).stop 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- 172.21.15.138:0/1770785608 shutdown_connections 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 --2- 172.21.15.138:0/1770785608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7810920 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- 172.21.15.138:0/1770785608 >> 172.21.15.138:0/1770785608 conn(0x55c0c780b0a0 msgr2=0x55c0c780bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- 172.21.15.138:0/1770785608 shutdown_connections 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- 172.21.15.138:0/1770785608 wait complete. 2024-02-16T10:30:45.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 Processor -- start 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.716+0000 7ff97a016980 1 -- start start 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7817190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c78176d0 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7817190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff978332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7817190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35942/0 (socket says 172.21.15.138:35942) 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 learned_addr learned my addr 172.21.15.138:0/3397170003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c7804cc0 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff978332640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7817190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff970049560 tx=0x7ff970049430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 -- 172.21.15.138:0/3397170003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff970013940 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c0c78178d0 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 -- 172.21.15.138:0/3397170003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970013aa0 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 -- 172.21.15.138:0/3397170003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff970013dc0 con 0x55c0c7810520 2024-02-16T10:30:45.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0c7817d60 con 0x55c0c7810520 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 -- 172.21.15.138:0/3397170003 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff9700495e0 con 0x55c0c7810520 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8400342b0 0x7ff840036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff8557fa640 1 -- 172.21.15.138:0/3397170003 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff970038bc0 con 0x55c0c7810520 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff977b31640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8400342b0 0x7ff840036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c7822910 0x55c0c7824db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7825500 con 0x55c0c7822910 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff977330640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c7822910 0x55c0c7824db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff977b31640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8400342b0 0x7ff840036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff96801b620 tx=0x7ff96800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff977330640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c7822910 0x55c0c7824db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 20 realm 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.720+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78258f0 con 0x55c0c7822910 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7826140 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78264a0 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7825de0 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 20 searching for the correct realm 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55c0c78286f0 0x55c0c782ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff978332640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55c0c78286f0 0x55c0c782ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff978332640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55c0c78286f0 0x55c0c782ab40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff978332640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff970014070 0x7ff97003a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977b31640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff970014070 0x7ff97003a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977b31640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff970014070 0x7ff97003a870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977b31640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff968047b40 0x7ff96802da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff968047b40 0x7ff96802da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.724+0000 7ff977330640 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff968047b40 0x7ff96802da60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.728+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.732+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c78286f0 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff97005d040 con 0x55c0c78286f0 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff968047b40 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x55c0c7822910 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.736+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b210 con 0x7ff970014070 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:45.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7827300 con 0x55c0c7822910 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7826f80 con 0x55c0c7822910 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7827bd0 con 0x7ff970014070 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 zone default found 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 4 Realm: () 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 zonegroup default 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782b6a0 con 0x7ff968047b40 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782d520 con 0x55c0c78286f0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782d880 con 0x55c0c78286f0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 started sync module instance, tier type = 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:45.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782c960 con 0x7ff970014070 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94286469317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782d1b0 con 0x7ff970014070 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.740+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782e2c0 con 0x55c0c7822910 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.744+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94286469317824] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.744+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.744+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94286469324192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782e670 con 0x55c0c7822910 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.744+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782f020 con 0x55c0c78286f0 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94286469327680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782ef60 con 0x55c0c78286f0 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c782ff20 con 0x7ff970014070 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94286469324192] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94286469319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78302d0 con 0x7ff970014070 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7830c80 con 0x55c0c7822910 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94286469327680] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.748+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94286469319952] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94286469329872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78307a0 con 0x55c0c7822910 2024-02-16T10:30:45.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78314d0 con 0x7ff968047b40 2024-02-16T10:30:45.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94286469329872] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94286469331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7831190 con 0x7ff968047b40 2024-02-16T10:30:45.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.752+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7831990 con 0x7ff968047b40 2024-02-16T10:30:45.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94286469337968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7831db0 con 0x7ff968047b40 2024-02-16T10:30:45.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7832880 con 0x7ff968047b40 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94286469331472] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94286469342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7832840 con 0x7ff968047b40 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=0 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=1 2024-02-16T10:30:45.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=2 2024-02-16T10:30:45.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=3 2024-02-16T10:30:45.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=4 2024-02-16T10:30:45.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.756+0000 7ff97a016980 20 add_watcher() i=5 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94286469342048] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94286469337968] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 20 add_watcher() i=6 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 20 add_watcher() i=7 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:45.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7830cf0 con 0x55c0c7822910 2024-02-16T10:30:45.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94286469339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7830cf0 con 0x55c0c7822910 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94286469339216] v31'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff97a016980 5 note: GC not initialized 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.760+0000 7ff82cfe1640 20 reqs_thread_entry: start 2024-02-16T10:30:45.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:45.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 20 Filter name: none 2024-02-16T10:30:45.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff7a67fc640 20 reqs_thread_entry: start 2024-02-16T10:30:45.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7857ca0 con 0x55c0c7822910 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff970014070 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.764+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff970014070 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c78580a0 con 0x55c0c78286f0 2024-02-16T10:30:45.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.768+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff970014070 2024-02-16T10:30:45.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.772+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff968047b40 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.776+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.776+0000 7ff82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.776+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94286469339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x55c0c7822910 2024-02-16T10:30:45.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.776+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94286469339216] v31'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.776+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94286469317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858060 con 0x7ff970014070 2024-02-16T10:30:45.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94286469317824] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff97a016980 20 remove_watcher() i=0 2024-02-16T10:30:45.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff97a016980 2 removed watcher, disabling cache 2024-02-16T10:30:45.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94286469324192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x55c0c7822910 2024-02-16T10:30:45.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94286469324192] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff97a016980 20 remove_watcher() i=1 2024-02-16T10:30:45.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.780+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94286469327680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x55c0c78286f0 2024-02-16T10:30:45.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff978332640 1 -- 172.21.15.138:0/3397170003 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94286469327680] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff97006a040 con 0x55c0c78286f0 2024-02-16T10:30:45.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 20 remove_watcher() i=2 2024-02-16T10:30:45.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94286469319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x7ff970014070 2024-02-16T10:30:45.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff977b31640 1 -- 172.21.15.138:0/3397170003 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94286469319952] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff968016070 con 0x7ff970014070 2024-02-16T10:30:45.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 20 remove_watcher() i=3 2024-02-16T10:30:45.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94286469329872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x55c0c7822910 2024-02-16T10:30:45.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94286469329872] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x55c0c7822910 2024-02-16T10:30:45.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 20 remove_watcher() i=4 2024-02-16T10:30:45.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.784+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94286469331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x7ff968047b40 2024-02-16T10:30:45.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.788+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94286469331472] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.788+0000 7ff97a016980 20 remove_watcher() i=5 2024-02-16T10:30:45.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.788+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94286469337968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x7ff968047b40 2024-02-16T10:30:45.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94286469337968] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 20 remove_watcher() i=6 2024-02-16T10:30:45.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94286469342048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c0c7858040 con 0x7ff968047b40 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94286469342048] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff96c0b0020 con 0x7ff968047b40 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 20 remove_watcher() i=7 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff968047b40 msgr2=0x7ff96802da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff968047b40 0x7ff96802da60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c7822910 msgr2=0x55c0c7824db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c7822910 0x55c0c7824db0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff970014070 msgr2=0x7ff97003a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff970014070 0x7ff97003a870 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55c0c78286f0 msgr2=0x55c0c782ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55c0c78286f0 0x55c0c782ab40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8400342b0 msgr2=0x7ff840036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8400342b0 0x7ff840036770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff96801b620 tx=0x7ff96800a000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 msgr2=0x55c0c7817190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/3397170003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7810520 0x55c0c7817190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff970049560 tx=0x7ff970049430 comp rx=0 tx=0).stop 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 reap_dead start 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff977330640 1 -- 172.21.15.138:0/3397170003 reap_dead start 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 shutdown_connections 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 >> 172.21.15.138:0/3397170003 conn(0x55c0c780b0a0 msgr2=0x55c0c780bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 shutdown_connections 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/3397170003 wait complete. 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 msgr2=0x7ff8500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 0x7ff8500367c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55c0c77f0900 tx=0x7ff9680016c0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 msgr2=0x55c0c78039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55c0c77ea220 tx=0x7ff970018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 shutdown_connections 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff850034300 0x7ff8500367c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/4197375422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c78035c0 0x55c0c78039e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 >> 172.21.15.138:0/4197375422 conn(0x55c0c77f83d0 msgr2=0x55c0c77f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 shutdown_connections 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/4197375422 wait complete. 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 msgr2=0x55c0c77efae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 0x55c0c77efae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 msgr2=0x55c0c77f5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.792+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 0x55c0c77f5040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 msgr2=0x7ff860036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 0x7ff860036770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0ae000 tx=0x7ff96c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 msgr2=0x55c0c77e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff96800f510 tx=0x7ff968000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 shutdown_connections 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55c0c77f17e0 0x55c0c77f5040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55c0c76f7da0 0x55c0c77efae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff8600342b0 0x7ff860036770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 --2- 172.21.15.138:0/2334102628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55c0c7665700 0x55c0c77e8e40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 >> 172.21.15.138:0/2334102628 conn(0x55c0c76ebd60 msgr2=0x55c0c77d7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 shutdown_connections 2024-02-16T10:30:45.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.796+0000 7ff97a016980 1 -- 172.21.15.138:0/2334102628 wait complete. 2024-02-16T10:30:45.813 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[],"summary":[]} 2024-02-16T10:30:45.813 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T10:30:45.813 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:45.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:45.814 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:45.885 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:45.886 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:45.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb09824980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556001e125e0 0x556001e129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb09824980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556001d5eb50 con 0x556001e12f00 2024-02-16T10:30:45.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb09824980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x556001d25d30 con 0x556001e125e0 2024-02-16T10:30:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb0733f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556001e125e0 0x556001e129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb0733f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556001e125e0 0x556001e129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35958/0 (socket says 172.21.15.138:35958) 2024-02-16T10:30:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb0733f640 1 -- 172.21.15.138:0/2446189276 learned_addr learned my addr 172.21.15.138:0/2446189276 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb0733f640 1 -- 172.21.15.138:0/2446189276 >> v1:172.21.15.107:6789/0 conn(0x556001e12f00 legacy=0x556001e138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.880+0000 7ffb0733f640 1 -- 172.21.15.138:0/2446189276 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556001e140f0 con 0x556001e125e0 2024-02-16T10:30:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2446189276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001e129c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800a4e0 tx=0x7ffaf801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7009d9f7712cb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb0633d640 1 -- 172.21.15.138:0/2446189276 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80aa540 con 0x556001e125e0 2024-02-16T10:30:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb0633d640 1 -- 172.21.15.138:0/2446189276 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf80a6070 con 0x556001e125e0 2024-02-16T10:30:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb0633d640 1 -- 172.21.15.138:0/2446189276 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80aa850 con 0x556001e125e0 2024-02-16T10:30:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 -- 172.21.15.138:0/2446189276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 msgr2=0x556001e129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 --2- 172.21.15.138:0/2446189276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001e129c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800a4e0 tx=0x7ffaf801b090 comp rx=0 tx=0).stop 2024-02-16T10:30:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 -- 172.21.15.138:0/2446189276 shutdown_connections 2024-02-16T10:30:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 --2- 172.21.15.138:0/2446189276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001e129c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 -- 172.21.15.138:0/2446189276 >> 172.21.15.138:0/2446189276 conn(0x556001e0deb0 msgr2=0x556001e102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 -- 172.21.15.138:0/2446189276 shutdown_connections 2024-02-16T10:30:45.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.884+0000 7ffb09824980 1 -- 172.21.15.138:0/2446189276 wait complete. 2024-02-16T10:30:45.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb09824980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb09824980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556001d22fc0 con 0x556001e125e0 2024-02-16T10:30:45.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb0733f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb0733f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35964/0 (socket says 172.21.15.138:35964) 2024-02-16T10:30:45.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.900+0000 7ffb0733f640 1 -- 172.21.15.138:0/1654176126 learned_addr learned my addr 172.21.15.138:0/1654176126 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 -- 172.21.15.138:0/1654176126 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf800a1c0 con 0x556001e125e0 2024-02-16T10:30:45.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 --2- 172.21.15.138:0/1654176126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8019740 tx=0x7ffaf80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92a42d5466daf67 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ff9f560a640 1 -- 172.21.15.138:0/1654176126 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80aa6f0 con 0x556001e125e0 2024-02-16T10:30:45.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ff9f560a640 1 -- 172.21.15.138:0/1654176126 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf80aa850 con 0x556001e125e0 2024-02-16T10:30:45.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ff9f560a640 1 -- 172.21.15.138:0/1654176126 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80aaaf0 con 0x556001e125e0 2024-02-16T10:30:45.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- 172.21.15.138:0/1654176126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 msgr2=0x556001efcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 --2- 172.21.15.138:0/1654176126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8019740 tx=0x7ffaf80033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- 172.21.15.138:0/1654176126 shutdown_connections 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 --2- 172.21.15.138:0/1654176126 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001efcbc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- 172.21.15.138:0/1654176126 >> 172.21.15.138:0/1654176126 conn(0x556001e0deb0 msgr2=0x556001ef8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- 172.21.15.138:0/1654176126 shutdown_connections 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- 172.21.15.138:0/1654176126 wait complete. 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb09824980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556001d1e7a0 con 0x556001e125e0 2024-02-16T10:30:45.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35974/0 (socket says 172.21.15.138:35974) 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 -- 172.21.15.138:0/823437627 learned_addr learned my addr 172.21.15.138:0/823437627 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556001e140f0 con 0x556001e125e0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.904+0000 7ffb0733f640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8019740 tx=0x7ffaf8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 -- 172.21.15.138:0/823437627 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80c4070 con 0x556001e125e0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 -- 172.21.15.138:0/823437627 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf80b5570 con 0x556001e125e0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556001f03ed0 con 0x556001e125e0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 -- 172.21.15.138:0/823437627 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaf80b5810 con 0x556001e125e0 2024-02-16T10:30:45.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556001f04380 con 0x556001e125e0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 -- 172.21.15.138:0/823437627 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffaf80a8070 con 0x556001e125e0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 0x7ff9ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ff9f3e07640 1 -- 172.21.15.138:0/823437627 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ffaf80e3ce0 con 0x556001e125e0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 0x7ff9ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 0x556001f0a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f0abc0 con 0x556001e12f00 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 0x556001f0a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 0x7ff9ec036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000f70 tx=0x7ffaf0001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 0x556001f0a680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 -- 172.21.15.138:0/823437627 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb000083f0 con 0x556001e12f00 2024-02-16T10:30:45.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f07dc0 con 0x556001e12f00 2024-02-16T10:30:45.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 -- 172.21.15.138:0/823437627 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffb000083f0 con 0x556001e12f00 2024-02-16T10:30:45.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f0c8f0 con 0x556001e12f00 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 -- 172.21.15.138:0/823437627 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ffb000083f0 con 0x556001e12f00 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f0baf0 con 0x556001e12f00 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb07b40640 1 -- 172.21.15.138:0/823437627 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffb000083f0 con 0x556001e12f00 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 0x556001f0fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f10300 con 0x556001f0c410 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.908+0000 7ffb0733f640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 0x556001f0fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb0733f640 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 0x556001f0fc70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb0733f640 1 -- 172.21.15.138:0/823437627 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ffaf80b4a00 con 0x556001f0c410 2024-02-16T10:30:45.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556001cb6f20 con 0x556001d88990 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35976/0 (socket says 172.21.15.138:35976) 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb07b40640 1 -- 172.21.15.138:0/1119738391 learned_addr learned my addr 172.21.15.138:0/1119738391 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb07b40640 1 -- 172.21.15.138:0/1119738391 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556001d87370 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb07b40640 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x556001f04890 tx=0x7ffb0000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ff9f1602640 1 -- 172.21.15.138:0/1119738391 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb0000f040 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ff9f1602640 1 -- 172.21.15.138:0/1119738391 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0001a560 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556001d875c0 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ff9f1602640 1 -- 172.21.15.138:0/1119738391 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb0001a820 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556001d87a50 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.912+0000 7ff9f1602640 1 -- 172.21.15.138:0/1119738391 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb0001aa10 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ff9f1602640 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 0x7ff9e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ff9f1602640 1 -- 172.21.15.138:0/1119738391 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ffb0004be60 con 0x556001d88990 2024-02-16T10:30:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb0733f640 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 0x7ff9e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb0733f640 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 0x7ff9e0036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x556001f0b4d0 tx=0x7ffaf80d2440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556001caa790 con 0x556001f2d630 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35978/0 (socket says 172.21.15.138:35978) 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 -- 172.21.15.138:0/942502940 learned_addr learned my addr 172.21.15.138:0/942502940 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 -- 172.21.15.138:0/942502940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556001f2e020 con 0x556001f2d630 2024-02-16T10:30:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 --2- 172.21.15.138:0/942502940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb0004a280 tx=0x7ffb00018ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8669b87173f3baba server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ff9eaffd640 1 -- 172.21.15.138:0/942502940 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb0001ae40 con 0x556001f2d630 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ff9eaffd640 1 -- 172.21.15.138:0/942502940 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb000079a0 con 0x556001f2d630 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ff9eaffd640 1 -- 172.21.15.138:0/942502940 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb00007c40 con 0x556001f2d630 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- 172.21.15.138:0/942502940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 msgr2=0x556001f2da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 --2- 172.21.15.138:0/942502940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb0004a280 tx=0x7ffb00018ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- 172.21.15.138:0/942502940 shutdown_connections 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 --2- 172.21.15.138:0/942502940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f2da50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- 172.21.15.138:0/942502940 >> 172.21.15.138:0/942502940 conn(0x556001f281b0 msgr2=0x556001f29090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- 172.21.15.138:0/942502940 shutdown_connections 2024-02-16T10:30:45.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- 172.21.15.138:0/942502940 wait complete. 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 Processor -- start 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- start start 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb09824980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556001f348f0 con 0x556001f2d630 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35982/0 (socket says 172.21.15.138:35982) 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.916+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 learned_addr learned my addr 172.21.15.138:0/2870772304 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556001d87a50 con 0x556001f2d630 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb07b40640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb000074f0 tx=0x7ffb0004a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 -- 172.21.15.138:0/2870772304 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb00032030 con 0x556001f2d630 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556001f34af0 con 0x556001f2d630 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 -- 172.21.15.138:0/2870772304 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00024960 con 0x556001f2d630 2024-02-16T10:30:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 -- 172.21.15.138:0/2870772304 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb00035040 con 0x556001f2d630 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556001f34f20 con 0x556001f2d630 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 -- 172.21.15.138:0/2870772304 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb00045070 con 0x556001f2d630 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ff9e97fa640 1 -- 172.21.15.138:0/2870772304 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ffb00052c60 con 0x556001f2d630 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001f3fa10 0x556001f41ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f42620 con 0x556001f3fa10 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001f3fa10 0x556001f41ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80c7e20 tx=0x7ffaf80da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001f3fa10 0x556001f41ed0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 realm 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f3eef0 con 0x556001f3fa10 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f430a0 con 0x556001f3fa10 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.920+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f43920 con 0x556001f3fa10 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f43c80 con 0x556001f3fa10 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 20 searching for the correct realm 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556001f459a0 0x556001f47dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb07b40640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556001f459a0 0x556001f47dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb07b40640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556001f459a0 0x556001f47dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb07b40640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb00051020 0x7ffb00033120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffb00051020 2024-02-16T10:30:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb00051020 0x7ffb00033120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb00051020 0x7ffb00033120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb0733f640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffaf80a9c20 0x7ffaf80a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffaf80a9c20 0x7ffaf80a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.924+0000 7ffb06b3e640 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffaf80a9c20 0x7ffaf80a93c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f3fa10 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f3fa10 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffb00051020 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f3fa10 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f3fa10 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.928+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffb00051020 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f484a0 con 0x556001f459a0 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f3fa10 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f3fa10 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffaf80a9c20 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f459a0 2024-02-16T10:30:45.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.932+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffb00051020 2024-02-16T10:30:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f3fa10 2024-02-16T10:30:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffaf80a9c20 2024-02-16T10:30:45.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f459a0 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffaf80a9c20 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffb00051020 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f459a0 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffaf80a9c20 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x556001f3fa10 2024-02-16T10:30:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.936+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ffb0006a040 con 0x7ffb00051020 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f445e0 con 0x556001f3fa10 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f44260 con 0x556001f3fa10 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f44f30 con 0x7ffb00051020 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 zone default found 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 4 Realm: () 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:45.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 zonegroup default 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f48dd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4a870 con 0x556001f459a0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4ad20 con 0x556001f459a0 2024-02-16T10:30:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 started sync module instance, tier type = 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f49d80 con 0x7ffb00051020 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93870838028512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4b140 con 0x7ffb00051020 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.940+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4baf0 con 0x556001f3fa10 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.944+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93870838028512] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.944+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.944+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93870838030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4bed0 con 0x556001f3fa10 2024-02-16T10:30:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.944+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4c840 con 0x556001f459a0 2024-02-16T10:30:45.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.944+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93870838030704] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93870838035984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4c840 con 0x556001f459a0 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4d200 con 0x7ffb00051020 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93870838041952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4da50 con 0x7ffb00051020 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4e4d0 con 0x556001f3fa10 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93870838035984] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93870838041952] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93870838046672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4d5b0 con 0x556001f3fa10 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.948+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4ed50 con 0x7ffaf80a9c20 2024-02-16T10:30:45.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93870838046672] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93870838039456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4d5b0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4f240 con 0x7ffaf80a9c20 2024-02-16T10:30:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93870838039456] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93870838050080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4f200 con 0x7ffaf80a9c20 2024-02-16T10:30:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.952+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4fb70 con 0x7ffaf80a9c20 2024-02-16T10:30:45.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93870838050080] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93870838048448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f4fb70 con 0x7ffaf80a9c20 2024-02-16T10:30:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=0 2024-02-16T10:30:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=1 2024-02-16T10:30:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=2 2024-02-16T10:30:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=3 2024-02-16T10:30:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=4 2024-02-16T10:30:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=5 2024-02-16T10:30:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb09824980 20 add_watcher() i=6 2024-02-16T10:30:45.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.956+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93870838048448] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 add_watcher() i=7 2024-02-16T10:30:45.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:45.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f52f60 con 0x556001f3fa10 2024-02-16T10:30:45.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93870838053024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f50440 con 0x556001f3fa10 2024-02-16T10:30:45.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93870838053024] v31'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ff9bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 5 note: GC not initialized 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ff9bcfe1640 20 reqs_thread_entry: start 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 Filter name: none 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ff9367fc640 20 reqs_thread_entry: start 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 rados->read ofs=0 len=0 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f749c0 con 0x556001f3fa10 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:45.969 INFO:teuthology.orchestra.run.smithi138.stderr:could not fetch user info: no user info saved 2024-02-16T10:30:45.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ff9bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:45.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.960+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93870838053024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x556001f3fa10 2024-02-16T10:30:45.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93870838053024] v31'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93870838028512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x7ffb00051020 2024-02-16T10:30:45.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93870838028512] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 20 remove_watcher() i=0 2024-02-16T10:30:45.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 2 removed watcher, disabling cache 2024-02-16T10:30:45.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93870838030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x556001f3fa10 2024-02-16T10:30:45.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93870838030704] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 20 remove_watcher() i=1 2024-02-16T10:30:45.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.964+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93870838035984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x556001f459a0 2024-02-16T10:30:45.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb07b40640 1 -- 172.21.15.138:0/2870772304 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93870838035984] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb0004e070 con 0x556001f459a0 2024-02-16T10:30:45.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb09824980 20 remove_watcher() i=2 2024-02-16T10:30:45.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93870838041952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x7ffb00051020 2024-02-16T10:30:45.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb0733f640 1 -- 172.21.15.138:0/2870772304 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93870838041952] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf80e8050 con 0x7ffb00051020 2024-02-16T10:30:45.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb09824980 20 remove_watcher() i=3 2024-02-16T10:30:45.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.968+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93870838046672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x556001f3fa10 2024-02-16T10:30:45.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93870838046672] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x556001f3fa10 2024-02-16T10:30:45.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb09824980 20 remove_watcher() i=4 2024-02-16T10:30:45.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93870838039456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x7ffaf80a9c20 2024-02-16T10:30:45.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93870838039456] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb09824980 20 remove_watcher() i=5 2024-02-16T10:30:45.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.972+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93870838050080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x7ffaf80a9c20 2024-02-16T10:30:45.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93870838050080] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 20 remove_watcher() i=6 2024-02-16T10:30:45.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93870838048448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556001f74980 con 0x7ffaf80a9c20 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93870838048448] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaf000bdd0 con 0x7ffaf80a9c20 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 20 remove_watcher() i=7 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffaf80a9c20 msgr2=0x7ffaf80a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffaf80a9c20 0x7ffaf80a93c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001f3fa10 msgr2=0x556001f41ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001f3fa10 0x556001f41ed0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb00051020 msgr2=0x7ffb00033120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb00051020 0x7ffb00033120 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556001f459a0 msgr2=0x556001f47dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556001f459a0 0x556001f47dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 msgr2=0x7ff9d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80c7e20 tx=0x7ffaf80da000 comp rx=0 tx=0).stop 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 msgr2=0x556001f343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb06b3e640 1 -- 172.21.15.138:0/2870772304 reap_dead start 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb000074f0 tx=0x7ffb0004a1e0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 shutdown_connections 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/2870772304 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001f2d630 0x556001f343b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 >> 172.21.15.138:0/2870772304 conn(0x556001f281b0 msgr2=0x556001f29090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 shutdown_connections 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/2870772304 wait complete. 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 msgr2=0x7ff9e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 0x7ff9e0036770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x556001f0b4d0 tx=0x7ffaf80d2440 comp rx=0 tx=0).stop 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 msgr2=0x556001d86e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x556001f04890 tx=0x7ffb0000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 shutdown_connections 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9e00342b0 0x7ff9e0036770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/1119738391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001d88990 0x556001d86e30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 >> 172.21.15.138:0/1119738391 conn(0x556001f130b0 msgr2=0x556001f13bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 shutdown_connections 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/1119738391 wait complete. 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 msgr2=0x556001f0a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 0x556001f0a680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 msgr2=0x556001f0fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 0x556001f0fc70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 msgr2=0x7ff9ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 0x7ff9ec036770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000f70 tx=0x7ffaf0001420 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 msgr2=0x556001f03990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8019740 tx=0x7ffaf8017e30 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 shutdown_connections 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556001f0c410 0x556001f0fc70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556001e12f00 0x556001f0a680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9ec0342b0 0x7ff9ec036770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 --2- 172.21.15.138:0/823437627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556001e125e0 0x556001f03990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 >> 172.21.15.138:0/823437627 conn(0x556001e0deb0 msgr2=0x556001ef7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 shutdown_connections 2024-02-16T10:30:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:45.976+0000 7ffb09824980 1 -- 172.21.15.138:0/823437627 wait complete. 2024-02-16T10:30:45.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T10:30:45.995 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T10:30:45.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-02-16T10:30:45.995 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-02-16T10:30:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.068+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.068+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf8b18980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557eb020abf0 0x557eb020afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf8b18980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557eb0156af0 con 0x557eb020b510 2024-02-16T10:30:46.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf8b18980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x557eb011dd30 con 0x557eb020abf0 2024-02-16T10:30:46.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf6633640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557eb020abf0 0x557eb020afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf5e32640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x557eb020b510 0x557eb0211e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53260/0 (socket says 172.21.15.138:53260) 2024-02-16T10:30:46.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf6633640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557eb020abf0 0x557eb020afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35984/0 (socket says 172.21.15.138:35984) 2024-02-16T10:30:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf5e32640 1 -- 172.21.15.138:0/3914899052 learned_addr learned my addr 172.21.15.138:0/3914899052 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf6633640 1 -- 172.21.15.138:0/3914899052 >> v1:172.21.15.107:6789/0 conn(0x557eb020b510 legacy=0x557eb0211e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.072+0000 7febf6633640 1 -- 172.21.15.138:0/3914899052 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eb02145c0 con 0x557eb020abf0 2024-02-16T10:30:46.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf6633640 1 --2- 172.21.15.138:0/3914899052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb020afd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febec00a4b0 tx=0x7febec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40a1090b165c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf5631640 1 -- 172.21.15.138:0/3914899052 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0ab540 con 0x557eb020abf0 2024-02-16T10:30:46.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf5631640 1 -- 172.21.15.138:0/3914899052 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0ab6a0 con 0x557eb020abf0 2024-02-16T10:30:46.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf5631640 1 -- 172.21.15.138:0/3914899052 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0ab960 con 0x557eb020abf0 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 -- 172.21.15.138:0/3914899052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 msgr2=0x557eb020afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 --2- 172.21.15.138:0/3914899052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb020afd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7febec00a4b0 tx=0x7febec01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 -- 172.21.15.138:0/3914899052 shutdown_connections 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 --2- 172.21.15.138:0/3914899052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb020afd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 -- 172.21.15.138:0/3914899052 >> 172.21.15.138:0/3914899052 conn(0x557eb0204490 msgr2=0x557eb02068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 -- 172.21.15.138:0/3914899052 shutdown_connections 2024-02-16T10:30:46.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.076+0000 7febf8b18980 1 -- 172.21.15.138:0/3914899052 wait complete. 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.088+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.088+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.088+0000 7febf8b18980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.088+0000 7febf8b18980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eb011afc0 con 0x557eb020abf0 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.088+0000 7febf6633640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:35988/0 (socket says 172.21.15.138:35988) 2024-02-16T10:30:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 -- 172.21.15.138:0/2225393273 learned_addr learned my addr 172.21.15.138:0/2225393273 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 -- 172.21.15.138:0/2225393273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec005d30 con 0x557eb020abf0 2024-02-16T10:30:46.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 --2- 172.21.15.138:0/2225393273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febec017e90 tx=0x7febec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a139c081284954e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7feae4608640 1 -- 172.21.15.138:0/2225393273 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0ab810 con 0x557eb020abf0 2024-02-16T10:30:46.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7feae4608640 1 -- 172.21.15.138:0/2225393273 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0ab970 con 0x557eb020abf0 2024-02-16T10:30:46.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7feae4608640 1 -- 172.21.15.138:0/2225393273 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0abc10 con 0x557eb020abf0 2024-02-16T10:30:46.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- 172.21.15.138:0/2225393273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 msgr2=0x557eb02f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 --2- 172.21.15.138:0/2225393273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febec017e90 tx=0x7febec003030 comp rx=0 tx=0).stop 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- 172.21.15.138:0/2225393273 shutdown_connections 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 --2- 172.21.15.138:0/2225393273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02f6920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- 172.21.15.138:0/2225393273 >> 172.21.15.138:0/2225393273 conn(0x557eb0204490 msgr2=0x557eb02f24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- 172.21.15.138:0/2225393273 shutdown_connections 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- 172.21.15.138:0/2225393273 wait complete. 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf8b18980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eb01167a0 con 0x557eb020abf0 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36000/0 (socket says 172.21.15.138:36000) 2024-02-16T10:30:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 -- 172.21.15.138:0/1169549443 learned_addr learned my addr 172.21.15.138:0/1169549443 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eb02145c0 con 0x557eb020abf0 2024-02-16T10:30:46.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7febf6633640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7febec005880 tx=0x7febec018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.092+0000 7feae2e05640 1 -- 172.21.15.138:0/1169549443 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0b5da0 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557eb02fdbd0 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7feae2e05640 1 -- 172.21.15.138:0/1169549443 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec0c7420 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7feae2e05640 1 -- 172.21.15.138:0/1169549443 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec0c76c0 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557eb02fe0e0 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7feae2e05640 1 -- 172.21.15.138:0/1169549443 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febec0c4020 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7feae2e05640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 0x7feadc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7feae2e05640 1 -- 172.21.15.138:0/1169549443 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febec0e3dc0 con 0x557eb020abf0 2024-02-16T10:30:46.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf5e32640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 0x7feadc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 0x557eb0304380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03048c0 con 0x557eb020b510 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 0x557eb0304380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 0x557eb0304380 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf5e32640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 0x7feadc0367c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe8000f70 tx=0x7febe80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 -- 172.21.15.138:0/1169549443 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb020b510 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0301ab0 con 0x557eb020b510 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 -- 172.21.15.138:0/1169549443 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb020b510 2024-02-16T10:30:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03065c0 con 0x557eb020b510 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 -- 172.21.15.138:0/1169549443 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb020b510 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03057c0 con 0x557eb020b510 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf6e34640 1 -- 172.21.15.138:0/1169549443 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb020b510 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 0x557eb0309940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.096+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0309f50 con 0x557eb03060e0 2024-02-16T10:30:46.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6633640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 0x557eb0309940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6633640 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 0x557eb0309940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6633640 1 -- 172.21.15.138:0/1169549443 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7febec0c69f0 con 0x557eb03060e0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eb00aef20 con 0x557eb0317ea0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36012/0 (socket says 172.21.15.138:36012) 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6e34640 1 -- 172.21.15.138:0/1885850273 learned_addr learned my addr 172.21.15.138:0/1885850273 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6e34640 1 -- 172.21.15.138:0/1885850273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eb0318800 con 0x557eb0317ea0 2024-02-16T10:30:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf6e34640 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557eb02fe8e0 tx=0x7febf00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7feadbfff640 1 -- 172.21.15.138:0/1885850273 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf001d070 con 0x557eb0317ea0 2024-02-16T10:30:46.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7feadbfff640 1 -- 172.21.15.138:0/1885850273 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0014450 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557eb0318a50 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7feadbfff640 1 -- 172.21.15.138:0/1885850273 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf0014730 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557eb03195a0 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.100+0000 7feadbfff640 1 -- 172.21.15.138:0/1885850273 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febf0020020 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7feadbfff640 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 0x7fead0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7feadbfff640 1 -- 172.21.15.138:0/1885850273 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febf004b0a0 con 0x557eb0317ea0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6633640 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 0x7fead0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6633640 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 0x7fead0036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x557eb0305200 tx=0x7febec0e2080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eb00a2790 con 0x557eb0324df0 2024-02-16T10:30:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36022/0 (socket says 172.21.15.138:36022) 2024-02-16T10:30:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 -- 172.21.15.138:0/1444492551 learned_addr learned my addr 172.21.15.138:0/1444492551 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 -- 172.21.15.138:0/1444492551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eb03257a0 con 0x557eb0324df0 2024-02-16T10:30:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 --2- 172.21.15.138:0/1444492551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7febf0018430 tx=0x7febf0012ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b879fd03c06319 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7fead9ffb640 1 -- 172.21.15.138:0/1444492551 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf00149c0 con 0x557eb0324df0 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7fead9ffb640 1 -- 172.21.15.138:0/1444492551 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf002b350 con 0x557eb0324df0 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7fead9ffb640 1 -- 172.21.15.138:0/1444492551 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf00133b0 con 0x557eb0324df0 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- 172.21.15.138:0/1444492551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 msgr2=0x557eb03251d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 --2- 172.21.15.138:0/1444492551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7febf0018430 tx=0x7febf0012ec0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- 172.21.15.138:0/1444492551 shutdown_connections 2024-02-16T10:30:46.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 --2- 172.21.15.138:0/1444492551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb03251d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- 172.21.15.138:0/1444492551 >> 172.21.15.138:0/1444492551 conn(0x557eb031f9c0 msgr2=0x557eb03208a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- 172.21.15.138:0/1444492551 shutdown_connections 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- 172.21.15.138:0/1444492551 wait complete. 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 Processor -- start 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- start start 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf8b18980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557eb032c0b0 con 0x557eb0324df0 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36028/0 (socket says 172.21.15.138:36028) 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 learned_addr learned my addr 172.21.15.138:0/4070490460 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.104+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557eb03195a0 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf6e34640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febf003b070 tx=0x7febf0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 -- 172.21.15.138:0/4070490460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf0034040 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557eb032c2b0 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 -- 172.21.15.138:0/4070490460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf002bd50 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 -- 172.21.15.138:0/4070490460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febf0013910 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557eb032c740 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 -- 172.21.15.138:0/4070490460 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7febf0013a70 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feac0034300 0x7feac00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7feac7fff640 1 -- 172.21.15.138:0/4070490460 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7febf0041020 con 0x557eb0324df0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb0337290 0x557eb0339750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0339ea0 con 0x557eb0337290 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf6633640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feac0034300 0x7feac00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb0337290 0x557eb0339750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf6633640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feac0034300 0x7feac00367c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febec0aa800 tx=0x7febec0d6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb0337290 0x557eb0339750 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 realm 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0336770 con 0x557eb0337290 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb033a920 con 0x557eb0337290 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb033b1a0 con 0x557eb0337290 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.108+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb033b500 con 0x557eb0337290 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf8b18980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf8b18980 20 searching for the correct realm 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557eb033d5e0 0x557eb033faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x557eb033d5e0 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6e34640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557eb033d5e0 0x557eb033faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6e34640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557eb033d5e0 0x557eb033faa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6e34640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7febf0014070 0x7febf0045070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x7febf0014070 2024-02-16T10:30:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6633640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7febf0014070 0x7febf0045070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6633640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7febf0014070 0x7febf0045070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febec0c69f0 con 0x7febf0014070 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6633640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7febec0ab030 0x7febec0e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x7febec0ab030 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7febec0ab030 0x7febec0e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7febec0ab030 0x7febec0e2a10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x557eb0337290 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x557eb0337290 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.112+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x7febec0ab030 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340120 con 0x7febec0ab030 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febf0014070 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febf0014070 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.116+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febf0014070 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.120+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febf0014070 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb033d5e0 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x557eb0337290 2024-02-16T10:30:46.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7febe802b040 con 0x7febf0014070 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb033cbb0 con 0x557eb0337290 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb033c3d0 con 0x557eb0337290 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0340560 con 0x7febf0014070 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 zone default found 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 4 Realm: () 2024-02-16T10:30:46.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 zonegroup default 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03408c0 con 0x7febec0ab030 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0342680 con 0x557eb033d5e0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0342a10 con 0x557eb033d5e0 2024-02-16T10:30:46.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 started sync module instance, tier type = 2024-02-16T10:30:46.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:46.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.124+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0341b10 con 0x7febf0014070 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002610443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0342310 con 0x7febf0014070 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0343480 con 0x557eb0337290 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002610443888] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002610450304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0343830 con 0x557eb0337290 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.128+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03441e0 con 0x557eb033d5e0 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002610450304] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002610445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03441a0 con 0x557eb033d5e0 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0344ba0 con 0x7febf0014070 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002610456320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0344b20 con 0x7febf0014070 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0345a80 con 0x557eb0337290 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002610456320] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.132+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002610445936] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002610453760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0345a40 con 0x557eb0337290 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03462d0 con 0x7febec0ab030 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002610453760] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002610460000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0345ee0 con 0x7febec0ab030 2024-02-16T10:30:46.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.136+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0346850 con 0x7febec0ab030 2024-02-16T10:30:46.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002610460000] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002610461520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0346850 con 0x7febec0ab030 2024-02-16T10:30:46.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03470d0 con 0x7febec0ab030 2024-02-16T10:30:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002610464848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0347750 con 0x7febec0ab030 2024-02-16T10:30:46.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=0 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=1 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=2 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=3 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=4 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=5 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002610461520] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.140+0000 7febf8b18980 20 add_watcher() i=6 2024-02-16T10:30:46.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002610464848] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 add_watcher() i=7 2024-02-16T10:30:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb034a670 con 0x557eb0337290 2024-02-16T10:30:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002610467232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb0347a90 con 0x557eb0337290 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002610467232] v31'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7feaacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 5 note: GC not initialized 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7fea277fe640 20 reqs_thread_entry: start 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 Filter name: none 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7fea257fa640 20 reqs_thread_entry: start 2024-02-16T10:30:46.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c4d0 con 0x557eb0337290 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-02-16T10:30:46.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c4d0 con 0x557eb0337290 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-02-16T10:30:46.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.144+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036ad00 con 0x7febec0ab030 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-02-16T10:30:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036b1d0 con 0x557eb0337290 2024-02-16T10:30:46.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~358] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94002610618160 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036f8d0 con 0x557eb0337290 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94002610453760 notify 133143986176 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7febe8035040 con 0x557eb0337290 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7fead9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94002610453760 notifier 4290 bl.length()=534 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7fead9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7fead9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7fead9ffb640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7feabc003ea0 con 0x557eb0337290 2024-02-16T10:30:46.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(66 notify.4 [notify cookie 94002610618160 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94002610618160 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557eb0156af0 con 0x557eb0337290 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.148+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036bf30 con 0x557eb0337290 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf8b18980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf8b18980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94002610618160 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036f8d0 con 0x7febf0014070 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== watch-notify(notify (1) cookie 94002610456320 notify 133143986176 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7febec101040 con 0x7febf0014070 2024-02-16T10:30:46.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7fead97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94002610456320 notifier 4290 bl.length()=169 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7fead97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7fead97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(69 notify.3 [notify cookie 94002610618160 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7fead97fa640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea2c003400 con 0x7febf0014070 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify_complete (2) cookie 94002610618160 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557eb02fe0e0 con 0x7febf0014070 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.152+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036d8b0 con 0x7febec0ab030 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:30:46.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94002610615664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036fd70 con 0x7febf0014070 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== watch-notify(notify (1) cookie 94002610456320 notify 133143986177 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x557eb02fe0e0 con 0x7febf0014070 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7fead97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94002610456320 notifier 4290 bl.length()=177 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7fead97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7fead97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(72 notify.3 [notify cookie 94002610615664 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7fead97fa640 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea2c003430 con 0x7febf0014070 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== watch-notify(notify_complete (2) cookie 94002610615664 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557eb02fdbd0 con 0x7febf0014070 2024-02-16T10:30:46.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.168 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7feaacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002610467232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb034cd60 con 0x557eb0337290 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94002610467232] v31'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002610443888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03471a0 con 0x7febf0014070 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94002610443888] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 20 remove_watcher() i=0 2024-02-16T10:30:46.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 2 removed watcher, disabling cache 2024-02-16T10:30:46.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.156+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002610450304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb03471a0 con 0x557eb0337290 2024-02-16T10:30:46.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94002610450304] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf8b18980 20 remove_watcher() i=1 2024-02-16T10:30:46.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002610445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x557eb033d5e0 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf6e34640 1 -- 172.21.15.138:0/4070490460 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94002610445936] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febf000a4d0 con 0x557eb033d5e0 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf8b18980 20 remove_watcher() i=2 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.160+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002610456320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x7febf0014070 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf6633640 1 -- 172.21.15.138:0/4070490460 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94002610456320] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febec0f9040 con 0x7febf0014070 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf8b18980 20 remove_watcher() i=3 2024-02-16T10:30:46.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002610453760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x557eb0337290 2024-02-16T10:30:46.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94002610453760] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x557eb0337290 2024-02-16T10:30:46.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf8b18980 20 remove_watcher() i=4 2024-02-16T10:30:46.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.164+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002610460000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x7febec0ab030 2024-02-16T10:30:46.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94002610460000] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf8b18980 20 remove_watcher() i=5 2024-02-16T10:30:46.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002610461520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x7febec0ab030 2024-02-16T10:30:46.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94002610461520] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf8b18980 20 remove_watcher() i=6 2024-02-16T10:30:46.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.168+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002610464848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557eb036c090 con 0x7febec0ab030 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94002610464848] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7febe800e5a0 con 0x7febec0ab030 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 20 remove_watcher() i=7 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7febec0ab030 msgr2=0x7febec0e2a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7febec0ab030 0x7febec0e2a10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb0337290 msgr2=0x557eb0339750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb0337290 0x557eb0339750 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7febf0014070 msgr2=0x7febf0045070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7febf0014070 0x7febf0045070 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557eb033d5e0 msgr2=0x557eb033faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557eb033d5e0 0x557eb033faa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feac0034300 msgr2=0x7feac00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feac0034300 0x7feac00367c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febec0aa800 tx=0x7febec0d6000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf5e32640 1 -- 172.21.15.138:0/4070490460 reap_dead start 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 msgr2=0x557eb032bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7febf003b070 tx=0x7febf0005a20 comp rx=0 tx=0).stop 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 shutdown_connections 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/4070490460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0324df0 0x557eb032bb70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 >> 172.21.15.138:0/4070490460 conn(0x557eb031f9c0 msgr2=0x557eb03208a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 shutdown_connections 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/4070490460 wait complete. 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 msgr2=0x7fead0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 0x7fead0036770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x557eb0305200 tx=0x7febec0e2080 comp rx=0 tx=0).stop 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 msgr2=0x557eb03182c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557eb02fe8e0 tx=0x7febf00188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 shutdown_connections 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fead00342b0 0x7fead0036770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1885850273 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb0317ea0 0x557eb03182c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 >> 172.21.15.138:0/1885850273 conn(0x557eb030ccb0 msgr2=0x557eb030d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 shutdown_connections 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1885850273 wait complete. 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 msgr2=0x557eb0304380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 0x557eb0304380 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 msgr2=0x557eb0309940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 0x557eb0309940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 msgr2=0x7feadc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 0x7feadc0367c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe8000f70 tx=0x7febe80012c0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 msgr2=0x557eb02fd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7febec005880 tx=0x7febec018020 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 shutdown_connections 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557eb03060e0 0x557eb0309940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557eb020b510 0x557eb0304380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feadc034300 0x7feadc0367c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 --2- 172.21.15.138:0/1169549443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557eb020abf0 0x557eb02fd690 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 >> 172.21.15.138:0/1169549443 conn(0x557eb0204490 msgr2=0x557eb02f0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 shutdown_connections 2024-02-16T10:30:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.172+0000 7febf8b18980 1 -- 172.21.15.138:0/1169549443 wait complete. 2024-02-16T10:30:46.189 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:46.190 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T10:30:46.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-02-16T10:30:46.190 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-02-16T10:30:46.262 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.262 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f3792506980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a2cc921440 0x55a2cc9b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f3792506980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a2cc8f8af0 con 0x55a2cc922780 2024-02-16T10:30:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f3792506980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a2cc8bfd30 con 0x55a2cc921440 2024-02-16T10:30:46.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a2cc921440 0x55a2cc9b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a2cc921440 0x55a2cc9b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36044/0 (socket says 172.21.15.138:36044) 2024-02-16T10:30:46.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 -- 172.21.15.138:0/656867095 learned_addr learned my addr 172.21.15.138:0/656867095 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 -- 172.21.15.138:0/656867095 >> v1:172.21.15.107:6789/0 conn(0x55a2cc922780 legacy=0x55a2cc920d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 -- 172.21.15.138:0/656867095 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2cc921850 con 0x55a2cc921440 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.256+0000 7f378f820640 1 --2- 172.21.15.138:0/656867095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cc9b5590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f377800a5c0 tx=0x7f377801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebc760b52e47031 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f378f01f640 1 -- 172.21.15.138:0/656867095 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37780ac460 con 0x55a2cc921440 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f378f01f640 1 -- 172.21.15.138:0/656867095 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780ac5c0 con 0x55a2cc921440 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f378f01f640 1 -- 172.21.15.138:0/656867095 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37780ac880 con 0x55a2cc921440 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 -- 172.21.15.138:0/656867095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 msgr2=0x55a2cc9b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 --2- 172.21.15.138:0/656867095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cc9b5590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f377800a5c0 tx=0x7f377801b340 comp rx=0 tx=0).stop 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 -- 172.21.15.138:0/656867095 shutdown_connections 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 --2- 172.21.15.138:0/656867095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cc9b5590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 -- 172.21.15.138:0/656867095 >> 172.21.15.138:0/656867095 conn(0x55a2cc9a7e50 msgr2=0x55a2cc9aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 -- 172.21.15.138:0/656867095 shutdown_connections 2024-02-16T10:30:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.260+0000 7f3792506980 1 -- 172.21.15.138:0/656867095 wait complete. 2024-02-16T10:30:46.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3792506980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3792506980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2cc8bcfc0 con 0x55a2cc921440 2024-02-16T10:30:46.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3790021640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3790021640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36052/0 (socket says 172.21.15.138:36052) 2024-02-16T10:30:46.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3790021640 1 -- 172.21.15.138:0/3484744624 learned_addr learned my addr 172.21.15.138:0/3484744624 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3790021640 1 -- 172.21.15.138:0/3484744624 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778005df0 con 0x55a2cc921440 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f3790021640 1 --2- 172.21.15.138:0/3484744624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3780006fb0 tx=0x7f3780001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da3f95cba02751 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f367e60c640 1 -- 172.21.15.138:0/3484744624 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378000f640 con 0x55a2cc921440 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f367e60c640 1 -- 172.21.15.138:0/3484744624 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000f7c0 con 0x55a2cc921440 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.272+0000 7f367e60c640 1 -- 172.21.15.138:0/3484744624 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378000fae0 con 0x55a2cc921440 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/3484744624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 msgr2=0x55a2cca98b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 --2- 172.21.15.138:0/3484744624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3780006fb0 tx=0x7f3780001940 comp rx=0 tx=0).stop 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/3484744624 shutdown_connections 2024-02-16T10:30:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 --2- 172.21.15.138:0/3484744624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca98b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/3484744624 >> 172.21.15.138:0/3484744624 conn(0x55a2cc9a7e50 msgr2=0x55a2cca94690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/3484744624 shutdown_connections 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/3484744624 wait complete. 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2cc8b87a0 con 0x55a2cc921440 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790021640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790021640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36062/0 (socket says 172.21.15.138:36062) 2024-02-16T10:30:46.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790021640 1 -- 172.21.15.138:0/778481367 learned_addr learned my addr 172.21.15.138:0/778481367 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790021640 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2cc8f8af0 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790021640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55a2cca99990 tx=0x7f3780000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 -- 172.21.15.138:0/778481367 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3780005450 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a2ccaa00f0 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 -- 172.21.15.138:0/778481367 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37800055b0 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 -- 172.21.15.138:0/778481367 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37800058b0 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2ccaa05a0 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 -- 172.21.15.138:0/778481367 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3780005b20 con 0x55a2cc921440 2024-02-16T10:30:46.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 0x7f3678036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f367ce09640 1 -- 172.21.15.138:0/778481367 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3780049290 con 0x55a2cc921440 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f378f820640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 0x7f3678036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 0x55a2ccaa6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaa6d40 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.276+0000 7f3790822640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 0x55a2ccaa6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f378f820640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 0x7f3678036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37780ae000 tx=0x7f37780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 0x55a2ccaa6800 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/778481367 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37880083f0 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaa3f20 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/778481367 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37880083f0 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaa8a70 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/778481367 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f37880083f0 con 0x55a2cc922780 2024-02-16T10:30:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaa7c70 con 0x55a2cc922780 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/778481367 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37880083f0 con 0x55a2cc922780 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 0x55a2ccaabdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaac3c0 con 0x55a2ccaa8590 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790021640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 0x55a2ccaabdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790021640 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 0x55a2ccaabdf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790021640 1 -- 172.21.15.138:0/778481367 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3780023070 con 0x55a2ccaa8590 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3792506980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2cc850f20 con 0x55a2ccaba340 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36074/0 (socket says 172.21.15.138:36074) 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/3342322936 learned_addr learned my addr 172.21.15.138:0/3342322936 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.280+0000 7f3790822640 1 -- 172.21.15.138:0/3342322936 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2ccabaca0 con 0x55a2ccaba340 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55a2ccaa0f40 tx=0x7f378800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 -- 172.21.15.138:0/3342322936 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378800f040 con 0x55a2ccaba340 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 -- 172.21.15.138:0/3342322936 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378801a560 con 0x55a2ccaba340 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a2ccabaef0 con 0x55a2ccaba340 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 -- 172.21.15.138:0/3342322936 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f378801a800 con 0x55a2ccaba340 2024-02-16T10:30:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2ccabba40 con 0x55a2ccaba340 2024-02-16T10:30:46.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 -- 172.21.15.138:0/3342322936 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f378801a9b0 con 0x55a2ccaba340 2024-02-16T10:30:46.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 0x7f3668036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3675ffb640 1 -- 172.21.15.138:0/3342322936 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f378804bc20 con 0x55a2ccaba340 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790021640 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 0x7f3668036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790021640 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 0x7f3668036770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55a2ccaa7710 tx=0x7f3780025ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3792506980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2cc844790 con 0x55a2ccac72f0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36084/0 (socket says 172.21.15.138:36084) 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 -- 172.21.15.138:0/1341041008 learned_addr learned my addr 172.21.15.138:0/1341041008 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 -- 172.21.15.138:0/1341041008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2ccac7ce0 con 0x55a2ccac72f0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f3790822640 1 --2- 172.21.15.138:0/1341041008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3788008b60 tx=0x7f3788018b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afadd6703cfe0dc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f366f7fe640 1 -- 172.21.15.138:0/1341041008 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3788043e10 con 0x55a2ccac72f0 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f366f7fe640 1 -- 172.21.15.138:0/1341041008 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788024410 con 0x55a2ccac72f0 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.284+0000 7f366f7fe640 1 -- 172.21.15.138:0/1341041008 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37880183c0 con 0x55a2ccac72f0 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/1341041008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 msgr2=0x55a2ccac7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 --2- 172.21.15.138:0/1341041008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3788008b60 tx=0x7f3788018b10 comp rx=0 tx=0).stop 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/1341041008 shutdown_connections 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 --2- 172.21.15.138:0/1341041008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccac7710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/1341041008 >> 172.21.15.138:0/1341041008 conn(0x55a2ccac1ec0 msgr2=0x55a2ccac2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/1341041008 shutdown_connections 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/1341041008 wait complete. 2024-02-16T10:30:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 Processor -- start 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- start start 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2ccace580 con 0x55a2ccac72f0 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36096/0 (socket says 172.21.15.138:36096) 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 learned_addr learned my addr 172.21.15.138:0/2370226978 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2ccabba40 con 0x55a2ccac72f0 2024-02-16T10:30:46.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790822640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3788008b60 tx=0x7f3788049fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 -- 172.21.15.138:0/2370226978 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3788024580 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a2ccace780 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 -- 172.21.15.138:0/2370226978 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880433a0 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2ccaceb50 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 -- 172.21.15.138:0/2370226978 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3788043640 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 -- 172.21.15.138:0/2370226978 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f37880233c0 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36600342b0 0x7f3660036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f366dffb640 1 -- 172.21.15.138:0/2370226978 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f378803ac60 con 0x55a2ccac72f0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3790021640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36600342b0 0x7f3660036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2ccad97a0 0x55a2ccadbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.288+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadc3b0 con 0x55a2ccad97a0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2ccad97a0 0x55a2ccadbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36600342b0 0x7f3660036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378000afd0 tx=0x7f378002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2ccad97a0 0x55a2ccadbc60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 realm 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadc7a0 con 0x55a2ccad97a0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadcff0 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadd350 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaddb50 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 20 searching for the correct realm 2024-02-16T10:30:46.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a2ccadfa00 0x55a2ccae1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790822640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a2ccadfa00 0x55a2ccae1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790822640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a2ccadfa00 0x55a2ccae1ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790822640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f37880122c0 0x7f3788023670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f37880122c0 0x7f3788023670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f37880122c0 0x7f3788023670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3780023070 con 0x7f37880122c0 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3780026020 0x7f37800495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.292+0000 7f378f820640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3780026020 0x7f37800495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3780026020 0x7f37800495b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.296+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.300+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccadfa00 2024-02-16T10:30:46.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f3780026020 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x55a2ccad97a0 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2540 con 0x7f37880122c0 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccade480 con 0x55a2ccad97a0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadecd0 con 0x55a2ccad97a0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccadecd0 con 0x7f37880122c0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 zone default found 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 4 Realm: () 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:46.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 zonegroup default 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.304+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae2980 con 0x7f3780026020 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae4740 con 0x55a2ccadfa00 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae4b50 con 0x55a2ccadfa00 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 started sync module instance, tier type = 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae4020 con 0x7f37880122c0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157707033472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae43d0 con 0x7f37880122c0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae5930 con 0x55a2ccad97a0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157707033472] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157707038576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae5ce0 con 0x55a2ccad97a0 2024-02-16T10:30:46.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.308+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae6690 con 0x55a2ccadfa00 2024-02-16T10:30:46.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157707038576] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157707039632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae6a40 con 0x55a2ccadfa00 2024-02-16T10:30:46.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae73b0 con 0x7f37880122c0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157707046672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae7c00 con 0x7f37880122c0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae85e0 con 0x55a2ccad97a0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.312+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157707039632] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157707046672] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157707048800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae8100 con 0x55a2ccad97a0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae8e60 con 0x7f3780026020 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157707048800] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157707043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae8e10 con 0x7f3780026020 2024-02-16T10:30:46.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.316+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae9780 con 0x7f3780026020 2024-02-16T10:30:46.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157707055840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae9ba0 con 0x7f3780026020 2024-02-16T10:30:46.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaea510 con 0x7f3780026020 2024-02-16T10:30:46.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157707043248] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157707055840] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157707053424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaea510 con 0x7f3780026020 2024-02-16T10:30:46.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=0 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=1 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=2 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=3 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=4 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=5 2024-02-16T10:30:46.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.320+0000 7f3792506980 20 add_watcher() i=6 2024-02-16T10:30:46.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157707053424] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 add_watcher() i=7 2024-02-16T10:30:46.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:46.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaed540 con 0x55a2ccad97a0 2024-02-16T10:30:46.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157707059312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaea960 con 0x55a2ccad97a0 2024-02-16T10:30:46.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157707059312] v31'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f36467fc640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:46.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 5 note: GC not initialized 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f36457fa640 20 reqs_thread_entry: start 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 Filter name: none 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f35b6ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.324+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccb0f280 con 0x7f3780026020 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-02-16T10:30:46.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccb0f280 con 0x55a2ccad97a0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=7 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccb10630 con 0x55a2ccad97a0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 foo [call out=48b,read 0~358 out=358b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+406 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-02-16T10:30:46.337 INFO:teuthology.orchestra.run.smithi138.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-02-16T10:30:46.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f36467fc640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157707059312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaefbe0 con 0x55a2ccad97a0 2024-02-16T10:30:46.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94157707059312] v31'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157707033472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccaea070 con 0x7f37880122c0 2024-02-16T10:30:46.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94157707033472] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 20 remove_watcher() i=0 2024-02-16T10:30:46.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 2 removed watcher, disabling cache 2024-02-16T10:30:46.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.328+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157707038576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae3b80 con 0x55a2ccad97a0 2024-02-16T10:30:46.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.332+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94157707038576] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.332+0000 7f3792506980 20 remove_watcher() i=1 2024-02-16T10:30:46.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.332+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157707039632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae4f70 con 0x55a2ccadfa00 2024-02-16T10:30:46.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.332+0000 7f3790822640 1 -- 172.21.15.138:0/2370226978 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94157707039632] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f378805b040 con 0x55a2ccadfa00 2024-02-16T10:30:46.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 20 remove_watcher() i=2 2024-02-16T10:30:46.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157707046672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae4f70 con 0x7f37880122c0 2024-02-16T10:30:46.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3790021640 1 -- 172.21.15.138:0/2370226978 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94157707046672] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3780053040 con 0x7f37880122c0 2024-02-16T10:30:46.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 20 remove_watcher() i=3 2024-02-16T10:30:46.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157707048800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae6f10 con 0x55a2ccad97a0 2024-02-16T10:30:46.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94157707048800] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x55a2ccad97a0 2024-02-16T10:30:46.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 20 remove_watcher() i=4 2024-02-16T10:30:46.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.336+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157707043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae7760 con 0x7f3780026020 2024-02-16T10:30:46.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94157707043248] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f3792506980 20 remove_watcher() i=5 2024-02-16T10:30:46.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157707055840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae61b0 con 0x7f3780026020 2024-02-16T10:30:46.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94157707055840] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f3792506980 20 remove_watcher() i=6 2024-02-16T10:30:46.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.340+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157707053424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a2ccae61b0 con 0x7f3780026020 2024-02-16T10:30:46.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94157707053424] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37780a9070 con 0x7f3780026020 2024-02-16T10:30:46.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 20 remove_watcher() i=7 2024-02-16T10:30:46.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3780026020 msgr2=0x7f37800495b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3780026020 0x7f37800495b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2ccad97a0 msgr2=0x55a2ccadbc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2ccad97a0 0x55a2ccadbc60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f37880122c0 msgr2=0x7f3788023670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f37880122c0 0x7f3788023670 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a2ccadfa00 msgr2=0x55a2ccae1ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a2ccadfa00 0x55a2ccae1ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36600342b0 msgr2=0x7f3660036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36600342b0 0x7f3660036770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378000afd0 tx=0x7f378002f000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 msgr2=0x55a2ccace040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3788008b60 tx=0x7f3788049fa0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f378f820640 1 -- 172.21.15.138:0/2370226978 reap_dead start 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 shutdown_connections 2024-02-16T10:30:46.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/2370226978 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccac72f0 0x55a2ccace040 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 >> 172.21.15.138:0/2370226978 conn(0x55a2ccac1ec0 msgr2=0x55a2ccac2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 shutdown_connections 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/2370226978 wait complete. 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 msgr2=0x7f3668036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 0x7f3668036770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55a2ccaa7710 tx=0x7f3780025ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 msgr2=0x55a2ccaba760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55a2ccaa0f40 tx=0x7f378800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 shutdown_connections 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36680342b0 0x7f3668036770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/3342322936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2ccaba340 0x55a2ccaba760 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 >> 172.21.15.138:0/3342322936 conn(0x55a2ccaaf150 msgr2=0x55a2ccaafc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 shutdown_connections 2024-02-16T10:30:46.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/3342322936 wait complete. 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 msgr2=0x55a2ccaa6800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 0x55a2ccaa6800 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 msgr2=0x55a2ccaabdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 0x55a2ccaabdf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 msgr2=0x7f3678036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 0x7f3678036770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37780ae000 tx=0x7f37780a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 msgr2=0x55a2cca9fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55a2cca99990 tx=0x7f3780000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 shutdown_connections 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a2ccaa8590 0x55a2ccaabdf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a2cc922780 0x55a2ccaa6800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f36780342b0 0x7f3678036770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 --2- 172.21.15.138:0/778481367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a2cc921440 0x55a2cca9fbb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 >> 172.21.15.138:0/778481367 conn(0x55a2cc9a7e50 msgr2=0x55a2cca931a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 shutdown_connections 2024-02-16T10:30:46.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.344+0000 7f3792506980 1 -- 172.21.15.138:0/778481367 wait complete. 2024-02-16T10:30:46.361 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-02-16T10:30:46.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:46.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:46.362 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:46.433 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.434 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468d636980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563cf7e9ccd0 0x563cf7e9f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468d636980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563cf7de2b50 con 0x563cf7e987d0 2024-02-16T10:30:46.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468d636980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563cf7da9d30 con 0x563cf7e9ccd0 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468a950640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563cf7e9ccd0 0x563cf7e9f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468a950640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563cf7e9ccd0 0x563cf7e9f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36100/0 (socket says 172.21.15.138:36100) 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468a950640 1 -- 172.21.15.138:0/543978200 learned_addr learned my addr 172.21.15.138:0/543978200 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468b151640 1 --1- 172.21.15.138:0/543978200 >> v1:172.21.15.107:6789/0 conn(0x563cf7e987d0 0x563cf7e98bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53276/0 (socket says 172.21.15.138:53276) 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468a950640 1 -- 172.21.15.138:0/543978200 >> v1:172.21.15.107:6789/0 conn(0x563cf7e987d0 legacy=0x563cf7e98bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.428+0000 7f468a950640 1 -- 172.21.15.138:0/543978200 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cf7ea0610 con 0x563cf7e9ccd0 2024-02-16T10:30:46.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468a950640 1 --2- 172.21.15.138:0/543978200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e9ccd0 0x563cf7e9f0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f467400a5c0 tx=0x7f467401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26d03c21c72c469 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468a14f640 1 -- 172.21.15.138:0/543978200 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46740aa470 con 0x563cf7e9ccd0 2024-02-16T10:30:46.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468a14f640 1 -- 172.21.15.138:0/543978200 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740aa5d0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468a14f640 1 -- 172.21.15.138:0/543978200 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46740aa890 con 0x563cf7e9ccd0 2024-02-16T10:30:46.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 -- 172.21.15.138:0/543978200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e9ccd0 msgr2=0x563cf7e9f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 --2- 172.21.15.138:0/543978200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e9ccd0 0x563cf7e9f0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f467400a5c0 tx=0x7f467401b340 comp rx=0 tx=0).stop 2024-02-16T10:30:46.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 -- 172.21.15.138:0/543978200 shutdown_connections 2024-02-16T10:30:46.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 --2- 172.21.15.138:0/543978200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e9ccd0 0x563cf7e9f0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 -- 172.21.15.138:0/543978200 >> 172.21.15.138:0/543978200 conn(0x563cf7e0bef0 msgr2=0x563cf7e0c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 -- 172.21.15.138:0/543978200 shutdown_connections 2024-02-16T10:30:46.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.432+0000 7f468d636980 1 -- 172.21.15.138:0/543978200 wait complete. 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468d636980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468d636980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cf7da6fc0 con 0x563cf7e987d0 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468b151640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468b151640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36102/0 (socket says 172.21.15.138:36102) 2024-02-16T10:30:46.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.444+0000 7f468b151640 1 -- 172.21.15.138:0/596197992 learned_addr learned my addr 172.21.15.138:0/596197992 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 -- 172.21.15.138:0/596197992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674005df0 con 0x563cf7e987d0 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 --2- 172.21.15.138:0/596197992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fb0 tx=0x7f467c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3da7c3a2abd529f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f457960a640 1 -- 172.21.15.138:0/596197992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c013420 con 0x563cf7e987d0 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f457960a640 1 -- 172.21.15.138:0/596197992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c013580 con 0x563cf7e987d0 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f457960a640 1 -- 172.21.15.138:0/596197992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c013860 con 0x563cf7e987d0 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/596197992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 msgr2=0x563cf7f82850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 --2- 172.21.15.138:0/596197992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fb0 tx=0x7f467c001940 comp rx=0 tx=0).stop 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/596197992 shutdown_connections 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 --2- 172.21.15.138:0/596197992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f82850 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/596197992 >> 172.21.15.138:0/596197992 conn(0x563cf7e0bef0 msgr2=0x563cf7f7e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/596197992 shutdown_connections 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/596197992 wait complete. 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cf7da27a0 con 0x563cf7e987d0 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36114/0 (socket says 172.21.15.138:36114) 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 -- 172.21.15.138:0/2322689367 learned_addr learned my addr 172.21.15.138:0/2322689367 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cf7de2b50 con 0x563cf7e987d0 2024-02-16T10:30:46.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468b151640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x563cf7f836e0 tx=0x7f467c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f4577e07640 1 -- 172.21.15.138:0/2322689367 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c0037a0 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f4577e07640 1 -- 172.21.15.138:0/2322689367 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c003900 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.448+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cf7f89ce0 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f4577e07640 1 -- 172.21.15.138:0/2322689367 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c003ba0 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cf7f8a190 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f4577e07640 1 -- 172.21.15.138:0/2322689367 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f467c003d00 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f4577e07640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 0x7f45700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f4577e07640 1 -- 172.21.15.138:0/2322689367 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f467c0494a0 con 0x563cf7e987d0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468a950640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 0x7f45700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 0x563cf7f90490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7f909d0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 0x563cf7f90490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468a950640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 0x7f45700367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46740ae000 tx=0x7f46740a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 0x563cf7f90490 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 -- 172.21.15.138:0/2322689367 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46840083f0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7f8dba0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 -- 172.21.15.138:0/2322689367 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f46840083f0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7f926d0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 -- 172.21.15.138:0/2322689367 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f46840083f0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7f918d0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b952640 1 -- 172.21.15.138:0/2322689367 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f46840083f0 con 0x563cf7e9ccd0 2024-02-16T10:30:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 0x563cf7f95a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7f960a0 con 0x563cf7f921f0 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b151640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 0x563cf7f95a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.452+0000 7f468b151640 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 0x563cf7f95a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b151640 1 -- 172.21.15.138:0/2322689367 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f467c024020 con 0x563cf7f921f0 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cf7d3af20 con 0x563cf7fa3fa0 2024-02-16T10:30:46.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36124/0 (socket says 172.21.15.138:36124) 2024-02-16T10:30:46.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b952640 1 -- 172.21.15.138:0/4294542381 learned_addr learned my addr 172.21.15.138:0/4294542381 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b952640 1 -- 172.21.15.138:0/4294542381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cf7fa4900 con 0x563cf7fa3fa0 2024-02-16T10:30:46.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b952640 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x563cf7f8a340 tx=0x7f468400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 -- 172.21.15.138:0/4294542381 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f468400f040 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 -- 172.21.15.138:0/4294542381 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684019550 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cf7fa4b50 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 -- 172.21.15.138:0/4294542381 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46840197f0 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cf7fa56a0 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 -- 172.21.15.138:0/4294542381 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f46840199a0 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 0x7f4564036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f4575602640 1 -- 172.21.15.138:0/4294542381 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f468404b460 con 0x563cf7fa3fa0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.456+0000 7f468b151640 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 0x7f4564036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b151640 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 0x7f4564036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x563cf7f91310 tx=0x7f467c028e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cf7d2e790 con 0x563cf7fb0f20 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36132/0 (socket says 172.21.15.138:36132) 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 -- 172.21.15.138:0/973473351 learned_addr learned my addr 172.21.15.138:0/973473351 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 -- 172.21.15.138:0/973473351 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cf7fb1910 con 0x563cf7fb0f20 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- 172.21.15.138:0/973473351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f468400efb0 tx=0x7f468402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b7ff14e6b8e5e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f456effd640 1 -- 172.21.15.138:0/973473351 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f468403a0d0 con 0x563cf7fb0f20 2024-02-16T10:30:46.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f456effd640 1 -- 172.21.15.138:0/973473351 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468403a230 con 0x563cf7fb0f20 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f456effd640 1 -- 172.21.15.138:0/973473351 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f468403b460 con 0x563cf7fb0f20 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- 172.21.15.138:0/973473351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 msgr2=0x563cf7fb1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 --2- 172.21.15.138:0/973473351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f468400efb0 tx=0x7f468402af40 comp rx=0 tx=0).stop 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- 172.21.15.138:0/973473351 shutdown_connections 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 --2- 172.21.15.138:0/973473351 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb1340 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- 172.21.15.138:0/973473351 >> 172.21.15.138:0/973473351 conn(0x563cf7fabaa0 msgr2=0x563cf7fac980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- 172.21.15.138:0/973473351 shutdown_connections 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- 172.21.15.138:0/973473351 wait complete. 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 Processor -- start 2024-02-16T10:30:46.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- start start 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468d636980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cf7fb8170 con 0x563cf7fb0f20 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36134/0 (socket says 172.21.15.138:36134) 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 learned_addr learned my addr 172.21.15.138:0/3262936105 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cf7fa56a0 con 0x563cf7fb0f20 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.460+0000 7f468b952640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46840056e0 tx=0x7f46840497e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 -- 172.21.15.138:0/3262936105 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f468404b200 con 0x563cf7fb0f20 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 -- 172.21.15.138:0/3262936105 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46840183b0 con 0x563cf7fb0f20 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cf7fb8370 con 0x563cf7fb0f20 2024-02-16T10:30:46.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 -- 172.21.15.138:0/3262936105 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46840153a0 con 0x563cf7fb0f20 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cf7fb87a0 con 0x563cf7fb0f20 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 -- 172.21.15.138:0/3262936105 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4684042070 con 0x563cf7fb0f20 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45540342b0 0x7f4554036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f456d7fa640 1 -- 172.21.15.138:0/3262936105 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f4684038c60 con 0x563cf7fb0f20 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468b151640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45540342b0 0x7f4554036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7fc3390 0x563cf7fc5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc5fa0 con 0x563cf7fc3390 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7fc3390 0x563cf7fc5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468b151640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45540342b0 0x7f4554036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f467c0410f0 tx=0x7f467c034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7fc3390 0x563cf7fc5850 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 realm 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc6390 con 0x563cf7fc3390 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc6be0 con 0x563cf7fc3390 2024-02-16T10:30:46.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc6f40 con 0x563cf7fc3390 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc6880 con 0x563cf7fc3390 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 20 searching for the correct realm 2024-02-16T10:30:46.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563cf7fc9190 0x563cf7fcb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468b952640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563cf7fc9190 0x563cf7fcb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.464+0000 7f468b952640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563cf7fc9190 0x563cf7fcb5e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b952640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4684037020 0x7f4684022450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b151640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4684037020 0x7f4684022450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b151640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4684037020 0x7f4684022450 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b151640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f467c0479d0 0x7f467c028640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f467c0479d0 0x7f467c028640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f467c0479d0 0x7f467c028640 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.468+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.472+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc9190 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.476+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f467c0479d0 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x563cf7fc3390 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcbcb0 con 0x7f4684037020 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:46.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc7da0 con 0x563cf7fc3390 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc7a20 con 0x563cf7fc3390 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fc8670 con 0x7f4684037020 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 zone default found 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 4 Realm: () 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 zonegroup default 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcc140 con 0x7f467c0479d0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcdfc0 con 0x563cf7fc9190 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fce320 con 0x563cf7fc9190 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 started sync module instance, tier type = 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcd590 con 0x7f4684037020 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94819858567408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fce680 con 0x7f4684037020 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.480+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcf030 con 0x563cf7fc3390 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.484+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94819858567408] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.484+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.484+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94819858569600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcf3e0 con 0x563cf7fc3390 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.484+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcfd90 con 0x563cf7fc9190 2024-02-16T10:30:46.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.484+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94819858569600] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94819858574160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fcfd50 con 0x563cf7fc9190 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd0750 con 0x7f4684037020 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94819858580144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd0fa0 con 0x7f4684037020 2024-02-16T10:30:46.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd1970 con 0x563cf7fc3390 2024-02-16T10:30:46.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94819858574160] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94819858580144] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94819858584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd0b00 con 0x563cf7fc3390 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.488+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd21c0 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94819858584688] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94819858577584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd0b00 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd26c0 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94819858577584] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94819858588064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd2680 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.492+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd3090 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94819858588064] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94819858590592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd3090 con 0x7f467c0479d0 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=0 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=1 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=2 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=3 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=4 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=5 2024-02-16T10:30:46.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=6 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94819858590592] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 20 add_watcher() i=7 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.496+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd64e0 con 0x563cf7fc3390 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94819858586432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd39c0 con 0x563cf7fc3390 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94819858586432] v31'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f4541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 5 note: GC not initialized 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f4540fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 Filter name: none 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f44ba7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7ff7ea0 con 0x563cf7fc3390 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:46.515 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f4541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.500+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94819858586432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd8ab0 con 0x563cf7fc3390 2024-02-16T10:30:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94819858586432] v31'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94819858567408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd1b40 con 0x7f4684037020 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94819858567408] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 20 remove_watcher() i=0 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 2 removed watcher, disabling cache 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94819858569600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd1b40 con 0x563cf7fc3390 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94819858569600] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 20 remove_watcher() i=1 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.504+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94819858574160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd1b40 con 0x563cf7fc9190 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468b952640 1 -- 172.21.15.138:0/3262936105 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94819858574160] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4684012070 con 0x563cf7fc9190 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468d636980 20 remove_watcher() i=2 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94819858580144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fceb50 con 0x7f4684037020 2024-02-16T10:30:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468b151640 1 -- 172.21.15.138:0/3262936105 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94819858580144] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f467c024020 con 0x7f4684037020 2024-02-16T10:30:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468d636980 20 remove_watcher() i=3 2024-02-16T10:30:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94819858584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd1b40 con 0x563cf7fc3390 2024-02-16T10:30:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94819858584688] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x563cf7fc3390 2024-02-16T10:30:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.508+0000 7f468d636980 20 remove_watcher() i=4 2024-02-16T10:30:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94819858577584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fd02b0 con 0x7f467c0479d0 2024-02-16T10:30:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94819858577584] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468d636980 20 remove_watcher() i=5 2024-02-16T10:30:46.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94819858588064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fceb50 con 0x7f467c0479d0 2024-02-16T10:30:46.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94819858588064] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468d636980 20 remove_watcher() i=6 2024-02-16T10:30:46.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.512+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94819858590592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563cf7fceb50 con 0x7f467c0479d0 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94819858590592] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46740b0020 con 0x7f467c0479d0 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 20 remove_watcher() i=7 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f467c0479d0 msgr2=0x7f467c028640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f467c0479d0 0x7f467c028640 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7fc3390 msgr2=0x563cf7fc5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7fc3390 0x563cf7fc5850 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4684037020 msgr2=0x7f4684022450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4684037020 0x7f4684022450 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563cf7fc9190 msgr2=0x563cf7fcb5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563cf7fc9190 0x563cf7fcb5e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45540342b0 msgr2=0x7f4554036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45540342b0 0x7f4554036770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f467c0410f0 tx=0x7f467c034000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 msgr2=0x563cf7fb7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468a950640 1 -- 172.21.15.138:0/3262936105 reap_dead start 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46840056e0 tx=0x7f46840497e0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 shutdown_connections 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/3262936105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fb0f20 0x563cf7fb7c30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 >> 172.21.15.138:0/3262936105 conn(0x563cf7fabaa0 msgr2=0x563cf7fac980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 shutdown_connections 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/3262936105 wait complete. 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 msgr2=0x7f4564036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 0x7f4564036770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x563cf7f91310 tx=0x7f467c028e90 comp rx=0 tx=0).stop 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 msgr2=0x563cf7fa43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x563cf7f8a340 tx=0x7f468400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 shutdown_connections 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f45640342b0 0x7f4564036770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/4294542381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7fa3fa0 0x563cf7fa43c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 >> 172.21.15.138:0/4294542381 conn(0x563cf7f98db0 msgr2=0x563cf7f998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 shutdown_connections 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/4294542381 wait complete. 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 msgr2=0x563cf7f90490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 0x563cf7f90490 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 msgr2=0x563cf7f95a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 0x563cf7f95a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 msgr2=0x7f45700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 0x7f45700367c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46740ae000 tx=0x7f46740a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 msgr2=0x563cf7f897a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x563cf7f836e0 tx=0x7f467c000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 shutdown_connections 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563cf7f921f0 0x563cf7f95a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563cf7e9ccd0 0x563cf7f90490 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4570034300 0x7f45700367c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 --2- 172.21.15.138:0/2322689367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563cf7e987d0 0x563cf7f897a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 >> 172.21.15.138:0/2322689367 conn(0x563cf7e0bef0 msgr2=0x563cf7f7cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 shutdown_connections 2024-02-16T10:30:46.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.516+0000 7f468d636980 1 -- 172.21.15.138:0/2322689367 wait complete. 2024-02-16T10:30:46.534 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:46.534 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T10:30:46.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T10:30:46.535 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T10:30:46.610 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.610 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae58a49980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556ba0d4baf0 0x556ba0d4dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae58a49980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556ba0c93b50 con 0x556ba0d475e0 2024-02-16T10:30:46.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae58a49980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x556ba0c5ad30 con 0x556ba0d4baf0 2024-02-16T10:30:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae55d63640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556ba0d4baf0 0x556ba0d4dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae55d63640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556ba0d4baf0 0x556ba0d4dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36148/0 (socket says 172.21.15.138:36148) 2024-02-16T10:30:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae55d63640 1 -- 172.21.15.138:0/1279731094 learned_addr learned my addr 172.21.15.138:0/1279731094 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae55d63640 1 -- 172.21.15.138:0/1279731094 >> v1:172.21.15.107:6789/0 conn(0x556ba0d475e0 legacy=0x556ba0d479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.604+0000 7fae55d63640 1 -- 172.21.15.138:0/1279731094 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba0d4f430 con 0x556ba0d4baf0 2024-02-16T10:30:46.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae55d63640 1 --2- 172.21.15.138:0/1279731094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d4baf0 0x556ba0d4dee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00a5c0 tx=0x7fae4c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440e10d35eae2265 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae55562640 1 -- 172.21.15.138:0/1279731094 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae4c0aa470 con 0x556ba0d4baf0 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae55562640 1 -- 172.21.15.138:0/1279731094 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c0aa5d0 con 0x556ba0d4baf0 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae55562640 1 -- 172.21.15.138:0/1279731094 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae4c0aa890 con 0x556ba0d4baf0 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 -- 172.21.15.138:0/1279731094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d4baf0 msgr2=0x556ba0d4dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 --2- 172.21.15.138:0/1279731094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d4baf0 0x556ba0d4dee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00a5c0 tx=0x7fae4c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 -- 172.21.15.138:0/1279731094 shutdown_connections 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 --2- 172.21.15.138:0/1279731094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d4baf0 0x556ba0d4dee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 -- 172.21.15.138:0/1279731094 >> 172.21.15.138:0/1279731094 conn(0x556ba0d42eb0 msgr2=0x556ba0d452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 -- 172.21.15.138:0/1279731094 shutdown_connections 2024-02-16T10:30:46.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.608+0000 7fae58a49980 1 -- 172.21.15.138:0/1279731094 wait complete. 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae58a49980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae58a49980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba0c57fc0 con 0x556ba0d475e0 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae56564640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae56564640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36158/0 (socket says 172.21.15.138:36158) 2024-02-16T10:30:46.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae56564640 1 -- 172.21.15.138:0/629671874 learned_addr learned my addr 172.21.15.138:0/629671874 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.620+0000 7fae56564640 1 -- 172.21.15.138:0/629671874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c005df0 con 0x556ba0d475e0 2024-02-16T10:30:46.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 --2- 172.21.15.138:0/629671874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae50006f60 tx=0x7fae50006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7d0711c2c6459 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad44608640 1 -- 172.21.15.138:0/629671874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae5000f640 con 0x556ba0d475e0 2024-02-16T10:30:46.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad44608640 1 -- 172.21.15.138:0/629671874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000f7a0 con 0x556ba0d475e0 2024-02-16T10:30:46.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad44608640 1 -- 172.21.15.138:0/629671874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae5000fac0 con 0x556ba0d475e0 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/629671874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 msgr2=0x556ba0cbd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 --2- 172.21.15.138:0/629671874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae50006f60 tx=0x7fae50006f90 comp rx=0 tx=0).stop 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/629671874 shutdown_connections 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 --2- 172.21.15.138:0/629671874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0cbd590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/629671874 >> 172.21.15.138:0/629671874 conn(0x556ba0d42eb0 msgr2=0x556ba0e2d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/629671874 shutdown_connections 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/629671874 wait complete. 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba0c537a0 con 0x556ba0d475e0 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36174/0 (socket says 172.21.15.138:36174) 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 -- 172.21.15.138:0/1401116817 learned_addr learned my addr 172.21.15.138:0/1401116817 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba0c93b50 con 0x556ba0d475e0 2024-02-16T10:30:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae56564640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e70 tx=0x7fae50001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad42e05640 1 -- 172.21.15.138:0/1401116817 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae50006160 con 0x556ba0d475e0 2024-02-16T10:30:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad42e05640 1 -- 172.21.15.138:0/1401116817 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500062c0 con 0x556ba0d475e0 2024-02-16T10:30:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba0e3ad80 con 0x556ba0d475e0 2024-02-16T10:30:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fad42e05640 1 -- 172.21.15.138:0/1401116817 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae5001e7c0 con 0x556ba0d475e0 2024-02-16T10:30:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.624+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba0e3b290 con 0x556ba0d475e0 2024-02-16T10:30:46.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fad42e05640 1 -- 172.21.15.138:0/1401116817 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fae5001e920 con 0x556ba0d475e0 2024-02-16T10:30:46.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fad42e05640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 0x7fad3c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fad42e05640 1 -- 172.21.15.138:0/1401116817 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fae50049a10 con 0x556ba0d475e0 2024-02-16T10:30:46.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae55d63640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 0x7fad3c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 0x556ba0e41530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e41a70 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 0x556ba0e41530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae55d63640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 0x7fad3c036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0ae000 tx=0x7fae4c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 0x556ba0e41530 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 -- 172.21.15.138:0/1401116817 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fae480083f0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e41df0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 -- 172.21.15.138:0/1401116817 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fae480083f0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e436a0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 -- 172.21.15.138:0/1401116817 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fae480083f0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e428a0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 -- 172.21.15.138:0/1401116817 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fae480083f0 con 0x556ba0d4baf0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 0x556ba0e46a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e47030 con 0x556ba0e431c0 2024-02-16T10:30:46.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56564640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 0x556ba0e46a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56564640 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 0x556ba0e46a20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56564640 1 -- 172.21.15.138:0/1401116817 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fae50018070 con 0x556ba0e431c0 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae58a49980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba0bebf20 con 0x556ba0e54f20 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.628+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36190/0 (socket says 172.21.15.138:36190) 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 -- 172.21.15.138:0/256184548 learned_addr learned my addr 172.21.15.138:0/256184548 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 -- 172.21.15.138:0/256184548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba0e55880 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556ba0e3b920 tx=0x7fae4800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 -- 172.21.15.138:0/256184548 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae4800f040 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 -- 172.21.15.138:0/256184548 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48019550 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba0e55ad0 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 -- 172.21.15.138:0/256184548 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae48019810 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba0e56620 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 -- 172.21.15.138:0/256184548 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fae48019a00 con 0x556ba0e54f20 2024-02-16T10:30:46.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 0x7fad30036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fad3bfff640 1 -- 172.21.15.138:0/256184548 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fae4804b4b0 con 0x556ba0e54f20 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56564640 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 0x7fad30036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56564640 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 0x7fad30036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x556ba0e422e0 tx=0x7fae50047d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae58a49980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba0bdf790 con 0x556ba0e61df0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36192/0 (socket says 172.21.15.138:36192) 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 -- 172.21.15.138:0/761185137 learned_addr learned my addr 172.21.15.138:0/761185137 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.632+0000 7fae56d65640 1 -- 172.21.15.138:0/761185137 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba0e627c0 con 0x556ba0e61df0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 --2- 172.21.15.138:0/761185137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fae4800efb0 tx=0x7fae4802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62809af248784d3c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad39ffb640 1 -- 172.21.15.138:0/761185137 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae48048070 con 0x556ba0e61df0 2024-02-16T10:30:46.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad39ffb640 1 -- 172.21.15.138:0/761185137 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4804b110 con 0x556ba0e61df0 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad39ffb640 1 -- 172.21.15.138:0/761185137 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae480153a0 con 0x556ba0e61df0 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/761185137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 msgr2=0x556ba0e621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 --2- 172.21.15.138:0/761185137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fae4800efb0 tx=0x7fae4802af40 comp rx=0 tx=0).stop 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/761185137 shutdown_connections 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 --2- 172.21.15.138:0/761185137 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e621f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/761185137 >> 172.21.15.138:0/761185137 conn(0x556ba0e5c9c0 msgr2=0x556ba0e5d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/761185137 shutdown_connections 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/761185137 wait complete. 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 Processor -- start 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- start start 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba0e69050 con 0x556ba0e61df0 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36196/0 (socket says 172.21.15.138:36196) 2024-02-16T10:30:46.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 learned_addr learned my addr 172.21.15.138:0/245846084 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba0e56620 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae56d65640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae48048720 tx=0x7fae48049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad27fff640 1 -- 172.21.15.138:0/245846084 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae48018530 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556ba0e69250 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad27fff640 1 -- 172.21.15.138:0/245846084 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4804b280 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fad27fff640 1 -- 172.21.15.138:0/245846084 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae48049bf0 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.636+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba0e696e0 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fad27fff640 1 -- 172.21.15.138:0/245846084 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fae48032020 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fad27fff640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad200342b0 0x7fad20036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fad27fff640 1 -- 172.21.15.138:0/245846084 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fae48037c90 con 0x556ba0e61df0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad200342b0 0x7fad20036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0e74240 0x556ba0e766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e76e20 con 0x556ba0e74240 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0e74240 0x556ba0e766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad200342b0 0x7fad20036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae50011ff0 tx=0x7fae50035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0e74240 0x556ba0e766d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 realm 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e77210 con 0x556ba0e74240 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e77a60 con 0x556ba0e74240 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e77dc0 con 0x556ba0e74240 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e785c0 con 0x556ba0e74240 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 20 searching for the correct realm 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556ba0e7a470 0x556ba0e7c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56d65640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556ba0e7a470 0x556ba0e7c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56d65640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556ba0e7a470 0x556ba0e7c930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56d65640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fae48022070 0x7fae4800da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fae48022070 0x7fae4800da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fae48022070 0x7fae4800da90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fae50012020 0x7fae500105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.640+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fae50012020 0x7fae500105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fae50012020 0x7fae500105d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.644+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48042040 con 0x556ba0e7a470 2024-02-16T10:30:46.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.648+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e7a470 2024-02-16T10:30:46.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae50012020 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x556ba0e74240 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7cfb0 con 0x7fae48022070 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:46.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e78ec0 con 0x556ba0e74240 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e79710 con 0x556ba0e74240 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e79710 con 0x7fae48022070 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:46.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 zone default found 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 4 Realm: () 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 zonegroup default 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.652+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7d3f0 con 0x7fae50012020 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7f1b0 con 0x556ba0e7a470 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7f560 con 0x556ba0e7a470 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 started sync module instance, tier type = 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7ea90 con 0x7fae48022070 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920749413872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7ee40 con 0x7fae48022070 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e80320 con 0x556ba0e74240 2024-02-16T10:30:46.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.656+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920749413872] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920749418880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e806d0 con 0x556ba0e74240 2024-02-16T10:30:46.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e810a0 con 0x556ba0e7a470 2024-02-16T10:30:46.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920749423520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e81060 con 0x556ba0e7a470 2024-02-16T10:30:46.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e81fa0 con 0x7fae48022070 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920749418880] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920749427392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e82380 con 0x7fae48022070 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e82cf0 con 0x556ba0e74240 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.660+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920749423520] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920749427392] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920749425744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7feb0 con 0x556ba0e74240 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e83540 con 0x7fae50012020 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920749425744] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920749430864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e834a0 con 0x7fae50012020 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.664+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e83e10 con 0x7fae50012020 2024-02-16T10:30:46.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920749430864] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920749433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e83e10 con 0x7fae50012020 2024-02-16T10:30:46.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84780 con 0x7fae50012020 2024-02-16T10:30:46.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920749433024] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920749435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84780 con 0x7fae50012020 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=0 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=1 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=2 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=3 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=4 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=5 2024-02-16T10:30:46.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.668+0000 7fae58a49980 20 add_watcher() i=6 2024-02-16T10:30:46.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920749435520] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 add_watcher() i=7 2024-02-16T10:30:46.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:46.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e87ae0 con 0x556ba0e74240 2024-02-16T10:30:46.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920749438032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84d10 con 0x556ba0e74240 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920749438032] v31'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fad0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 5 note: GC not initialized 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fac877fe640 20 reqs_thread_entry: start 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 Filter name: none 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fac857fa640 20 reqs_thread_entry: start 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:46.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0ea99c0 con 0x556ba0e74240 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.672+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0eabd80 con 0x7fae48022070 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0eaf3c0 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93920749612736 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0eac220 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 93920749425744 notify 133143986177 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fae4c0e1040 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fad39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 93920749425744 notifier 4311 bl.length()=534 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fad39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fad39ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fad39ffb640 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fad1c003ea0 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 notify.4 [notify cookie 93920749612736 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== watch-notify(notify_complete (2) cookie 93920749612736 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fae4c0b9070 con 0x556ba0e74240 2024-02-16T10:30:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.687 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fad0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.676+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920749438032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0ea8980 con 0x556ba0e74240 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93920749438032] v31'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920749413872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84450 con 0x7fae48022070 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93920749413872] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 20 remove_watcher() i=0 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 2 removed watcher, disabling cache 2024-02-16T10:30:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920749418880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84450 con 0x556ba0e74240 2024-02-16T10:30:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93920749418880] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 20 remove_watcher() i=1 2024-02-16T10:30:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.680+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920749423520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7f980 con 0x556ba0e7a470 2024-02-16T10:30:46.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae56d65640 1 -- 172.21.15.138:0/245846084 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93920749423520] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae48061040 con 0x556ba0e7a470 2024-02-16T10:30:46.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae58a49980 20 remove_watcher() i=2 2024-02-16T10:30:46.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920749427392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84450 con 0x7fae48022070 2024-02-16T10:30:46.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae56564640 1 -- 172.21.15.138:0/245846084 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93920749427392] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae50039040 con 0x7fae48022070 2024-02-16T10:30:46.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae58a49980 20 remove_watcher() i=3 2024-02-16T10:30:46.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920749425744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7f980 con 0x556ba0e74240 2024-02-16T10:30:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.684+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93920749425744] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x556ba0e74240 2024-02-16T10:30:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.688+0000 7fae58a49980 20 remove_watcher() i=4 2024-02-16T10:30:46.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.688+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920749430864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e84450 con 0x7fae50012020 2024-02-16T10:30:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.688+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93920749430864] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.688+0000 7fae58a49980 20 remove_watcher() i=5 2024-02-16T10:30:46.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.688+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920749433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e81450 con 0x7fae50012020 2024-02-16T10:30:46.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93920749433024] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 20 remove_watcher() i=6 2024-02-16T10:30:46.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920749435520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x556ba0e7f980 con 0x7fae50012020 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93920749435520] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fae4c0b0020 con 0x7fae50012020 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 20 remove_watcher() i=7 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fae50012020 msgr2=0x7fae500105d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fae50012020 0x7fae500105d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0e74240 msgr2=0x556ba0e766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0e74240 0x556ba0e766d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fae48022070 msgr2=0x7fae4800da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fae48022070 0x7fae4800da90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556ba0e7a470 msgr2=0x556ba0e7c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556ba0e7a470 0x556ba0e7c930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad200342b0 msgr2=0x7fad20036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad200342b0 0x7fad20036770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae50011ff0 tx=0x7fae50035000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 msgr2=0x556ba0e68b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae55d63640 1 -- 172.21.15.138:0/245846084 reap_dead start 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae48048720 tx=0x7fae48049830 comp rx=0 tx=0).stop 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 shutdown_connections 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/245846084 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e61df0 0x556ba0e68b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 >> 172.21.15.138:0/245846084 conn(0x556ba0e5c9c0 msgr2=0x556ba0e5d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 shutdown_connections 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/245846084 wait complete. 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 msgr2=0x7fad30036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 0x7fad30036770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x556ba0e422e0 tx=0x7fae50047d90 comp rx=0 tx=0).stop 2024-02-16T10:30:46.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 msgr2=0x556ba0e55340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x556ba0e3b920 tx=0x7fae4800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 shutdown_connections 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad300342b0 0x7fad30036770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/256184548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0e54f20 0x556ba0e55340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 >> 172.21.15.138:0/256184548 conn(0x556ba0e49d30 msgr2=0x556ba0e4a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 shutdown_connections 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/256184548 wait complete. 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 msgr2=0x556ba0e41530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 0x556ba0e41530 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 msgr2=0x556ba0e46a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 0x556ba0e46a20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 msgr2=0x7fad3c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 0x7fad3c036770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0ae000 tx=0x7fae4c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 msgr2=0x556ba0e3a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e70 tx=0x7fae50001260 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 shutdown_connections 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556ba0e431c0 0x556ba0e46a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556ba0d4baf0 0x556ba0e41530 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad3c0342b0 0x7fad3c036770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 --2- 172.21.15.138:0/1401116817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556ba0d475e0 0x556ba0e3a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 >> 172.21.15.138:0/1401116817 conn(0x556ba0d42eb0 msgr2=0x556ba0cbbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 shutdown_connections 2024-02-16T10:30:46.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.692+0000 7fae58a49980 1 -- 172.21.15.138:0/1401116817 wait complete. 2024-02-16T10:30:46.710 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:46.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:46.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:46.711 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:46.786 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.787 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd7923dd980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fbb54a89b0 0x55fbb54aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd7923dd980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fbb53f0b50 con 0x55fbb5418710 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd7923dd980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fbb53b7d30 con 0x55fbb54a89b0 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78f6f7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fbb54a89b0 0x55fbb54aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78f6f7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fbb54a89b0 0x55fbb54aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36210/0 (socket says 172.21.15.138:36210) 2024-02-16T10:30:46.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78f6f7640 1 -- 172.21.15.138:0/2660156561 learned_addr learned my addr 172.21.15.138:0/2660156561 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78fef8640 1 --1- 172.21.15.138:0/2660156561 >> v1:172.21.15.107:6789/0 conn(0x55fbb5418710 0x55fbb54a7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53296/0 (socket says 172.21.15.138:53296) 2024-02-16T10:30:46.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78f6f7640 1 -- 172.21.15.138:0/2660156561 >> v1:172.21.15.107:6789/0 conn(0x55fbb5418710 legacy=0x55fbb54a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.780+0000 7fd78f6f7640 1 -- 172.21.15.138:0/2660156561 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb54ac380 con 0x55fbb54a89b0 2024-02-16T10:30:46.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/2660156561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb54aada0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd78400a5c0 tx=0x7fd78401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a483a822ed324d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd78eef6640 1 -- 172.21.15.138:0/2660156561 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7840aa470 con 0x55fbb54a89b0 2024-02-16T10:30:46.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd78eef6640 1 -- 172.21.15.138:0/2660156561 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7840aa5d0 con 0x55fbb54a89b0 2024-02-16T10:30:46.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd78eef6640 1 -- 172.21.15.138:0/2660156561 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7840aa890 con 0x55fbb54a89b0 2024-02-16T10:30:46.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 -- 172.21.15.138:0/2660156561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 msgr2=0x55fbb54aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2660156561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb54aada0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd78400a5c0 tx=0x7fd78401b340 comp rx=0 tx=0).stop 2024-02-16T10:30:46.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 -- 172.21.15.138:0/2660156561 shutdown_connections 2024-02-16T10:30:46.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2660156561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb54aada0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 -- 172.21.15.138:0/2660156561 >> 172.21.15.138:0/2660156561 conn(0x55fbb549ed70 msgr2=0x55fbb54a1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 -- 172.21.15.138:0/2660156561 shutdown_connections 2024-02-16T10:30:46.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.784+0000 7fd7923dd980 1 -- 172.21.15.138:0/2660156561 wait complete. 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.796+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.796+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.796+0000 7fd7923dd980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.796+0000 7fd7923dd980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb53b4fc0 con 0x55fbb5418710 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36212/0 (socket says 172.21.15.138:36212) 2024-02-16T10:30:46.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 -- 172.21.15.138:0/3833606313 learned_addr learned my addr 172.21.15.138:0/3833606313 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 -- 172.21.15.138:0/3833606313 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784005df0 con 0x55fbb5418710 2024-02-16T10:30:46.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- 172.21.15.138:0/3833606313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd788006fc0 tx=0x7fd7880019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1f742a8389b34f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd67de0b640 1 -- 172.21.15.138:0/3833606313 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd788013420 con 0x55fbb5418710 2024-02-16T10:30:46.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd67de0b640 1 -- 172.21.15.138:0/3833606313 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788013580 con 0x55fbb5418710 2024-02-16T10:30:46.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd67de0b640 1 -- 172.21.15.138:0/3833606313 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd788013880 con 0x55fbb5418710 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/3833606313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 msgr2=0x55fbb558e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 --2- 172.21.15.138:0/3833606313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd788006fc0 tx=0x7fd7880019b0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/3833606313 shutdown_connections 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 --2- 172.21.15.138:0/3833606313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb5418710 0x55fbb558e650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/3833606313 >> 172.21.15.138:0/3833606313 conn(0x55fbb549ed70 msgr2=0x55fbb558a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/3833606313 shutdown_connections 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/3833606313 wait complete. 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb53b07a0 con 0x55fbb54a89b0 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36226/0 (socket says 172.21.15.138:36226) 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 -- 172.21.15.138:0/224540892 learned_addr learned my addr 172.21.15.138:0/224540892 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb53f0b50 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd78fef8640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55fbb558f4e0 tx=0x7fd788001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd677fff640 1 -- 172.21.15.138:0/224540892 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd788006320 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbb5595d30 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.800+0000 7fd677fff640 1 -- 172.21.15.138:0/224540892 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788006840 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd677fff640 1 -- 172.21.15.138:0/224540892 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd788004bb0 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbb55961e0 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd677fff640 1 -- 172.21.15.138:0/224540892 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd788004d10 con 0x55fbb54a89b0 2024-02-16T10:30:46.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd677fff640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 0x7fd678036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd677fff640 1 -- 172.21.15.138:0/224540892 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd7880496d0 con 0x55fbb54a89b0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 0x7fd678036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 0x55fbb559c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb559ce00 con 0x55fbb559a4d0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 0x55fbb559c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 0x7fd678036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7840ae000 tx=0x7fd7840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 0x55fbb559c8c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 -- 172.21.15.138:0/224540892 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7800083f0 con 0x55fbb559a4d0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb5599c00 con 0x55fbb559a4d0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 -- 172.21.15.138:0/224540892 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd7800083f0 con 0x55fbb559a4d0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb559eb30 con 0x55fbb559a4d0 2024-02-16T10:30:46.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 -- 172.21.15.138:0/224540892 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd7800083f0 con 0x55fbb559a4d0 2024-02-16T10:30:46.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb559dc70 con 0x55fbb559a4d0 2024-02-16T10:30:46.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7906f9640 1 -- 172.21.15.138:0/224540892 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd7800083f0 con 0x55fbb559a4d0 2024-02-16T10:30:46.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 0x55fbb55a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55a24c0 con 0x55fbb559e590 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd78fef8640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 0x55fbb55a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.804+0000 7fd78fef8640 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 0x55fbb55a1eb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd78fef8640 1 -- 172.21.15.138:0/224540892 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd788024070 con 0x55fbb559e590 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb5348f20 con 0x55fbb55b03b0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36236/0 (socket says 172.21.15.138:36236) 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7906f9640 1 -- 172.21.15.138:0/2625837716 learned_addr learned my addr 172.21.15.138:0/2625837716 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7906f9640 1 -- 172.21.15.138:0/2625837716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb55b0d10 con 0x55fbb55b03b0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7906f9640 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55fbb5596c20 tx=0x7fd78000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd6757fa640 1 -- 172.21.15.138:0/2625837716 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd78000f040 con 0x55fbb55b03b0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd6757fa640 1 -- 172.21.15.138:0/2625837716 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780019550 con 0x55fbb55b03b0 2024-02-16T10:30:46.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd6757fa640 1 -- 172.21.15.138:0/2625837716 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd780019830 con 0x55fbb55b03b0 2024-02-16T10:30:46.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbb55b0f60 con 0x55fbb55b03b0 2024-02-16T10:30:46.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbb55b1ab0 con 0x55fbb55b03b0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.808+0000 7fd6757fa640 1 -- 172.21.15.138:0/2625837716 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd780019990 con 0x55fbb55b03b0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd6757fa640 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 0x7fd6680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd6757fa640 1 -- 172.21.15.138:0/2625837716 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd78004b430 con 0x55fbb55b03b0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd78fef8640 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 0x7fd6680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd78fef8640 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 0x7fd6680367c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd788047b80 tx=0x7fd788047a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb533c790 con 0x55fbb55bd2f0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36238/0 (socket says 172.21.15.138:36238) 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 -- 172.21.15.138:0/2498026402 learned_addr learned my addr 172.21.15.138:0/2498026402 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 -- 172.21.15.138:0/2498026402 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb55bdce0 con 0x55fbb55bd2f0 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 --2- 172.21.15.138:0/2498026402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd78000bfd0 tx=0x7fd7800156b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a310dc9443c2333c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd66effd640 1 -- 172.21.15.138:0/2498026402 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd78003b560 con 0x55fbb55bd2f0 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd66effd640 1 -- 172.21.15.138:0/2498026402 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78004b0d0 con 0x55fbb55bd2f0 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd66effd640 1 -- 172.21.15.138:0/2498026402 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd780020360 con 0x55fbb55bd2f0 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- 172.21.15.138:0/2498026402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 msgr2=0x55fbb55bd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2498026402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd78000bfd0 tx=0x7fd7800156b0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- 172.21.15.138:0/2498026402 shutdown_connections 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2498026402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55bd710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- 172.21.15.138:0/2498026402 >> 172.21.15.138:0/2498026402 conn(0x55fbb55b7e70 msgr2=0x55fbb55b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- 172.21.15.138:0/2498026402 shutdown_connections 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- 172.21.15.138:0/2498026402 wait complete. 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 Processor -- start 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- start start 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7923dd980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbb55c4530 con 0x55fbb55bd2f0 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36240/0 (socket says 172.21.15.138:36240) 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 learned_addr learned my addr 172.21.15.138:0/146229962 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.812+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbb55b1ab0 con 0x55fbb55bd2f0 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7906f9640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd780048740 tx=0x7fd7800497b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 -- 172.21.15.138:0/146229962 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd780020e90 con 0x55fbb55bd2f0 2024-02-16T10:30:46.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fbb55c4730 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbb55c4b60 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 -- 172.21.15.138:0/146229962 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780019c40 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 -- 172.21.15.138:0/146229962 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd780017b80 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 -- 172.21.15.138:0/146229962 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd780017ce0 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd658034300 0x7fd6580367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd66d7fa640 1 -- 172.21.15.138:0/146229962 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd780037c70 con 0x55fbb55bd2f0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78fef8640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd658034300 0x7fd6580367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb55cf720 0x55fbb55d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d2330 con 0x55fbb55cf720 2024-02-16T10:30:46.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb55cf720 0x55fbb55d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78fef8640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd658034300 0x7fd6580367c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55fbb55a2860 tx=0x7fd788032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb55cf720 0x55fbb55d1be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 realm 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d2720 con 0x55fbb55cf720 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d2f70 con 0x55fbb55cf720 2024-02-16T10:30:46.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d32d0 con 0x55fbb55cf720 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d2bd0 con 0x55fbb55cf720 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 20 searching for the correct realm 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fbb55d5650 0x55fbb55d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.816+0000 7fd7906f9640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fbb55d5650 0x55fbb55d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd7906f9640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fbb55d5650 0x55fbb55d7a40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd7906f9640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd78003b050 0x7fd780022450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78fef8640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd78003b050 0x7fd780022450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78fef8640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd78003b050 0x7fd780022450 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78fef8640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd788027020 0x7fd788010590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd788027020 0x7fd788010590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd788027020 0x7fd788010590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.820+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.824+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780012070 con 0x55fbb55d5650 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.828+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55d5650 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd788027020 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x55fbb55cf720 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d80c0 con 0x7fd78003b050 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d40f0 con 0x55fbb55cf720 2024-02-16T10:30:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d3d70 con 0x55fbb55cf720 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d49c0 con 0x7fd78003b050 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 zone default found 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 4 Realm: () 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:46.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 zonegroup default 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d8530 con 0x7fd788027020 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55da3b0 con 0x55fbb55d5650 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55da710 con 0x55fbb55d5650 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:46.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 started sync module instance, tier type = 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.832+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d9980 con 0x7fd78003b050 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539567961312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55da710 con 0x7fd78003b050 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55db0c0 con 0x55fbb55cf720 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539567961312] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539567963440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55db470 con 0x55fbb55cf720 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.836+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dbde0 con 0x55fbb55d5650 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539567963440] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539567970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dbd60 con 0x55fbb55d5650 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dabe0 con 0x7fd78003b050 2024-02-16T10:30:46.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539567974352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dd090 con 0x7fd78003b050 2024-02-16T10:30:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dda00 con 0x55fbb55cf720 2024-02-16T10:30:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539567970624] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539567974352] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539567972752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dda00 con 0x55fbb55cf720 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.840+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55de250 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539567972752] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539567978096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55ddfd0 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55deaa0 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539567978096] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539567981952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dea60 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.844+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55df480 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539567984480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55df8e0 con 0x7fd788027020 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=0 2024-02-16T10:30:46.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=1 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=2 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=3 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=4 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=5 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539567981952] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=6 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539567984480] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 20 add_watcher() i=7 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dda90 con 0x55fbb55cf720 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.848+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539567985728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dda90 con 0x55fbb55cf720 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539567985728] v31'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 5 note: GC not initialized 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd644fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 Filter name: none 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd5be7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 rados->read ofs=0 len=0 2024-02-16T10:30:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb5604220 con 0x55fbb55cf720 2024-02-16T10:30:46.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:46.864 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:46.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd645fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:46.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539567985728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55e4eb0 con 0x55fbb55cf720 2024-02-16T10:30:46.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94539567985728] v31'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.852+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539567961312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55df440 con 0x7fd78003b050 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94539567961312] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd7923dd980 20 remove_watcher() i=0 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd7923dd980 2 removed watcher, disabling cache 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539567963440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d94e0 con 0x55fbb55cf720 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94539567963440] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd7923dd980 20 remove_watcher() i=1 2024-02-16T10:30:46.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.856+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539567970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d94e0 con 0x55fbb55d5650 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7906f9640 1 -- 172.21.15.138:0/146229962 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94539567970624] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd780061040 con 0x55fbb55d5650 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 20 remove_watcher() i=2 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539567974352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55db940 con 0x7fd78003b050 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd78fef8640 1 -- 172.21.15.138:0/146229962 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94539567974352] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd788024070 con 0x7fd78003b050 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 20 remove_watcher() i=3 2024-02-16T10:30:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539567972752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d94e0 con 0x55fbb55cf720 2024-02-16T10:30:46.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94539567972752] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x55fbb55cf720 2024-02-16T10:30:46.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 20 remove_watcher() i=4 2024-02-16T10:30:46.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.860+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539567978096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55dc7d0 con 0x7fd788027020 2024-02-16T10:30:46.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94539567978096] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd7923dd980 20 remove_watcher() i=5 2024-02-16T10:30:46.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539567981952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55db940 con 0x7fd788027020 2024-02-16T10:30:46.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94539567981952] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd7923dd980 20 remove_watcher() i=6 2024-02-16T10:30:46.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.864+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539567984480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fbb55d94e0 con 0x7fd788027020 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94539567984480] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7840b0020 con 0x7fd788027020 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 20 remove_watcher() i=7 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd788027020 msgr2=0x7fd788010590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd788027020 0x7fd788010590 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb55cf720 msgr2=0x55fbb55d1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb55cf720 0x55fbb55d1be0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd78003b050 msgr2=0x7fd780022450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd78003b050 0x7fd780022450 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fbb55d5650 msgr2=0x55fbb55d7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fbb55d5650 0x55fbb55d7a40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd658034300 msgr2=0x7fd6580367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd658034300 0x7fd6580367c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55fbb55a2860 tx=0x7fd788032000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd78f6f7640 1 -- 172.21.15.138:0/146229962 reap_dead start 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 msgr2=0x55fbb55c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd780048740 tx=0x7fd7800497b0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 shutdown_connections 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/146229962 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55bd2f0 0x55fbb55c3ff0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 >> 172.21.15.138:0/146229962 conn(0x55fbb55b7e70 msgr2=0x55fbb55b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 shutdown_connections 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/146229962 wait complete. 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 msgr2=0x7fd6680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 0x7fd6680367c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd788047b80 tx=0x7fd788047a50 comp rx=0 tx=0).stop 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 msgr2=0x55fbb55b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55fbb5596c20 tx=0x7fd78000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 shutdown_connections 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd668034300 0x7fd6680367c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/2625837716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb55b03b0 0x55fbb55b07d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 >> 172.21.15.138:0/2625837716 conn(0x55fbb55a51c0 msgr2=0x55fbb55a5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 shutdown_connections 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/2625837716 wait complete. 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 msgr2=0x55fbb559c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 0x55fbb559c8c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 msgr2=0x55fbb55a1eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 0x55fbb55a1eb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 msgr2=0x7fd678036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 0x7fd678036770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd7840ae000 tx=0x7fd7840a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 msgr2=0x55fbb55957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55fbb558f4e0 tx=0x7fd788001260 comp rx=0 tx=0).stop 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 shutdown_connections 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fbb559e590 0x55fbb55a1eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fbb559a4d0 0x55fbb559c8c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6780342b0 0x7fd678036770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 --2- 172.21.15.138:0/224540892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fbb54a89b0 0x55fbb55957f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 >> 172.21.15.138:0/224540892 conn(0x55fbb549ed70 msgr2=0x55fbb5588cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 shutdown_connections 2024-02-16T10:30:46.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.868+0000 7fd7923dd980 1 -- 172.21.15.138:0/224540892 wait complete. 2024-02-16T10:30:46.886 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:46.886 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T10:30:46.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T10:30:46.887 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T10:30:46.964 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:46.964 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:46.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.956+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.956+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.956+0000 7f6226bce980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cdcce85620 0x55cdcce85a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.956+0000 7f6226bce980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cdccdd1b50 con 0x55cdcce85f40 2024-02-16T10:30:46.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.956+0000 7f6226bce980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cdccd98d30 con 0x55cdcce85620 2024-02-16T10:30:46.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cdcce85620 0x55cdcce85a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cdcce85620 0x55cdcce85a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36250/0 (socket says 172.21.15.138:36250) 2024-02-16T10:30:46.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 -- 172.21.15.138:0/3548744982 learned_addr learned my addr 172.21.15.138:0/3548744982 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 -- 172.21.15.138:0/3548744982 >> v1:172.21.15.107:6789/0 conn(0x55cdcce85f40 legacy=0x55cdcce868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 -- 172.21.15.138:0/3548744982 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdcce870e0 con 0x55cdcce85620 2024-02-16T10:30:46.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62246e9640 1 --2- 172.21.15.138:0/3548744982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdcce85a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a4e0 tx=0x7f621c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eec24a86729ae2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62236e7640 1 -- 172.21.15.138:0/3548744982 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0aa540 con 0x55cdcce85620 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62236e7640 1 -- 172.21.15.138:0/3548744982 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0a6070 con 0x55cdcce85620 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f62236e7640 1 -- 172.21.15.138:0/3548744982 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0aa850 con 0x55cdcce85620 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 -- 172.21.15.138:0/3548744982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 msgr2=0x55cdcce85a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 --2- 172.21.15.138:0/3548744982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdcce85a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f621c00a4e0 tx=0x7f621c01b090 comp rx=0 tx=0).stop 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 -- 172.21.15.138:0/3548744982 shutdown_connections 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 --2- 172.21.15.138:0/3548744982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdcce85a00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 -- 172.21.15.138:0/3548744982 >> 172.21.15.138:0/3548744982 conn(0x55cdcce80ef0 msgr2=0x55cdcce83310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 -- 172.21.15.138:0/3548744982 shutdown_connections 2024-02-16T10:30:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.960+0000 7f6226bce980 1 -- 172.21.15.138:0/3548744982 wait complete. 2024-02-16T10:30:46.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.972+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdccd95fc0 con 0x55cdcce85620 2024-02-16T10:30:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36262/0 (socket says 172.21.15.138:36262) 2024-02-16T10:30:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 -- 172.21.15.138:0/4152466465 learned_addr learned my addr 172.21.15.138:0/4152466465 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 -- 172.21.15.138:0/4152466465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c00a1c0 con 0x55cdcce85620 2024-02-16T10:30:46.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 --2- 172.21.15.138:0/4152466465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f621c019740 tx=0x7f621c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53336867db4ac201 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f611260c640 1 -- 172.21.15.138:0/4152466465 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0aa6f0 con 0x55cdcce85620 2024-02-16T10:30:46.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f611260c640 1 -- 172.21.15.138:0/4152466465 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0aa850 con 0x55cdcce85620 2024-02-16T10:30:46.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f611260c640 1 -- 172.21.15.138:0/4152466465 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0aaaf0 con 0x55cdcce85620 2024-02-16T10:30:46.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- 172.21.15.138:0/4152466465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 msgr2=0x55cdccf6fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 --2- 172.21.15.138:0/4152466465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f621c019740 tx=0x7f621c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- 172.21.15.138:0/4152466465 shutdown_connections 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 --2- 172.21.15.138:0/4152466465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf6fbd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- 172.21.15.138:0/4152466465 >> 172.21.15.138:0/4152466465 conn(0x55cdcce80ef0 msgr2=0x55cdccf6b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- 172.21.15.138:0/4152466465 shutdown_connections 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- 172.21.15.138:0/4152466465 wait complete. 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f6226bce980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdccd917a0 con 0x55cdcce85620 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36264/0 (socket says 172.21.15.138:36264) 2024-02-16T10:30:46.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 -- 172.21.15.138:0/3606022387 learned_addr learned my addr 172.21.15.138:0/3606022387 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.976+0000 7f62246e9640 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdcce870e0 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f62246e9640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f621c019740 tx=0x7f621c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 -- 172.21.15.138:0/3606022387 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0c4070 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdccf76f40 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 -- 172.21.15.138:0/3606022387 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0b5570 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 -- 172.21.15.138:0/3606022387 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621c0b5810 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdccf773f0 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 -- 172.21.15.138:0/3606022387 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f621c0a8070 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 0x7f610c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6110e09640 1 -- 172.21.15.138:0/3606022387 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f621c0e3df0 con 0x55cdcce85620 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6223ee8640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 0x7f610c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 0x55cdccf7d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccf7dc30 con 0x55cdcce85f40 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 0x55cdccf7d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6223ee8640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 0x7f610c036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f620c001e20 tx=0x7f620c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 0x55cdccf7d6f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 -- 172.21.15.138:0/3606022387 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f62140083f0 con 0x55cdcce85f40 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccf7ae40 con 0x55cdcce85f40 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 -- 172.21.15.138:0/3606022387 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f62140083f0 con 0x55cdcce85f40 2024-02-16T10:30:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccf7f990 con 0x55cdcce85f40 2024-02-16T10:30:46.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 -- 172.21.15.138:0/3606022387 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f62140083f0 con 0x55cdcce85f40 2024-02-16T10:30:46.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccf7eb90 con 0x55cdcce85f40 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6224eea640 1 -- 172.21.15.138:0/3606022387 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f62140083f0 con 0x55cdcce85f40 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 0x55cdccf82d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccf83360 con 0x55cdccf7f4b0 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.980+0000 7f62246e9640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 0x55cdccf82d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f62246e9640 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 0x55cdccf82d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f62246e9640 1 -- 172.21.15.138:0/3606022387 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f621c0c97a0 con 0x55cdccf7f4b0 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdccd29f20 con 0x55cdccf91270 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36268/0 (socket says 172.21.15.138:36268) 2024-02-16T10:30:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6224eea640 1 -- 172.21.15.138:0/2132801919 learned_addr learned my addr 172.21.15.138:0/2132801919 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6224eea640 1 -- 172.21.15.138:0/2132801919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdccf91bd0 con 0x55cdccf91270 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6224eea640 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55cdccf77c50 tx=0x7f621400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 -- 172.21.15.138:0/2132801919 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f621400f040 con 0x55cdccf91270 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 -- 172.21.15.138:0/2132801919 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214019550 con 0x55cdccf91270 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdccf91e20 con 0x55cdccf91270 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 -- 172.21.15.138:0/2132801919 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6214019810 con 0x55cdccf91270 2024-02-16T10:30:46.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdccf92970 con 0x55cdccf91270 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 -- 172.21.15.138:0/2132801919 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6214019a40 con 0x55cdccf91270 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 0x7f60fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f6109ffb640 1 -- 172.21.15.138:0/2132801919 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f621404b4b0 con 0x55cdccf91270 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.984+0000 7f62246e9640 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 0x7f60fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f62246e9640 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 0x7f60fc036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55cdccf7e5d0 tx=0x7f621c0b4880 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdccd1d790 con 0x55cdccf9e1f0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36270/0 (socket says 172.21.15.138:36270) 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 -- 172.21.15.138:0/3592674681 learned_addr learned my addr 172.21.15.138:0/3592674681 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 -- 172.21.15.138:0/3592674681 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdccf9ebe0 con 0x55cdccf9e1f0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- 172.21.15.138:0/3592674681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f621400efb0 tx=0x7f62140177b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d5aa1023cd1997 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f61037fe640 1 -- 172.21.15.138:0/3592674681 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62140153a0 con 0x55cdccf9e1f0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f61037fe640 1 -- 172.21.15.138:0/3592674681 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214015500 con 0x55cdccf9e1f0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f61037fe640 1 -- 172.21.15.138:0/3592674681 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6214015df0 con 0x55cdccf9e1f0 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- 172.21.15.138:0/3592674681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 msgr2=0x55cdccf9e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 --2- 172.21.15.138:0/3592674681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f621400efb0 tx=0x7f62140177b0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- 172.21.15.138:0/3592674681 shutdown_connections 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 --2- 172.21.15.138:0/3592674681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccf9e610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- 172.21.15.138:0/3592674681 >> 172.21.15.138:0/3592674681 conn(0x55cdccf98d70 msgr2=0x55cdccf99c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- 172.21.15.138:0/3592674681 shutdown_connections 2024-02-16T10:30:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- 172.21.15.138:0/3592674681 wait complete. 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 Processor -- start 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- start start 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6226bce980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdccfa53f0 con 0x55cdccf9e1f0 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36276/0 (socket says 172.21.15.138:36276) 2024-02-16T10:30:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 learned_addr learned my addr 172.21.15.138:0/2889033993 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdccf92970 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6224eea640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f621404b420 tx=0x7f6214049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.988+0000 7f6101ffb640 1 -- 172.21.15.138:0/2889033993 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62140153a0 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6101ffb640 1 -- 172.21.15.138:0/2889033993 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214019cf0 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdccfa55f0 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6101ffb640 1 -- 172.21.15.138:0/2889033993 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6214017a70 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdccfa5a80 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6101ffb640 1 -- 172.21.15.138:0/2889033993 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6214042070 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6101ffb640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60f4034260 0x7f60f4036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6101ffb640 1 -- 172.21.15.138:0/2889033993 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6214037cb0 con 0x55cdccf9e1f0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f62246e9640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60f4034260 0x7f60f4036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdccfb0640 0x55cdccfb2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb3250 con 0x55cdccfb0640 2024-02-16T10:30:47.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdccfb0640 0x55cdccfb2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdccfb0640 0x55cdccfb2b00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f62246e9640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60f4034260 0x7f60f4036720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f621c0c9ab0 tx=0x7f621c0e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 realm 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfafbb0 con 0x55cdccfb0640 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb3d20 con 0x55cdccfb0640 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb45a0 con 0x55cdccfb0640 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb4900 con 0x55cdccfb0640 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 20 searching for the correct realm 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cdccfb69d0 0x55cdccfb8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6224eea640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cdccfb69d0 0x55cdccfb8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.992+0000 7f6224eea640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cdccfb69d0 0x55cdccfb8e90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214012070 con 0x55cdccfb69d0 2024-02-16T10:30:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6224eea640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6214036070 0x7f62140460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f62246e9640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6214036070 0x7f62140460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f62246e9640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6214036070 0x7f62140460b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f62246e9640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f621c0fa040 0x7f621c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f621c0fa040 0x7f621c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f621c0fa040 0x7f621c0a93c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:46.996+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214012070 con 0x55cdccfb69d0 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214012070 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214012070 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.000+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb69d0 2024-02-16T10:30:47.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.004+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f621c0fa040 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x55cdccfb0640 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9560 con 0x7f6214036070 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb52d0 con 0x55cdccfb0640 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb5680 con 0x55cdccfb0640 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb5a60 con 0x7f6214036070 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 zone default found 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 4 Realm: () 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 zonegroup default 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfb9e40 con 0x7f621c0fa040 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbba00 con 0x55cdccfb69d0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbbf00 con 0x55cdccfb69d0 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 started sync module instance, tier type = 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.008+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbad20 con 0x7f6214036070 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94342395701376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbb0d0 con 0x7f6214036070 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbcca0 con 0x55cdccfb0640 2024-02-16T10:30:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94342395701376] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94342395708192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbd050 con 0x55cdccfb0640 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.012+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbd9c0 con 0x55cdccfb69d0 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94342395712800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbd940 con 0x55cdccfb69d0 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbe8b0 con 0x7f6214036070 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94342395708192] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94342395716528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbec60 con 0x7f6214036070 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbf5d0 con 0x55cdccfb0640 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94342395712800] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94342395716528] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94342395714928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbc850 con 0x55cdccfb0640 2024-02-16T10:30:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.016+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbfe20 con 0x7f621c0fa040 2024-02-16T10:30:47.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94342395714928] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94342395719984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbfd40 con 0x7f621c0fa040 2024-02-16T10:30:47.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc06b0 con 0x7f621c0fa040 2024-02-16T10:30:47.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94342395719984] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94342395722160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc06b0 con 0x7f621c0fa040 2024-02-16T10:30:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.020+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc0ef0 con 0x7f621c0fa040 2024-02-16T10:30:47.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94342395725488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc1590 con 0x7f621c0fa040 2024-02-16T10:30:47.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=0 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=1 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=2 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=3 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=4 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=5 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94342395722160] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=6 2024-02-16T10:30:47.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94342395725488] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 20 add_watcher() i=7 2024-02-16T10:30:47.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc4490 con 0x55cdccfb0640 2024-02-16T10:30:47.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.024+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94342395727808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc1880 con 0x55cdccfb0640 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94342395727808] v31'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f60da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 5 note: GC not initialized 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f60d97e2640 20 reqs_thread_entry: start 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 Filter name: none 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f604affd640 20 reqs_thread_entry: start 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfe61e0 con 0x55cdccfb0640 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfe85a0 con 0x7f6214036070 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfebd20 con 0x55cdccfb0640 2024-02-16T10:30:47.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~358] v31'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94342395902400 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfe8a40 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94342395714928 notify 133143986178 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f620c037040 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f61037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94342395714928 notifier 4325 bl.length()=534 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f61037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 notify.4 [notify cookie 94342395902400 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f61037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f61037fe640 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f60e8003ea0 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.028+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94342395902400 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f620c009050 con 0x55cdccfb0640 2024-02-16T10:30:47.039 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f60da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94342395727808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfe51a0 con 0x55cdccfb0640 2024-02-16T10:30:47.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94342395727808] v31'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94342395701376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc0fc0 con 0x7f6214036070 2024-02-16T10:30:47.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94342395701376] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6226bce980 20 remove_watcher() i=0 2024-02-16T10:30:47.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6226bce980 2 removed watcher, disabling cache 2024-02-16T10:30:47.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.032+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94342395708192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc0fc0 con 0x55cdccfb0640 2024-02-16T10:30:47.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94342395708192] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 20 remove_watcher() i=1 2024-02-16T10:30:47.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94342395712800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbc320 con 0x55cdccfb69d0 2024-02-16T10:30:47.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6224eea640 1 -- 172.21.15.138:0/2889033993 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94342395712800] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6214060040 con 0x55cdccfb69d0 2024-02-16T10:30:47.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 20 remove_watcher() i=2 2024-02-16T10:30:47.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94342395716528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfc0fc0 con 0x7f6214036070 2024-02-16T10:30:47.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f62246e9640 1 -- 172.21.15.138:0/2889033993 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94342395716528] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f621c0c97a0 con 0x7f6214036070 2024-02-16T10:30:47.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 20 remove_watcher() i=3 2024-02-16T10:30:47.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.036+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94342395714928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbd520 con 0x55cdccfb0640 2024-02-16T10:30:47.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94342395714928] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x55cdccfb0640 2024-02-16T10:30:47.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6226bce980 20 remove_watcher() i=4 2024-02-16T10:30:47.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94342395719984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbc320 con 0x7f621c0fa040 2024-02-16T10:30:47.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94342395719984] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c0105b0 con 0x7f621c0fa040 2024-02-16T10:30:47.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6226bce980 20 remove_watcher() i=5 2024-02-16T10:30:47.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.040+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94342395722160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbe3b0 con 0x7f621c0fa040 2024-02-16T10:30:47.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94342395722160] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c046040 con 0x7f621c0fa040 2024-02-16T10:30:47.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 20 remove_watcher() i=6 2024-02-16T10:30:47.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94342395725488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cdccfbe3b0 con 0x7f621c0fa040 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94342395725488] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f620c046040 con 0x7f621c0fa040 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 20 remove_watcher() i=7 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f621c0fa040 msgr2=0x7f621c0a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f621c0fa040 0x7f621c0a93c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdccfb0640 msgr2=0x55cdccfb2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdccfb0640 0x55cdccfb2b00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6214036070 msgr2=0x7f62140460b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6214036070 0x7f62140460b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cdccfb69d0 msgr2=0x55cdccfb8e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cdccfb69d0 0x55cdccfb8e90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60f4034260 msgr2=0x7f60f4036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60f4034260 0x7f60f4036720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f621c0c9ab0 tx=0x7f621c0e7000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 msgr2=0x55cdccfa4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6223ee8640 1 -- 172.21.15.138:0/2889033993 reap_dead start 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f621404b420 tx=0x7f6214049830 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 shutdown_connections 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 --2- 172.21.15.138:0/2889033993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf9e1f0 0x55cdccfa4eb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.044+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 >> 172.21.15.138:0/2889033993 conn(0x55cdccf98d70 msgr2=0x55cdccf99c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 shutdown_connections 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2889033993 wait complete. 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 msgr2=0x7f60fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 0x7f60fc036770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55cdccf7e5d0 tx=0x7f621c0b4880 comp rx=0 tx=0).stop 2024-02-16T10:30:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 msgr2=0x55cdccf91690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55cdccf77c50 tx=0x7f621400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 shutdown_connections 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60fc0342b0 0x7f60fc036770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/2132801919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdccf91270 0x55cdccf91690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 >> 172.21.15.138:0/2132801919 conn(0x55cdccf86080 msgr2=0x55cdccf86b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 shutdown_connections 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/2132801919 wait complete. 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 msgr2=0x55cdccf7d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 0x55cdccf7d6f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 msgr2=0x55cdccf82d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 0x55cdccf82d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 msgr2=0x7f610c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 0x7f610c036770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f620c001e20 tx=0x7f620c0013a0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 msgr2=0x55cdccf76a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f621c019740 tx=0x7f621c017e30 comp rx=0 tx=0).stop 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 shutdown_connections 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cdccf7f4b0 0x55cdccf82d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cdcce85f40 0x55cdccf7d6f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f610c0342b0 0x7f610c036770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 --2- 172.21.15.138:0/3606022387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cdcce85620 0x55cdccf76a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 >> 172.21.15.138:0/3606022387 conn(0x55cdcce80ef0 msgr2=0x55cdccf6a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 shutdown_connections 2024-02-16T10:30:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.048+0000 7f6226bce980 1 -- 172.21.15.138:0/3606022387 wait complete. 2024-02-16T10:30:47.064 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:47.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:47.064 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:47.132 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd887f7a980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561b9960c750 0x561b9969b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd887f7a980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b995e4b50 con 0x561b9969b790 2024-02-16T10:30:47.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd887f7a980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b995abd30 con 0x561b9960c750 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885a95640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561b9960c750 0x561b9969b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885a95640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561b9960c750 0x561b9969b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36278/0 (socket says 172.21.15.138:36278) 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885a95640 1 -- 172.21.15.138:0/4164943148 learned_addr learned my addr 172.21.15.138:0/4164943148 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885294640 1 --1- 172.21.15.138:0/4164943148 >> v1:172.21.15.107:6789/0 conn(0x561b9969b790 0x561b9969db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53302/0 (socket says 172.21.15.138:53302) 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885a95640 1 -- 172.21.15.138:0/4164943148 >> v1:172.21.15.107:6789/0 conn(0x561b9969b790 legacy=0x561b9969db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.124+0000 7fd885a95640 1 -- 172.21.15.138:0/4164943148 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b996a0370 con 0x561b9960c750 2024-02-16T10:30:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.128+0000 7fd885a95640 1 --2- 172.21.15.138:0/4164943148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b9969b250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00a5c0 tx=0x7fd87c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10d9549a154868c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.128+0000 7fd884a93640 1 -- 172.21.15.138:0/4164943148 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0aa470 con 0x561b9960c750 2024-02-16T10:30:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.128+0000 7fd884a93640 1 -- 172.21.15.138:0/4164943148 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c0aa5d0 con 0x561b9960c750 2024-02-16T10:30:47.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.128+0000 7fd884a93640 1 -- 172.21.15.138:0/4164943148 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0aa890 con 0x561b9960c750 2024-02-16T10:30:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 -- 172.21.15.138:0/4164943148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 msgr2=0x561b9969b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 --2- 172.21.15.138:0/4164943148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b9969b250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00a5c0 tx=0x7fd87c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 -- 172.21.15.138:0/4164943148 shutdown_connections 2024-02-16T10:30:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 --2- 172.21.15.138:0/4164943148 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b9969b250 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 -- 172.21.15.138:0/4164943148 >> 172.21.15.138:0/4164943148 conn(0x561b99692d70 msgr2=0x561b99695190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 -- 172.21.15.138:0/4164943148 shutdown_connections 2024-02-16T10:30:47.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.132+0000 7fd887f7a980 1 -- 172.21.15.138:0/4164943148 wait complete. 2024-02-16T10:30:47.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b995a8fc0 con 0x561b9960c750 2024-02-16T10:30:47.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36294/0 (socket says 172.21.15.138:36294) 2024-02-16T10:30:47.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 -- 172.21.15.138:0/2103027955 learned_addr learned my addr 172.21.15.138:0/2103027955 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 -- 172.21.15.138:0/2103027955 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c005df0 con 0x561b9960c750 2024-02-16T10:30:47.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 --2- 172.21.15.138:0/2103027955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01b380 tx=0x7fd87c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53f4ccdc89d6b3f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd773e07640 1 -- 172.21.15.138:0/2103027955 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0aa9b0 con 0x561b9960c750 2024-02-16T10:30:47.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd773e07640 1 -- 172.21.15.138:0/2103027955 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c0aab30 con 0x561b9960c750 2024-02-16T10:30:47.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd773e07640 1 -- 172.21.15.138:0/2103027955 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0aae10 con 0x561b9960c750 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- 172.21.15.138:0/2103027955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 msgr2=0x561b997826b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2103027955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01b380 tx=0x7fd87c003030 comp rx=0 tx=0).stop 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- 172.21.15.138:0/2103027955 shutdown_connections 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2103027955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b997826b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- 172.21.15.138:0/2103027955 >> 172.21.15.138:0/2103027955 conn(0x561b99692d70 msgr2=0x561b9977e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- 172.21.15.138:0/2103027955 shutdown_connections 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- 172.21.15.138:0/2103027955 wait complete. 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd887f7a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b995a47a0 con 0x561b9960c750 2024-02-16T10:30:47.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36304/0 (socket says 172.21.15.138:36304) 2024-02-16T10:30:47.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.144+0000 7fd885a95640 1 -- 172.21.15.138:0/2697499039 learned_addr learned my addr 172.21.15.138:0/2697499039 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd885a95640 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b996a0370 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd885a95640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0aa5a0 tx=0x7fd87c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 -- 172.21.15.138:0/2697499039 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0cb070 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b997899c0 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 -- 172.21.15.138:0/2697499039 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c0c6750 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b99789e70 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 -- 172.21.15.138:0/2697499039 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0c69f0 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 -- 172.21.15.138:0/2697499039 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd87c0c6b50 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 0x7fd76c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd772604640 1 -- 172.21.15.138:0/2697499039 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd87c0e4b20 con 0x561b9960c750 2024-02-16T10:30:47.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd885294640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 0x7fd76c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 0x561b99790170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997906b0 con 0x561b9969b790 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 0x561b99790170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd885294640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 0x7fd76c036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd878000f70 tx=0x7fd878001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 0x561b99790170 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 -- 172.21.15.138:0/2697499039 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b9969b790 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b99790aa0 con 0x561b9969b790 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 -- 172.21.15.138:0/2697499039 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b9969b790 2024-02-16T10:30:47.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b99792350 con 0x561b9969b790 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 -- 172.21.15.138:0/2697499039 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b9969b790 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b99791550 con 0x561b9969b790 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd886296640 1 -- 172.21.15.138:0/2697499039 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b9969b790 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 0x561b997956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b99795ce0 con 0x561b99791e70 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.148+0000 7fd885a95640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 0x561b997956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd885a95640 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 0x561b997956d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd885a95640 1 -- 172.21.15.138:0/2697499039 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd87c0cd070 con 0x561b99791e70 2024-02-16T10:30:47.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9953cf20 con 0x561b997a3c30 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36320/0 (socket says 172.21.15.138:36320) 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd886296640 1 -- 172.21.15.138:0/419081967 learned_addr learned my addr 172.21.15.138:0/419081967 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd886296640 1 -- 172.21.15.138:0/419081967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b997a4590 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd886296640 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x561b9978a560 tx=0x7fd8800188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd76b7fe640 1 -- 172.21.15.138:0/419081967 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd88001d070 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd76b7fe640 1 -- 172.21.15.138:0/419081967 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd880014580 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b997a47e0 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd76b7fe640 1 -- 172.21.15.138:0/419081967 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd880014860 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b997a5330 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.152+0000 7fd76b7fe640 1 -- 172.21.15.138:0/419081967 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd880020020 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd76b7fe640 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 0x7fd7600367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd76b7fe640 1 -- 172.21.15.138:0/419081967 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd88004b160 con 0x561b997a3c30 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd885a95640 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 0x7fd7600367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd885a95640 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 0x7fd7600367c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561b99790f90 tx=0x7fd87c0e2f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b99530790 con 0x561b996984d0 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36326/0 (socket says 172.21.15.138:36326) 2024-02-16T10:30:47.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 -- 172.21.15.138:0/3460121102 learned_addr learned my addr 172.21.15.138:0/3460121102 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 -- 172.21.15.138:0/3460121102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b99698ec0 con 0x561b996984d0 2024-02-16T10:30:47.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 --2- 172.21.15.138:0/3460121102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd880049580 tx=0x7fd88002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537245ef18d2e047 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd7697fa640 1 -- 172.21.15.138:0/3460121102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd880016570 con 0x561b996984d0 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd7697fa640 1 -- 172.21.15.138:0/3460121102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8800149c0 con 0x561b996984d0 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd7697fa640 1 -- 172.21.15.138:0/3460121102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8800123a0 con 0x561b996984d0 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- 172.21.15.138:0/3460121102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 msgr2=0x561b996988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3460121102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd880049580 tx=0x7fd88002bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- 172.21.15.138:0/3460121102 shutdown_connections 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3460121102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b996988f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- 172.21.15.138:0/3460121102 >> 172.21.15.138:0/3460121102 conn(0x561b997ab710 msgr2=0x561b997ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- 172.21.15.138:0/3460121102 shutdown_connections 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- 172.21.15.138:0/3460121102 wait complete. 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 Processor -- start 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- start start 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd887f7a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b997ba010 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36328/0 (socket says 172.21.15.138:36328) 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 learned_addr learned my addr 172.21.15.138:0/3863075888 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.156+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b997a5330 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd886296640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd88002b8d0 tx=0x7fd8800494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 -- 172.21.15.138:0/3863075888 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd880033070 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b997ba210 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 -- 172.21.15.138:0/3863075888 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88002b940 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b997ba640 con 0x561b996984d0 2024-02-16T10:30:47.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 -- 172.21.15.138:0/3863075888 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8800133b0 con 0x561b996984d0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 -- 172.21.15.138:0/3863075888 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd880013510 con 0x561b996984d0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd7500342b0 0x7fd750036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd7577fe640 1 -- 172.21.15.138:0/3863075888 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd88004cca0 con 0x561b996984d0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885a95640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd7500342b0 0x7fd750036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b997c51f0 0x561b997c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c7e00 con 0x561b997c51f0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b997c51f0 0x561b997c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b997c51f0 0x561b997c76b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885a95640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd7500342b0 0x7fd750036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cefd0 tx=0x7fd87c0ed000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 realm 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c46d0 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c8880 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c8d40 con 0x561b997c51f0 2024-02-16T10:30:47.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c8500 con 0x561b997c51f0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 20 searching for the correct realm 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561b997cb080 0x561b997cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cdbe0 con 0x561b997cb080 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd886296640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561b997cb080 0x561b997cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.160+0000 7fd886296640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561b997cb080 0x561b997cd510 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b997cb080 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd886296640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd880014070 0x7fd880026a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x7fd880014070 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885a95640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd880014070 0x7fd880026a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885a95640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd880014070 0x7fd880026a50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885a95640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd87c100040 0x7fd87c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x7fd87c100040 2024-02-16T10:30:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd87c100040 0x7fd87c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd87c100040 0x7fd87c0c73f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x561b997c51f0 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x561b997c51f0 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd880038030 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.164+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd880014070 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88000a4d0 con 0x561b997cb080 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd880014070 2024-02-16T10:30:47.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.168+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd880014070 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd880014070 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997cb080 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.172+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd87c100040 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x561b997c51f0 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd87802d040 con 0x7fd880014070 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c9b10 con 0x561b997c51f0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c9ec0 con 0x561b997c51f0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997c9ec0 con 0x7fd880014070 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 zone default found 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 4 Realm: () 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 zonegroup default 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997ca790 con 0x7fd87c100040 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cfa50 con 0x561b997cb080 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cfe20 con 0x561b997cb080 2024-02-16T10:30:47.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 started sync module instance, tier type = 2024-02-16T10:30:47.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997ceee0 con 0x7fd880014070 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.176+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94676539206208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cf6e0 con 0x7fd880014070 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d0930 con 0x561b997c51f0 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94676539206208] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94676539212816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d0ce0 con 0x561b997c51f0 2024-02-16T10:30:47.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.180+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d1650 con 0x561b997cb080 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94676539216304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d1610 con 0x561b997cb080 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d2570 con 0x7fd880014070 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94676539212816] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94676539220112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d2950 con 0x7fd880014070 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d32c0 con 0x561b997c51f0 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94676539216304] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94676539220112] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94676539218432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cf350 con 0x561b997c51f0 2024-02-16T10:30:47.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.184+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d3b10 con 0x7fd87c100040 2024-02-16T10:30:47.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94676539218432] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94676539223584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d3a50 con 0x7fd87c100040 2024-02-16T10:30:47.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d43c0 con 0x7fd87c100040 2024-02-16T10:30:47.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94676539223584] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94676539225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d43c0 con 0x7fd87c100040 2024-02-16T10:30:47.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.188+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d4d30 con 0x7fd87c100040 2024-02-16T10:30:47.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94676539230352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d5190 con 0x7fd87c100040 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=0 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=1 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=2 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=3 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=4 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=5 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94676539225792] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=6 2024-02-16T10:30:47.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94676539230352] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 20 add_watcher() i=7 2024-02-16T10:30:47.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d3f20 con 0x561b997c51f0 2024-02-16T10:30:47.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.192+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94676539231408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d3f20 con 0x561b997c51f0 2024-02-16T10:30:47.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94676539231408] v31'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 5 note: GC not initialized 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd7367fc640 20 reqs_thread_entry: start 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 Filter name: none 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd6a7fff640 20 reqs_thread_entry: start 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997f9c90 con 0x561b997c51f0 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:47.205 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94676539231408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997da810 con 0x561b997c51f0 2024-02-16T10:30:47.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94676539231408] v31'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.196+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94676539206208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d4cb0 con 0x7fd880014070 2024-02-16T10:30:47.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94676539206208] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd887f7a980 20 remove_watcher() i=0 2024-02-16T10:30:47.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd887f7a980 2 removed watcher, disabling cache 2024-02-16T10:30:47.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94676539212816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cea40 con 0x561b997c51f0 2024-02-16T10:30:47.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94676539212816] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd887f7a980 20 remove_watcher() i=1 2024-02-16T10:30:47.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.200+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94676539216304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cea40 con 0x561b997cb080 2024-02-16T10:30:47.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd886296640 1 -- 172.21.15.138:0/3863075888 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94676539216304] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd88005f040 con 0x561b997cb080 2024-02-16T10:30:47.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 20 remove_watcher() i=2 2024-02-16T10:30:47.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94676539220112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cea40 con 0x7fd880014070 2024-02-16T10:30:47.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd885a95640 1 -- 172.21.15.138:0/3863075888 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94676539220112] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87c0cd070 con 0x7fd880014070 2024-02-16T10:30:47.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 20 remove_watcher() i=3 2024-02-16T10:30:47.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94676539218432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997cea40 con 0x561b997c51f0 2024-02-16T10:30:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94676539218432] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x561b997c51f0 2024-02-16T10:30:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 20 remove_watcher() i=4 2024-02-16T10:30:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.204+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94676539223584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d1a00 con 0x7fd87c100040 2024-02-16T10:30:47.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94676539223584] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd887f7a980 20 remove_watcher() i=5 2024-02-16T10:30:47.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94676539225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d2e20 con 0x7fd87c100040 2024-02-16T10:30:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94676539225792] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd887f7a980 20 remove_watcher() i=6 2024-02-16T10:30:47.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.208+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94676539230352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561b997d2e20 con 0x7fd87c100040 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94676539230352] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd87800f620 con 0x7fd87c100040 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 20 remove_watcher() i=7 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd87c100040 msgr2=0x7fd87c0c73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd87c100040 0x7fd87c0c73f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b997c51f0 msgr2=0x561b997c76b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b997c51f0 0x561b997c76b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd880014070 msgr2=0x7fd880026a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd880014070 0x7fd880026a50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561b997cb080 msgr2=0x561b997cd510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561b997cb080 0x561b997cd510 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd7500342b0 msgr2=0x7fd750036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd7500342b0 0x7fd750036770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0cefd0 tx=0x7fd87c0ed000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 msgr2=0x561b997b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd885294640 1 -- 172.21.15.138:0/3863075888 reap_dead start 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd88002b8d0 tx=0x7fd8800494e0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 shutdown_connections 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/3863075888 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b996984d0 0x561b997b9ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 >> 172.21.15.138:0/3863075888 conn(0x561b997ab710 msgr2=0x561b997ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 shutdown_connections 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/3863075888 wait complete. 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 msgr2=0x7fd7600367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 0x7fd7600367c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561b99790f90 tx=0x7fd87c0e2f90 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 msgr2=0x561b997a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x561b9978a560 tx=0x7fd8800188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 shutdown_connections 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd760034300 0x7fd7600367c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/419081967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b997a3c30 0x561b997a4050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 >> 172.21.15.138:0/419081967 conn(0x561b99798a40 msgr2=0x561b99799550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 shutdown_connections 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/419081967 wait complete. 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 msgr2=0x561b99790170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 0x561b99790170 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 msgr2=0x561b997956d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 0x561b997956d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 msgr2=0x7fd76c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 0x7fd76c036770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd878000f70 tx=0x7fd878001380 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 msgr2=0x561b99789480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0aa5a0 tx=0x7fd87c0180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 shutdown_connections 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561b99791e70 0x561b997956d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561b9969b790 0x561b99790170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd76c0342b0 0x7fd76c036770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 --2- 172.21.15.138:0/2697499039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561b9960c750 0x561b99789480 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 >> 172.21.15.138:0/2697499039 conn(0x561b99692d70 msgr2=0x561b9977cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 shutdown_connections 2024-02-16T10:30:47.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.212+0000 7fd887f7a980 1 -- 172.21.15.138:0/2697499039 wait complete. 2024-02-16T10:30:47.229 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T10:30:47.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-02-16T10:30:47.230 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-02-16T10:30:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77bbd9a980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640678beed0 0x5640678c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77bbd9a980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564067804af0 con 0x5640678b8c30 2024-02-16T10:30:47.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77bbd9a980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5640677cbd30 con 0x5640678beed0 2024-02-16T10:30:47.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640678beed0 0x5640678c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640678beed0 0x5640678c12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36338/0 (socket says 172.21.15.138:36338) 2024-02-16T10:30:47.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 -- 172.21.15.138:0/854790217 learned_addr learned my addr 172.21.15.138:0/854790217 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 -- 172.21.15.138:0/854790217 >> v1:172.21.15.107:6789/0 conn(0x5640678b8c30 legacy=0x5640678b9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 -- 172.21.15.138:0/854790217 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640678b9720 con 0x5640678beed0 2024-02-16T10:30:47.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.296+0000 7f77b90b4640 1 --2- 172.21.15.138:0/854790217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678beed0 0x5640678c12c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a5c0 tx=0x7f77b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cbf4b7f932ae52 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77b88b3640 1 -- 172.21.15.138:0/854790217 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b00aa470 con 0x5640678beed0 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77b88b3640 1 -- 172.21.15.138:0/854790217 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b00aa5d0 con 0x5640678beed0 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77b88b3640 1 -- 172.21.15.138:0/854790217 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b00aa890 con 0x5640678beed0 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 -- 172.21.15.138:0/854790217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678beed0 msgr2=0x5640678c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/854790217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678beed0 0x5640678c12c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77b000a5c0 tx=0x7f77b001b340 comp rx=0 tx=0).stop 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 -- 172.21.15.138:0/854790217 shutdown_connections 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/854790217 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678beed0 0x5640678c12c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 -- 172.21.15.138:0/854790217 >> 172.21.15.138:0/854790217 conn(0x5640678b2490 msgr2=0x5640678b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 -- 172.21.15.138:0/854790217 shutdown_connections 2024-02-16T10:30:47.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.300+0000 7f77bbd9a980 1 -- 172.21.15.138:0/854790217 wait complete. 2024-02-16T10:30:47.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640677c8fc0 con 0x5640678b8c30 2024-02-16T10:30:47.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77b98b5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77b98b5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36350/0 (socket says 172.21.15.138:36350) 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77b98b5640 1 -- 172.21.15.138:0/3799745003 learned_addr learned my addr 172.21.15.138:0/3799745003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77b98b5640 1 -- 172.21.15.138:0/3799745003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0005df0 con 0x5640678b8c30 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77b98b5640 1 --2- 172.21.15.138:0/3799745003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77ac006f60 tx=0x7f77ac006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dc0b36ab5b2aa2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f76a7e07640 1 -- 172.21.15.138:0/3799745003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac00f640 con 0x5640678b8c30 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f76a7e07640 1 -- 172.21.15.138:0/3799745003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00f7a0 con 0x5640678b8c30 2024-02-16T10:30:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f76a7e07640 1 -- 172.21.15.138:0/3799745003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac00fac0 con 0x5640678b8c30 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- 172.21.15.138:0/3799745003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 msgr2=0x5640679a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/3799745003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77ac006f60 tx=0x7f77ac006f90 comp rx=0 tx=0).stop 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- 172.21.15.138:0/3799745003 shutdown_connections 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/3799745003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679a4900 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- 172.21.15.138:0/3799745003 >> 172.21.15.138:0/3799745003 conn(0x5640678b2490 msgr2=0x5640679a0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- 172.21.15.138:0/3799745003 shutdown_connections 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.312+0000 7f77bbd9a980 1 -- 172.21.15.138:0/3799745003 wait complete. 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640677c47a0 con 0x5640678b8c30 2024-02-16T10:30:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b98b5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b98b5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36360/0 (socket says 172.21.15.138:36360) 2024-02-16T10:30:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b98b5640 1 -- 172.21.15.138:0/2589736258 learned_addr learned my addr 172.21.15.138:0/2589736258 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b98b5640 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564067804af0 con 0x5640678b8c30 2024-02-16T10:30:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b98b5640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77ac001e70 tx=0x7f77ac001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 -- 172.21.15.138:0/2589736258 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac006160 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640679abe10 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 -- 172.21.15.138:0/2589736258 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0062c0 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640679ac320 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 -- 172.21.15.138:0/2589736258 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77ac01e7c0 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 -- 172.21.15.138:0/2589736258 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77ac01e920 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 0x7f76a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f76a6604640 1 -- 172.21.15.138:0/2589736258 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f77ac049ad0 con 0x5640678b8c30 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b90b4640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 0x7f76a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 0x5640679b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679b2b00 con 0x5640678beed0 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 0x5640679b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77b90b4640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 0x7f76a0036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ae000 tx=0x7f77b00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.316+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 0x5640679b25c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2589736258 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77b40083f0 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679b2ec0 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2589736258 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f77b40083f0 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679b4770 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2589736258 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f77b40083f0 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679b3970 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2589736258 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f77b40083f0 con 0x5640678beed0 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 0x5640679b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679b8140 con 0x5640679b4290 2024-02-16T10:30:47.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77b98b5640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 0x5640679b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77b98b5640 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 0x5640679b7af0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77b98b5640 1 -- 172.21.15.138:0/2589736258 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f77ac018070 con 0x5640679b4290 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56406775cf20 con 0x5640679c60e0 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36374/0 (socket says 172.21.15.138:36374) 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2919361715 learned_addr learned my addr 172.21.15.138:0/2919361715 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 -- 172.21.15.138:0/2919361715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640679c6a40 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5640679acd00 tx=0x7f77b400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f769f7fe640 1 -- 172.21.15.138:0/2919361715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b400f040 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f769f7fe640 1 -- 172.21.15.138:0/2919361715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4019550 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640679c6c90 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f769f7fe640 1 -- 172.21.15.138:0/2919361715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b40197f0 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.320+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640679c77e0 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769f7fe640 1 -- 172.21.15.138:0/2919361715 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77b40199a0 con 0x5640679c60e0 2024-02-16T10:30:47.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769f7fe640 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 0x7f76940367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769f7fe640 1 -- 172.21.15.138:0/2919361715 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f77b404b540 con 0x5640679c60e0 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77b98b5640 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 0x7f76940367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77b98b5640 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 0x7f76940367c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5640679b33b0 tx=0x7f77ac049040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564067750790 con 0x5640679d3090 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36390/0 (socket says 172.21.15.138:36390) 2024-02-16T10:30:47.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77ba0b6640 1 -- 172.21.15.138:0/427684045 learned_addr learned my addr 172.21.15.138:0/427684045 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77ba0b6640 1 -- 172.21.15.138:0/427684045 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640679d3a80 con 0x5640679d3090 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/427684045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77b40498a0 tx=0x7f77b404b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a915c30083165a46 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769d7fa640 1 -- 172.21.15.138:0/427684045 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b4048070 con 0x5640679d3090 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769d7fa640 1 -- 172.21.15.138:0/427684045 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b403a200 con 0x5640679d3090 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f769d7fa640 1 -- 172.21.15.138:0/427684045 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b40154d0 con 0x5640679d3090 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- 172.21.15.138:0/427684045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 msgr2=0x5640679d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/427684045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77b40498a0 tx=0x7f77b404b420 comp rx=0 tx=0).stop 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- 172.21.15.138:0/427684045 shutdown_connections 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/427684045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d34b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- 172.21.15.138:0/427684045 >> 172.21.15.138:0/427684045 conn(0x5640679cdc60 msgr2=0x5640679ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- 172.21.15.138:0/427684045 shutdown_connections 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- 172.21.15.138:0/427684045 wait complete. 2024-02-16T10:30:47.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 Processor -- start 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.324+0000 7f77bbd9a980 1 -- start start 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640679da2f0 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77ba0b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36396/0 (socket says 172.21.15.138:36396) 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 learned_addr learned my addr 172.21.15.138:0/185259465 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640679c77e0 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77b400efb0 tx=0x7f77b4049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 -- 172.21.15.138:0/185259465 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b4015ae0 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640679da4f0 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 -- 172.21.15.138:0/185259465 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4017e90 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 -- 172.21.15.138:0/185259465 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77b40481a0 con 0x5640679d3090 2024-02-16T10:30:47.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640679da980 con 0x5640679d3090 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 -- 172.21.15.138:0/185259465 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f77b4032020 con 0x5640679d3090 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76840342b0 0x7f7684036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f768b7fe640 1 -- 172.21.15.138:0/185259465 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f77b404c070 con 0x5640679d3090 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b98b5640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76840342b0 0x7f7684036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640679e5590 0x5640679e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679e8180 con 0x5640679e5590 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b90b4640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640679e5590 0x5640679e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b98b5640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76840342b0 0x7f7684036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77ac049010 tx=0x7f77ac039000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b90b4640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640679e5590 0x5640679e7a30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 realm 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679e8570 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.328+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679e8dc0 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679e9120 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679e9920 con 0x5640679e5590 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 20 searching for the correct realm 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5640679eb7d0 0x5640679edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5640679eb7d0 0x5640679edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5640679eb7d0 0x5640679edc90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77ba0b6640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f77b4022070 0x7f77b40078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b98b5640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f77b4022070 0x7f77b40078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b98b5640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f77b4022070 0x7f77b40078e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b98b5640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f77ac057040 0x7f77ac0105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f77ac057040 0x7f77ac0105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f77ac057040 0x7f77ac0105d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.332+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.336+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.340+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679eb7d0 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x5640679e5590 2024-02-16T10:30:47.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee310 con 0x7f77b4022070 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ea220 con 0x5640679e5590 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679eaa70 con 0x5640679e5590 2024-02-16T10:30:47.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679eaa70 con 0x7f77b4022070 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 zone default found 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 4 Realm: () 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 zonegroup default 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.344+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ee750 con 0x7f77ac057040 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f0510 con 0x5640679eb7d0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f08c0 con 0x5640679eb7d0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 started sync module instance, tier type = 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679ef9a0 con 0x7f77b4022070 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94834616366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f01a0 con 0x7f77b4022070 2024-02-16T10:30:47.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f1330 con 0x5640679e5590 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.348+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94834616366336] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94834616368384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f16e0 con 0x5640679e5590 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f2050 con 0x5640679eb7d0 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94834616368384] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94834616376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f2010 con 0x5640679eb7d0 2024-02-16T10:30:47.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f0e90 con 0x7f77b4022070 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94834616380048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f3350 con 0x7f77b4022070 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.352+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f3d00 con 0x5640679e5590 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94834616376240] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94834616380048] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94834616381104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f3820 con 0x5640679e5590 2024-02-16T10:30:47.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f4550 con 0x7f77ac057040 2024-02-16T10:30:47.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94834616381104] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94834616378368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f4500 con 0x7f77ac057040 2024-02-16T10:30:47.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.356+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f4e70 con 0x7f77ac057040 2024-02-16T10:30:47.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94834616378368] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94834616388048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f5290 con 0x7f77ac057040 2024-02-16T10:30:47.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f4060 con 0x7f77ac057040 2024-02-16T10:30:47.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94834616385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f5c00 con 0x7f77ac057040 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=0 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=1 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=2 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=3 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=4 2024-02-16T10:30:47.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=5 2024-02-16T10:30:47.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94834616388048] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.360+0000 7f77bbd9a980 20 add_watcher() i=6 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94834616385632] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 add_watcher() i=7 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f5c00 con 0x5640679e5590 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94834616391520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f5b80 con 0x5640679e5590 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94834616391520] v31'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f766b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 5 note: GC not initialized 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f766a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 Filter name: none 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f75dbfff640 20 reqs_thread_entry: start 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.364+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1aa50 con 0x5640679e5590 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1adf0 con 0x7f77ac057040 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:30:47.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~461 in=461b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a205d0 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~461] v31'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94834616566000 in=649b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1d2b0 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94834616381104 notify 133143986179 ret 0) v3 ==== 679+0+0 (crc 0 0 0) 0x7f77b00e1040 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f769d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94834616381104 notifier 4339 bl.length()=637 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f769d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f769d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f769d7fa640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f767c003ea0 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 notify.4 [notify cookie 94834616566000 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94834616566000 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f77b00b9070 con 0x5640679e5590 2024-02-16T10:30:47.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.368+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a200f0 con 0x7f77ac057040 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94834616566000 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1adf0 con 0x5640679eb7d0 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== watch-notify(notify (1) cookie 94834616376240 notify 133143986176 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f77b4060040 con 0x5640679eb7d0 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f769cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94834616376240 notifier 4339 bl.length()=177 2024-02-16T10:30:47.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f769cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f769cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [notify cookie 94834616566000 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f769cff9640 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f75e4003430 con 0x5640679eb7d0 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== watch-notify(notify_complete (2) cookie 94834616566000 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5640679da980 con 0x5640679eb7d0 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.381 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f766b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94834616391520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1adf0 con 0x5640679e5590 2024-02-16T10:30:47.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94834616391520] v31'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.372+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94834616366336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a0cb00 con 0x7f77b4022070 2024-02-16T10:30:47.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94834616366336] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77bbd9a980 20 remove_watcher() i=0 2024-02-16T10:30:47.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77bbd9a980 2 removed watcher, disabling cache 2024-02-16T10:30:47.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94834616368384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x5640679e5590 2024-02-16T10:30:47.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94834616368384] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77bbd9a980 20 remove_watcher() i=1 2024-02-16T10:30:47.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.376+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94834616376240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x5640679eb7d0 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77ba0b6640 1 -- 172.21.15.138:0/185259465 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94834616376240] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b4012070 con 0x5640679eb7d0 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 20 remove_watcher() i=2 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94834616380048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x7f77b4022070 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77b98b5640 1 -- 172.21.15.138:0/185259465 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94834616380048] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77ac018070 con 0x7f77b4022070 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 20 remove_watcher() i=3 2024-02-16T10:30:47.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94834616381104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x5640679e5590 2024-02-16T10:30:47.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94834616381104] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x5640679e5590 2024-02-16T10:30:47.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 20 remove_watcher() i=4 2024-02-16T10:30:47.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.380+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94834616378368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5640679f2f30 con 0x7f77ac057040 2024-02-16T10:30:47.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94834616378368] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77bbd9a980 20 remove_watcher() i=5 2024-02-16T10:30:47.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94834616388048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x7f77ac057040 2024-02-16T10:30:47.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94834616388048] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77bbd9a980 20 remove_watcher() i=6 2024-02-16T10:30:47.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.384+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94834616385632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564067a1add0 con 0x7f77ac057040 2024-02-16T10:30:47.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94834616385632] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77b00b0020 con 0x7f77ac057040 2024-02-16T10:30:47.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 20 remove_watcher() i=7 2024-02-16T10:30:47.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f77ac057040 msgr2=0x7f77ac0105d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f77ac057040 0x7f77ac0105d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640679e5590 msgr2=0x5640679e7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640679e5590 0x5640679e7a30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f77b4022070 msgr2=0x7f77b40078e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f77b4022070 0x7f77b40078e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5640679eb7d0 msgr2=0x5640679edc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5640679eb7d0 0x5640679edc90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76840342b0 msgr2=0x7f7684036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76840342b0 0x7f7684036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77ac049010 tx=0x7f77ac039000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 msgr2=0x5640679d9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77b90b4640 1 -- 172.21.15.138:0/185259465 reap_dead start 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77b400efb0 tx=0x7f77b4049800 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 shutdown_connections 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/185259465 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679d3090 0x5640679d9db0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 >> 172.21.15.138:0/185259465 conn(0x5640679cdc60 msgr2=0x5640679ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 shutdown_connections 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/185259465 wait complete. 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 msgr2=0x7f76940367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 0x7f76940367c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x5640679b33b0 tx=0x7f77ac049040 comp rx=0 tx=0).stop 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 msgr2=0x5640679c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5640679acd00 tx=0x7f77b400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 shutdown_connections 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7694034300 0x7f76940367c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2919361715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640679c60e0 0x5640679c6500 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 >> 172.21.15.138:0/2919361715 conn(0x5640679baef0 msgr2=0x5640679bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 shutdown_connections 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2919361715 wait complete. 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 msgr2=0x5640679b25c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 0x5640679b25c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 msgr2=0x5640679b7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 0x5640679b7af0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 msgr2=0x7f76a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 0x7f76a0036770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ae000 tx=0x7f77b00a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 msgr2=0x5640679ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77ac001e70 tx=0x7f77ac001260 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 shutdown_connections 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640679b4290 0x5640679b7af0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640678beed0 0x5640679b25c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f76a00342b0 0x7f76a0036770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 --2- 172.21.15.138:0/2589736258 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640678b8c30 0x5640679ab8d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 >> 172.21.15.138:0/2589736258 conn(0x5640678b2490 msgr2=0x56406799efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 shutdown_connections 2024-02-16T10:30:47.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.388+0000 7f77bbd9a980 1 -- 172.21.15.138:0/2589736258 wait complete. 2024-02-16T10:30:47.406 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.406 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:47.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:47.406 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:47.479 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:47.479 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:47.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a2c2f980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558cab05e710 0x558cab0ed290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a2c2f980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558cab036b50 con 0x558cab0ed7d0 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a2c2f980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x558caaffdd30 con 0x558cab05e710 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a074a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558cab05e710 0x558cab0ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb49ff49640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x558cab0ed7d0 0x558cab0efbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53316/0 (socket says 172.21.15.138:53316) 2024-02-16T10:30:47.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb49ff49640 1 -- 172.21.15.138:0/972159471 learned_addr learned my addr 172.21.15.138:0/972159471 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:47.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a074a640 1 -- 172.21.15.138:0/972159471 >> v1:172.21.15.107:6789/0 conn(0x558cab0ed7d0 legacy=0x558cab0efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb4a074a640 1 -- 172.21.15.138:0/972159471 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cab0f2380 con 0x558cab05e710 2024-02-16T10:30:47.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.472+0000 7fb49f748640 1 -- 172.21.15.138:0/972159471 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783330693 0 0) 0x558cab036b50 con 0x558cab0ed7d0 2024-02-16T10:30:47.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a074a640 1 --2- 172.21.15.138:0/972159471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab0ed290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb49800a420 tx=0x7fb49801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364308ef7cf3deb0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb49f748640 1 -- 172.21.15.138:0/972159471 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980aa530 con 0x558cab05e710 2024-02-16T10:30:47.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb49f748640 1 -- 172.21.15.138:0/972159471 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4980a6050 con 0x558cab05e710 2024-02-16T10:30:47.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb49f748640 1 -- 172.21.15.138:0/972159471 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980aa7c0 con 0x558cab05e710 2024-02-16T10:30:47.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/972159471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 msgr2=0x558cab0ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/972159471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab0ed290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb49800a420 tx=0x7fb49801afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/972159471 shutdown_connections 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/972159471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab0ed290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/972159471 >> 172.21.15.138:0/972159471 conn(0x558cab0e4d70 msgr2=0x558cab0e7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/972159471 shutdown_connections 2024-02-16T10:30:47.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.476+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/972159471 wait complete. 2024-02-16T10:30:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a2c2f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a2c2f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558caaffafc0 con 0x558cab05e710 2024-02-16T10:30:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a074a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a074a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36412/0 (socket says 172.21.15.138:36412) 2024-02-16T10:30:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a074a640 1 -- 172.21.15.138:0/1570741594 learned_addr learned my addr 172.21.15.138:0/1570741594 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.488+0000 7fb4a074a640 1 -- 172.21.15.138:0/1570741594 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49800a100 con 0x558cab05e710 2024-02-16T10:30:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 --2- 172.21.15.138:0/1570741594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb4980ad040 tx=0x7fb4980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9805ab56d887825 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38e60c640 1 -- 172.21.15.138:0/1570741594 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980aa630 con 0x558cab05e710 2024-02-16T10:30:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38e60c640 1 -- 172.21.15.138:0/1570741594 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4980aa790 con 0x558cab05e710 2024-02-16T10:30:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38e60c640 1 -- 172.21.15.138:0/1570741594 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980aaa30 con 0x558cab05e710 2024-02-16T10:30:47.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1570741594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 msgr2=0x558cab1d4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1570741594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb4980ad040 tx=0x7fb4980033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1570741594 shutdown_connections 2024-02-16T10:30:47.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1570741594 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1d4490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1570741594 >> 172.21.15.138:0/1570741594 conn(0x558cab0e4d70 msgr2=0x558cab1d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1570741594 shutdown_connections 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1570741594 wait complete. 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558caaff67a0 con 0x558cab05e710 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36416/0 (socket says 172.21.15.138:36416) 2024-02-16T10:30:47.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 -- 172.21.15.138:0/1132075423 learned_addr learned my addr 172.21.15.138:0/1132075423 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cab0f2380 con 0x558cab05e710 2024-02-16T10:30:47.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a074a640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb49801b010 tx=0x7fb498019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38ce09640 1 -- 172.21.15.138:0/1132075423 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980b6a30 con 0x558cab05e710 2024-02-16T10:30:47.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cab1db820 con 0x558cab05e710 2024-02-16T10:30:47.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38ce09640 1 -- 172.21.15.138:0/1132075423 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4980b6b90 con 0x558cab05e710 2024-02-16T10:30:47.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb38ce09640 1 -- 172.21.15.138:0/1132075423 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4980b6e30 con 0x558cab05e710 2024-02-16T10:30:47.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.492+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cab1dbd30 con 0x558cab05e710 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb38ce09640 1 -- 172.21.15.138:0/1132075423 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb4980c0450 con 0x558cab05e710 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb38ce09640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 0x7fb388036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb38ce09640 1 -- 172.21.15.138:0/1132075423 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb4980e4370 con 0x558cab05e710 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb49ff49640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 0x7fb388036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 0x558cab1e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab1e24c0 con 0x558cab0ed7d0 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 0x558cab1e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb49ff49640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 0x7fb388036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c10 tx=0x7fb4880013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 0x558cab1e1f80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/1132075423 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4900083f0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab1df690 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/1132075423 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb4900083f0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab1e41c0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/1132075423 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb4900083f0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab1e32d0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/1132075423 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb4900083f0 con 0x558cab0ed7d0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 0x558cab1e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab1e7ac0 con 0x558cab1e3bc0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a074a640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 0x558cab1e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a074a640 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 0x558cab1e7540 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a074a640 1 -- 172.21.15.138:0/1132075423 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb4980b1040 con 0x558cab1e3bc0 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.496+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558caaf8ef20 con 0x558cab1f59f0 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36418/0 (socket says 172.21.15.138:36418) 2024-02-16T10:30:47.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/882430450 learned_addr learned my addr 172.21.15.138:0/882430450 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/882430450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cab1f6350 con 0x558cab1f59f0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558cab1dc190 tx=0x7fb49000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 -- 172.21.15.138:0/882430450 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49000f040 con 0x558cab1f59f0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cab1f65a0 con 0x558cab1f59f0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 -- 172.21.15.138:0/882430450 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49001a560 con 0x558cab1f59f0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 -- 172.21.15.138:0/882430450 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49001a820 con 0x558cab1f59f0 2024-02-16T10:30:47.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cab1f70f0 con 0x558cab1f59f0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 -- 172.21.15.138:0/882430450 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb49001aa10 con 0x558cab1f59f0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 0x7fb378036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb385ffb640 1 -- 172.21.15.138:0/882430450 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb49004bcf0 con 0x558cab1f59f0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a074a640 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 0x7fb378036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a074a640 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 0x7fb378036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558cab1e3630 tx=0x7fb4980e4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a2c2f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558caaf82790 con 0x558cab202930 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36434/0 (socket says 172.21.15.138:36434) 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.500+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/2846503881 learned_addr learned my addr 172.21.15.138:0/2846503881 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/2846503881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cab203320 con 0x558cab202930 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/2846503881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb490024fd0 tx=0x7fb49004a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f400eff3036036 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37f7fe640 1 -- 172.21.15.138:0/2846503881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49001add0 con 0x558cab202930 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37f7fe640 1 -- 172.21.15.138:0/2846503881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490024410 con 0x558cab202930 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37f7fe640 1 -- 172.21.15.138:0/2846503881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4900183c0 con 0x558cab202930 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/2846503881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 msgr2=0x558cab202d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/2846503881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb490024fd0 tx=0x7fb49004a2d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/2846503881 shutdown_connections 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/2846503881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab202d50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/2846503881 >> 172.21.15.138:0/2846503881 conn(0x558cab1fd4b0 msgr2=0x558cab1fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/2846503881 shutdown_connections 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/2846503881 wait complete. 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 Processor -- start 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- start start 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cab208b30 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36440/0 (socket says 172.21.15.138:36440) 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 learned_addr learned my addr 172.21.15.138:0/3958199489 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cab1f70f0 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb490024fd0 tx=0x7fb490049fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37dffb640 1 -- 172.21.15.138:0/3958199489 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb490035070 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cab207790 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37dffb640 1 -- 172.21.15.138:0/3958199489 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490024580 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb37dffb640 1 -- 172.21.15.138:0/3958199489 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb49001add0 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.504+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cab207bc0 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb37dffb640 1 -- 172.21.15.138:0/3958199489 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb4900233c0 con 0x558cab202930 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb37dffb640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3700342b0 0x7fb370036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb37dffb640 1 -- 172.21.15.138:0/3958199489 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb490056ca0 con 0x558cab202930 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a074a640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3700342b0 0x7fb370036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab21b3b0 0x558cab21d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21dfa0 con 0x558cab21b3b0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab21b3b0 0x558cab21d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a074a640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3700342b0 0x7fb370036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4980b6fb0 tx=0x7fb4980dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab21b3b0 0x558cab21d850 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 realm 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21a8d0 con 0x558cab21b3b0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21ea20 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21eee0 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21f780 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 20 searching for the correct realm 2024-02-16T10:30:47.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558cab2214a0 0x558cab223890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x558cab2214a0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558cab2214a0 0x558cab223890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558cab2214a0 0x558cab223890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a0f4b640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb4900545c0 0x7fb49003a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x7fb4900545c0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.508+0000 7fb4a074a640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb4900545c0 0x7fb49003a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb4900545c0 0x7fb49003a600 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb4980f2040 0x7fb4980bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x7fb4980f2040 2024-02-16T10:30:47.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb4980f2040 0x7fb4980bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb4980f2040 0x7fb4980bf810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x558cab21b3b0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x558cab21b3b0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x7fb4980f2040 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab223dd0 con 0x7fb4980f2040 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4900545c0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.512+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4900545c0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.516+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4900545c0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4900545c0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab2214a0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4980f2040 2024-02-16T10:30:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.520+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x558cab21b3b0 2024-02-16T10:30:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb48802d040 con 0x7fb4900545c0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2200e0 con 0x558cab21b3b0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab21fd60 con 0x558cab21b3b0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2209b0 con 0x7fb4900545c0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 zone default found 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 4 Realm: () 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 zonegroup default 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2241c0 con 0x7fb4980f2040 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab226040 con 0x558cab2214a0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2263a0 con 0x558cab2214a0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 started sync module instance, tier type = 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225610 con 0x7fb4900545c0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94062654935408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab226700 con 0x7fb4900545c0 2024-02-16T10:30:47.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.524+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab227070 con 0x558cab21b3b0 2024-02-16T10:30:47.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94062654935408] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94062654942160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab226ff0 con 0x558cab21b3b0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab227da0 con 0x558cab2214a0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94062654945472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2285f0 con 0x558cab2214a0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.528+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab228fe0 con 0x7fb4900545c0 2024-02-16T10:30:47.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94062654942160] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94062654950080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab229390 con 0x7fb4900545c0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab229d00 con 0x558cab21b3b0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94062654945472] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94062654950080] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94062654947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab227530 con 0x558cab21b3b0 2024-02-16T10:30:47.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.532+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22a550 con 0x7fb4980f2040 2024-02-16T10:30:47.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94062654947664] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94062654953568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22a4b0 con 0x7fb4980f2040 2024-02-16T10:30:47.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22ae20 con 0x7fb4980f2040 2024-02-16T10:30:47.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94062654953568] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94062654955968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22ae20 con 0x7fb4980f2040 2024-02-16T10:30:47.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.536+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22b790 con 0x7fb4980f2040 2024-02-16T10:30:47.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94062654955968] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94062654960368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22b710 con 0x7fb4980f2040 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=0 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=1 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=2 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=3 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=4 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=5 2024-02-16T10:30:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=6 2024-02-16T10:30:47.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94062654960368] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 20 add_watcher() i=7 2024-02-16T10:30:47.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22eb90 con 0x558cab21b3b0 2024-02-16T10:30:47.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.540+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94062654957952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22c0a0 con 0x558cab21b3b0 2024-02-16T10:30:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94062654957952] v31'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb3567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 5 note: GC not initialized 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb3557e2640 20 reqs_thread_entry: start 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 Filter name: none 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb2c6ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2505d0 con 0x558cab21b3b0 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T10:30:47.553 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb3567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94062654957952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab2154e0 con 0x558cab21b3b0 2024-02-16T10:30:47.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94062654957952] v31'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.544+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94062654935408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab22a980 con 0x7fb4900545c0 2024-02-16T10:30:47.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94062654935408] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a2c2f980 20 remove_watcher() i=0 2024-02-16T10:30:47.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a2c2f980 2 removed watcher, disabling cache 2024-02-16T10:30:47.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94062654942160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225170 con 0x558cab21b3b0 2024-02-16T10:30:47.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94062654942160] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a2c2f980 20 remove_watcher() i=1 2024-02-16T10:30:47.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.548+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94062654945472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225170 con 0x558cab2214a0 2024-02-16T10:30:47.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a0f4b640 1 -- 172.21.15.138:0/3958199489 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94062654945472] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb490012070 con 0x558cab2214a0 2024-02-16T10:30:47.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 20 remove_watcher() i=2 2024-02-16T10:30:47.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94062654950080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225170 con 0x7fb4900545c0 2024-02-16T10:30:47.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a074a640 1 -- 172.21.15.138:0/3958199489 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94062654950080] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4980b1040 con 0x7fb4900545c0 2024-02-16T10:30:47.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 20 remove_watcher() i=3 2024-02-16T10:30:47.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94062654947664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225170 con 0x558cab21b3b0 2024-02-16T10:30:47.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94062654947664] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x558cab21b3b0 2024-02-16T10:30:47.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 20 remove_watcher() i=4 2024-02-16T10:30:47.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.552+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94062654953568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab228150 con 0x7fb4980f2040 2024-02-16T10:30:47.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94062654953568] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb4a2c2f980 20 remove_watcher() i=5 2024-02-16T10:30:47.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94062654955968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab225170 con 0x7fb4980f2040 2024-02-16T10:30:47.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94062654955968] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb4a2c2f980 20 remove_watcher() i=6 2024-02-16T10:30:47.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.556+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94062654960368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cab229860 con 0x7fb4980f2040 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94062654960368] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb48800c040 con 0x7fb4980f2040 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 20 remove_watcher() i=7 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb4980f2040 msgr2=0x7fb4980bf810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb4980f2040 0x7fb4980bf810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab21b3b0 msgr2=0x558cab21d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab21b3b0 0x558cab21d850 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb4900545c0 msgr2=0x7fb49003a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb4900545c0 0x7fb49003a600 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558cab2214a0 msgr2=0x558cab223890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558cab2214a0 0x558cab223890 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3700342b0 msgr2=0x7fb370036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3700342b0 0x7fb370036770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4980b6fb0 tx=0x7fb4980dc000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 msgr2=0x558cab207250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb49ff49640 1 -- 172.21.15.138:0/3958199489 reap_dead start 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb490024fd0 tx=0x7fb490049fb0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 shutdown_connections 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/3958199489 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab202930 0x558cab207250 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 >> 172.21.15.138:0/3958199489 conn(0x558cab1fd4b0 msgr2=0x558cab1fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 shutdown_connections 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/3958199489 wait complete. 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 msgr2=0x7fb378036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 0x7fb378036770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558cab1e3630 tx=0x7fb4980e4040 comp rx=0 tx=0).stop 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 msgr2=0x558cab1f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558cab1dc190 tx=0x7fb49000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 shutdown_connections 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3780342b0 0x7fb378036770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/882430450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab1f59f0 0x558cab1f5e10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 >> 172.21.15.138:0/882430450 conn(0x558cab1ea800 msgr2=0x558cab1eb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 shutdown_connections 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/882430450 wait complete. 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 msgr2=0x558cab1e1f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 0x558cab1e1f80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 msgr2=0x558cab1e7540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 0x558cab1e7540 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 msgr2=0x7fb388036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 0x7fb388036770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c10 tx=0x7fb4880013c0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 msgr2=0x558cab1db2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb49801b010 tx=0x7fb498019810 comp rx=0 tx=0).stop 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 shutdown_connections 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558cab1e3bc0 0x558cab1e7540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558cab0ed7d0 0x558cab1e1f80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb3880342b0 0x7fb388036770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 --2- 172.21.15.138:0/1132075423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558cab05e710 0x558cab1db2e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 >> 172.21.15.138:0/1132075423 conn(0x558cab0e4d70 msgr2=0x558cab1ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 shutdown_connections 2024-02-16T10:30:47.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.560+0000 7fb4a2c2f980 1 -- 172.21.15.138:0/1132075423 wait complete. 2024-02-16T10:30:47.577 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T10:30:47.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-02-16T10:30:47.577 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-02-16T10:30:47.650 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:47.650 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:47.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6d84a980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d90c7024b0 0x55d90c7901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6d84a980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d90c6d9b60 con 0x55d90c7037f0 2024-02-16T10:30:47.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6d84a980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d90c6a0d30 con 0x55d90c7024b0 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6ab64640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d90c7024b0 0x55d90c7901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6ab64640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d90c7024b0 0x55d90c7901e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36444/0 (socket says 172.21.15.138:36444) 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6ab64640 1 -- 172.21.15.138:0/1968412359 learned_addr learned my addr 172.21.15.138:0/1968412359 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6b365640 1 --1- 172.21.15.138:0/1968412359 >> v1:172.21.15.107:6789/0 conn(0x55d90c7037f0 0x55d90c701da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53332/0 (socket says 172.21.15.138:53332) 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6ab64640 1 -- 172.21.15.138:0/1968412359 >> v1:172.21.15.107:6789/0 conn(0x55d90c7037f0 legacy=0x55d90c701da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.644+0000 7feb6ab64640 1 -- 172.21.15.138:0/1968412359 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d90c7028c0 con 0x55d90c7024b0 2024-02-16T10:30:47.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6ab64640 1 --2- 172.21.15.138:0/1968412359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c7901e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb5400a5c0 tx=0x7feb5401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68aab2319c126f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6a363640 1 -- 172.21.15.138:0/1968412359 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb540ac460 con 0x55d90c7024b0 2024-02-16T10:30:47.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6a363640 1 -- 172.21.15.138:0/1968412359 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb540ac5c0 con 0x55d90c7024b0 2024-02-16T10:30:47.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6a363640 1 -- 172.21.15.138:0/1968412359 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb540ac880 con 0x55d90c7024b0 2024-02-16T10:30:47.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 -- 172.21.15.138:0/1968412359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 msgr2=0x55d90c7901e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 --2- 172.21.15.138:0/1968412359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c7901e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb5400a5c0 tx=0x7feb5401b340 comp rx=0 tx=0).stop 2024-02-16T10:30:47.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 -- 172.21.15.138:0/1968412359 shutdown_connections 2024-02-16T10:30:47.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 --2- 172.21.15.138:0/1968412359 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c7901e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 -- 172.21.15.138:0/1968412359 >> 172.21.15.138:0/1968412359 conn(0x55d90c788ec0 msgr2=0x55d90c78b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 -- 172.21.15.138:0/1968412359 shutdown_connections 2024-02-16T10:30:47.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.648+0000 7feb6d84a980 1 -- 172.21.15.138:0/1968412359 wait complete. 2024-02-16T10:30:47.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6d84a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6d84a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d90c69dfc0 con 0x55d90c7024b0 2024-02-16T10:30:47.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6b365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6b365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36454/0 (socket says 172.21.15.138:36454) 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6b365640 1 -- 172.21.15.138:0/3008196350 learned_addr learned my addr 172.21.15.138:0/3008196350 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6b365640 1 -- 172.21.15.138:0/3008196350 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54005df0 con 0x55d90c7024b0 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7feb6b365640 1 --2- 172.21.15.138:0/3008196350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb64006fb0 tx=0x7feb64001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92b7e0f8817ce3b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7fea5960a640 1 -- 172.21.15.138:0/3008196350 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb64013420 con 0x55d90c7024b0 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7fea5960a640 1 -- 172.21.15.138:0/3008196350 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64013580 con 0x55d90c7024b0 2024-02-16T10:30:47.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.660+0000 7fea5960a640 1 -- 172.21.15.138:0/3008196350 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb64013860 con 0x55d90c7024b0 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3008196350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 msgr2=0x55d90c87e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3008196350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feb64006fb0 tx=0x7feb64001940 comp rx=0 tx=0).stop 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3008196350 shutdown_connections 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3008196350 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c87e060 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3008196350 >> 172.21.15.138:0/3008196350 conn(0x55d90c788ec0 msgr2=0x55d90c879bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3008196350 shutdown_connections 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3008196350 wait complete. 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d90c6997a0 con 0x55d90c7024b0 2024-02-16T10:30:47.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6b365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6b365640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36456/0 (socket says 172.21.15.138:36456) 2024-02-16T10:30:47.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6b365640 1 -- 172.21.15.138:0/3413777546 learned_addr learned my addr 172.21.15.138:0/3413777546 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6b365640 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d90c6d9b60 con 0x55d90c7024b0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6b365640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d90c87eef0 tx=0x7feb64000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 -- 172.21.15.138:0/3413777546 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb640037a0 con 0x55d90c7024b0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d90c8854f0 con 0x55d90c7024b0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 -- 172.21.15.138:0/3413777546 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64003900 con 0x55d90c7024b0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 -- 172.21.15.138:0/3413777546 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb64003ba0 con 0x55d90c7024b0 2024-02-16T10:30:47.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d90c8859a0 con 0x55d90c7024b0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 -- 172.21.15.138:0/3413777546 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feb64028460 con 0x55d90c7024b0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 0x7fea50036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7fea57e07640 1 -- 172.21.15.138:0/3413777546 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7feb640494e0 con 0x55d90c7024b0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 0x7fea50036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 0x55d90c88bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.664+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c88c1e0 con 0x55d90c7037f0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 0x55d90c88bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 0x7fea50036770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb540ae000 tx=0x7feb540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 0x55d90c88bca0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3413777546 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb5c0083f0 con 0x55d90c7037f0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8893a0 con 0x55d90c7037f0 2024-02-16T10:30:47.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3413777546 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb5c0083f0 con 0x55d90c7037f0 2024-02-16T10:30:47.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c88dee0 con 0x55d90c7037f0 2024-02-16T10:30:47.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3413777546 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7feb5c0083f0 con 0x55d90c7037f0 2024-02-16T10:30:47.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c88d0e0 con 0x55d90c7037f0 2024-02-16T10:30:47.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3413777546 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb5c0083f0 con 0x55d90c7037f0 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 0x55d90c891260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c891870 con 0x55d90c88da00 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6b365640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 0x55d90c891260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6b365640 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 0x55d90c891260 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6b365640 1 -- 172.21.15.138:0/3413777546 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7feb64024020 con 0x55d90c88da00 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6d84a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d90c631f20 con 0x55d90c89f810 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36460/0 (socket says 172.21.15.138:36460) 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3701859638 learned_addr learned my addr 172.21.15.138:0/3701859638 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 -- 172.21.15.138:0/3701859638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d90c8a0170 con 0x55d90c89f810 2024-02-16T10:30:47.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.668+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55d90c885b50 tx=0x7feb5c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 -- 172.21.15.138:0/3701859638 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c00f040 con 0x55d90c89f810 2024-02-16T10:30:47.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 -- 172.21.15.138:0/3701859638 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c019550 con 0x55d90c89f810 2024-02-16T10:30:47.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 -- 172.21.15.138:0/3701859638 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c0197f0 con 0x55d90c89f810 2024-02-16T10:30:47.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d90c8a03c0 con 0x55d90c89f810 2024-02-16T10:30:47.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d90c8a0f10 con 0x55d90c89f810 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 -- 172.21.15.138:0/3701859638 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feb5c019950 con 0x55d90c89f810 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 0x7fea440367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7fea55602640 1 -- 172.21.15.138:0/3701859638 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7feb5c04b410 con 0x55d90c89f810 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6b365640 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 0x7fea440367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6b365640 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 0x7fea440367c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55d90c88cb20 tx=0x7feb64001e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6d84a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d90c625790 con 0x55d90c8ac750 2024-02-16T10:30:47.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36468/0 (socket says 172.21.15.138:36468) 2024-02-16T10:30:47.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.672+0000 7feb6bb66640 1 -- 172.21.15.138:0/386805881 learned_addr learned my addr 172.21.15.138:0/386805881 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 -- 172.21.15.138:0/386805881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d90c8ad0b0 con 0x55d90c8ac750 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 --2- 172.21.15.138:0/386805881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb5c049800 tx=0x7feb5c02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c10cb4794e1adca server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4effd640 1 -- 172.21.15.138:0/386805881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c03b540 con 0x55d90c8ac750 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4effd640 1 -- 172.21.15.138:0/386805881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c04b0d0 con 0x55d90c8ac750 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4effd640 1 -- 172.21.15.138:0/386805881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c0183b0 con 0x55d90c8ac750 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/386805881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 msgr2=0x55d90c8acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 --2- 172.21.15.138:0/386805881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb5c049800 tx=0x7feb5c02af40 comp rx=0 tx=0).stop 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/386805881 shutdown_connections 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 --2- 172.21.15.138:0/386805881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8acb70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/386805881 >> 172.21.15.138:0/386805881 conn(0x55d90c8a7370 msgr2=0x55d90c8a8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/386805881 shutdown_connections 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/386805881 wait complete. 2024-02-16T10:30:47.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 Processor -- start 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- start start 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d90c8b3ae0 con 0x55d90c8ac750 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36480/0 (socket says 172.21.15.138:36480) 2024-02-16T10:30:47.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 learned_addr learned my addr 172.21.15.138:0/3927163561 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d90c8a0f10 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb5c049800 tx=0x7feb5c049790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4d7fa640 1 -- 172.21.15.138:0/3927163561 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c04b240 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d90c8b3ce0 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d90c8b4110 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4d7fa640 1 -- 172.21.15.138:0/3927163561 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c015cc0 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.676+0000 7fea4d7fa640 1 -- 172.21.15.138:0/3927163561 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5c017a50 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7fea4d7fa640 1 -- 172.21.15.138:0/3927163561 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7feb5c017bb0 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7fea4d7fa640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea34034300 0x7fea340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7fea4d7fa640 1 -- 172.21.15.138:0/3927163561 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7feb5c01d070 con 0x55d90c8ac750 2024-02-16T10:30:47.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6b365640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea34034300 0x7fea340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c8bebd0 0x55d90c8c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c17e0 con 0x55d90c8bebd0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c8bebd0 0x55d90c8c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6b365640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea34034300 0x7fea340367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb6401dfd0 tx=0x7feb64034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c8bebd0 0x55d90c8c1090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 realm 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c1bd0 con 0x55d90c8bebd0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c2450 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c27b0 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c2fb0 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 20 searching for the correct realm 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d90c8c4e60 0x55d90c8c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d90c8c4e60 0x55d90c8c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d90c8c4e60 0x55d90c8c7320 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6bb66640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7feb5c022070 0x7feb5c04b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb5c022070 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6b365640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7feb5c022070 0x7feb5c04b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.680+0000 7feb6b365640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7feb5c022070 0x7feb5c04b6f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6b365640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7feb64056040 0x7feb640123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7feb64056040 0x7feb640123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7feb64056040 0x7feb640123c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb5c022070 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.684+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb5c022070 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.688+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb5c022070 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb5c022070 2024-02-16T10:30:47.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x7feb64056040 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.692+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c79f0 con 0x55d90c8bebd0 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7feb540dc080 con 0x7feb5c022070 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c38b0 con 0x55d90c8bebd0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c4100 con 0x55d90c8bebd0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c4100 con 0x7feb5c022070 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 zone default found 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 4 Realm: () 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 zonegroup default 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c7e30 con 0x7feb64056040 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c9cb0 con 0x55d90c8c4e60 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca010 con 0x55d90c8c4e60 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 started sync module instance, tier type = 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c9280 con 0x7feb5c022070 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94390706802144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca010 con 0x7feb5c022070 2024-02-16T10:30:47.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.696+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca980 con 0x55d90c8bebd0 2024-02-16T10:30:47.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.700+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94390706802144] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.700+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.700+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94390706808032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca900 con 0x55d90c8bebd0 2024-02-16T10:30:47.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.700+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cb6b0 con 0x55d90c8c4e60 2024-02-16T10:30:47.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.700+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94390706808032] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94390706810160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cb5f0 con 0x55d90c8c4e60 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cc070 con 0x7feb5c022070 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94390706813904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cc8c0 con 0x7feb5c022070 2024-02-16T10:30:47.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cd2b0 con 0x55d90c8bebd0 2024-02-16T10:30:47.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94390706813904] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94390706810160] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94390706811216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cc420 con 0x55d90c8bebd0 2024-02-16T10:30:47.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.704+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cdb00 con 0x7feb64056040 2024-02-16T10:30:47.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94390706820544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cde80 con 0x7feb64056040 2024-02-16T10:30:47.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ce8d0 con 0x7feb64056040 2024-02-16T10:30:47.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94390706811216] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94390706820544] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94390706824112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cd9e0 con 0x7feb64056040 2024-02-16T10:30:47.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.708+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cee80 con 0x7feb64056040 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94390706825696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cf2a0 con 0x7feb64056040 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=0 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=1 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=2 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=3 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=4 2024-02-16T10:30:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=5 2024-02-16T10:30:47.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94390706824112] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=6 2024-02-16T10:30:47.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94390706825696] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 add_watcher() i=7 2024-02-16T10:30:47.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8d22d0 con 0x55d90c8bebd0 2024-02-16T10:30:47.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94390706826752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cf6c0 con 0x55d90c8bebd0 2024-02-16T10:30:47.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94390706826752] v31'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7fea21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7feb6d84a980 5 note: GC not initialized 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.712+0000 7fea20fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 20 Filter name: none 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fe99a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8f3f10 con 0x55d90c8bebd0 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~461 out=461b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+584 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 20 rados_obj.operate() r=0 bl.length=461 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8f9a50 con 0x55d90c8bebd0 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94390707001072 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8f6770 con 0x55d90c8bebd0 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94390706811216 notify 133143986180 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55d90c7028c0 con 0x55d90c8bebd0 2024-02-16T10:30:47.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94390706811216 notifier 4353 bl.length()=534 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(64 notify.4 [notify cookie 94390707001072 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea30003ea0 con 0x55d90c8bebd0 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94390707001072 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7feb540d2af0 con 0x55d90c8bebd0 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94390707001072 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8f6770 con 0x55d90c8c4e60 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== watch-notify(notify (1) cookie 94390706810160 notify 133143986177 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55d90c8b4110 con 0x55d90c8c4e60 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94390706810160 notifier 4353 bl.length()=170 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7fea4effd640 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea30003ea0 con 0x55d90c8c4e60 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(66 notify.2 [notify cookie 94390707001072 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== watch-notify(notify_complete (2) cookie 94390707001072 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d90c8b3ce0 con 0x55d90c8c4e60 2024-02-16T10:30:47.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.716+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8f96f0 con 0x7feb64056040 2024-02-16T10:30:47.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.727 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7fea21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94390706826752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8d4800 con 0x55d90c8bebd0 2024-02-16T10:30:47.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94390706826752] v31'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94390706802144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8d4800 con 0x7feb5c022070 2024-02-16T10:30:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94390706802144] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6d84a980 20 remove_watcher() i=0 2024-02-16T10:30:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6d84a980 2 removed watcher, disabling cache 2024-02-16T10:30:47.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.720+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94390706808032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8c8de0 con 0x55d90c8bebd0 2024-02-16T10:30:47.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94390706808032] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6d84a980 20 remove_watcher() i=1 2024-02-16T10:30:47.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94390706810160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca4e0 con 0x55d90c8c4e60 2024-02-16T10:30:47.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6bb66640 1 -- 172.21.15.138:0/3927163561 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94390706810160] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb5c032020 con 0x55d90c8c4e60 2024-02-16T10:30:47.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6d84a980 20 remove_watcher() i=2 2024-02-16T10:30:47.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.724+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94390706813904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8ca4e0 con 0x7feb5c022070 2024-02-16T10:30:47.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6b365640 1 -- 172.21.15.138:0/3927163561 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94390706813904] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb64024020 con 0x7feb5c022070 2024-02-16T10:30:47.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6d84a980 20 remove_watcher() i=3 2024-02-16T10:30:47.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94390706811216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cbbd0 con 0x55d90c8bebd0 2024-02-16T10:30:47.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94390706811216] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x55d90c8bebd0 2024-02-16T10:30:47.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6d84a980 20 remove_watcher() i=4 2024-02-16T10:30:47.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.728+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94390706820544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cbbd0 con 0x7feb64056040 2024-02-16T10:30:47.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94390706820544] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6d84a980 20 remove_watcher() i=5 2024-02-16T10:30:47.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94390706824112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cbbd0 con 0x7feb64056040 2024-02-16T10:30:47.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94390706824112] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6d84a980 20 remove_watcher() i=6 2024-02-16T10:30:47.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.732+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94390706825696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d90c8cbbd0 con 0x7feb64056040 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94390706825696] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feb540b3040 con 0x7feb64056040 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 20 remove_watcher() i=7 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7feb64056040 msgr2=0x7feb640123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7feb64056040 0x7feb640123c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c8bebd0 msgr2=0x55d90c8c1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c8bebd0 0x55d90c8c1090 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7feb5c022070 msgr2=0x7feb5c04b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7feb5c022070 0x7feb5c04b6f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d90c8c4e60 msgr2=0x55d90c8c7320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d90c8c4e60 0x55d90c8c7320 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea34034300 msgr2=0x7fea340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea34034300 0x7fea340367c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb6401dfd0 tx=0x7feb64034000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 msgr2=0x55d90c8b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6ab64640 1 -- 172.21.15.138:0/3927163561 reap_dead start 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb5c049800 tx=0x7feb5c049790 comp rx=0 tx=0).stop 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 shutdown_connections 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3927163561 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c8ac750 0x55d90c8b35a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 >> 172.21.15.138:0/3927163561 conn(0x55d90c8a7370 msgr2=0x55d90c8a8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 shutdown_connections 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3927163561 wait complete. 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 msgr2=0x7fea440367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 0x7fea440367c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55d90c88cb20 tx=0x7feb64001e70 comp rx=0 tx=0).stop 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 msgr2=0x55d90c89fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55d90c885b50 tx=0x7feb5c00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 shutdown_connections 2024-02-16T10:30:47.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea44034300 0x7fea440367c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3701859638 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c89f810 0x55d90c89fc30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 >> 172.21.15.138:0/3701859638 conn(0x55d90c894620 msgr2=0x55d90c895130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 shutdown_connections 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3701859638 wait complete. 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 msgr2=0x55d90c88bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 0x55d90c88bca0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 msgr2=0x55d90c891260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 0x55d90c891260 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 msgr2=0x7fea50036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 0x7fea50036770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb540ae000 tx=0x7feb540a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 msgr2=0x55d90c884fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d90c87eef0 tx=0x7feb64000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 shutdown_connections 2024-02-16T10:30:47.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d90c88da00 0x55d90c891260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d90c7037f0 0x55d90c88bca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fea500342b0 0x7fea50036770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 --2- 172.21.15.138:0/3413777546 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d90c7024b0 0x55d90c884fb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 >> 172.21.15.138:0/3413777546 conn(0x55d90c788ec0 msgr2=0x55d90c878700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 shutdown_connections 2024-02-16T10:30:47.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.736+0000 7feb6d84a980 1 -- 172.21.15.138:0/3413777546 wait complete. 2024-02-16T10:30:47.753 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T10:30:47.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-02-16T10:30:47.754 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-02-16T10:30:47.822 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:47.822 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:47.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc0664fc980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559ea9569a10 0x559ea956be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc0664fc980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559ea94b2b60 con 0x559ea95654b0 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc0664fc980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x559ea9479d30 con 0x559ea9569a10 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc063816640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559ea9569a10 0x559ea956be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc064017640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x559ea95654b0 0x559ea9565890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53348/0 (socket says 172.21.15.138:53348) 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc063816640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559ea9569a10 0x559ea956be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36482/0 (socket says 172.21.15.138:36482) 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc064017640 1 -- 172.21.15.138:0/1359995511 learned_addr learned my addr 172.21.15.138:0/1359995511 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc063816640 1 -- 172.21.15.138:0/1359995511 >> v1:172.21.15.107:6789/0 conn(0x559ea95654b0 legacy=0x559ea9565890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.816+0000 7fc063816640 1 -- 172.21.15.138:0/1359995511 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea956d350 con 0x559ea9569a10 2024-02-16T10:30:47.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc063816640 1 --2- 172.21.15.138:0/1359995511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9569a10 0x559ea956be00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00a480 tx=0x7fc04c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d4b55a804b1632 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc063015640 1 -- 172.21.15.138:0/1359995511 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0ab540 con 0x559ea9569a10 2024-02-16T10:30:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc063015640 1 -- 172.21.15.138:0/1359995511 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c0ab6a0 con 0x559ea9569a10 2024-02-16T10:30:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc063015640 1 -- 172.21.15.138:0/1359995511 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0ab960 con 0x559ea9569a10 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 -- 172.21.15.138:0/1359995511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9569a10 msgr2=0x559ea956be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1359995511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9569a10 0x559ea956be00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00a480 tx=0x7fc04c01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 -- 172.21.15.138:0/1359995511 shutdown_connections 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1359995511 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9569a10 0x559ea956be00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 -- 172.21.15.138:0/1359995511 >> 172.21.15.138:0/1359995511 conn(0x559ea9560d80 msgr2=0x559ea95631a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 -- 172.21.15.138:0/1359995511 shutdown_connections 2024-02-16T10:30:47.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.820+0000 7fc0664fc980 1 -- 172.21.15.138:0/1359995511 wait complete. 2024-02-16T10:30:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc0664fc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc0664fc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea9476fc0 con 0x559ea95654b0 2024-02-16T10:30:47.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc064017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc064017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36486/0 (socket says 172.21.15.138:36486) 2024-02-16T10:30:47.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc064017640 1 -- 172.21.15.138:0/3162182475 learned_addr learned my addr 172.21.15.138:0/3162182475 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.832+0000 7fc064017640 1 -- 172.21.15.138:0/3162182475 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c005d30 con 0x559ea95654b0 2024-02-16T10:30:47.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 --2- 172.21.15.138:0/3162182475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006fb0 tx=0x7fc05c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9449966f8542ee61 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf5260c640 1 -- 172.21.15.138:0/3162182475 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05c004530 con 0x559ea95654b0 2024-02-16T10:30:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf5260c640 1 -- 172.21.15.138:0/3162182475 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c004690 con 0x559ea95654b0 2024-02-16T10:30:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf5260c640 1 -- 172.21.15.138:0/3162182475 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05c0049b0 con 0x559ea95654b0 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/3162182475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 msgr2=0x559ea964f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 --2- 172.21.15.138:0/3162182475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006fb0 tx=0x7fc05c001940 comp rx=0 tx=0).stop 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/3162182475 shutdown_connections 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 --2- 172.21.15.138:0/3162182475 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea964f5a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/3162182475 >> 172.21.15.138:0/3162182475 conn(0x559ea9560d80 msgr2=0x559ea964b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/3162182475 shutdown_connections 2024-02-16T10:30:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/3162182475 wait complete. 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea94727a0 con 0x559ea95654b0 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36498/0 (socket says 172.21.15.138:36498) 2024-02-16T10:30:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 -- 172.21.15.138:0/1133404873 learned_addr learned my addr 172.21.15.138:0/1133404873 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea94b2b60 con 0x559ea95654b0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc064017640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559ea9650430 tx=0x7fc05c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf50e09640 1 -- 172.21.15.138:0/1133404873 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05c013760 con 0x559ea95654b0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ea9657ba0 con 0x559ea95654b0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf50e09640 1 -- 172.21.15.138:0/1133404873 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0138c0 con 0x559ea95654b0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fbf50e09640 1 -- 172.21.15.138:0/1133404873 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05c013b60 con 0x559ea95654b0 2024-02-16T10:30:47.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.836+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ea9658050 con 0x559ea95654b0 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fbf50e09640 1 -- 172.21.15.138:0/1133404873 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc05c013cc0 con 0x559ea95654b0 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fbf50e09640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 0x7fbf4c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fbf50e09640 1 -- 172.21.15.138:0/1133404873 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc05c049520 con 0x559ea95654b0 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc063816640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 0x7fbf4c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 0x559ea965e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea965e840 con 0x559ea9569a10 2024-02-16T10:30:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 0x559ea965e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc063816640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 0x7fbf4c036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0ad000 tx=0x7fc04c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 0x559ea965e300 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 -- 172.21.15.138:0/1133404873 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0540083f0 con 0x559ea9569a10 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea965ec50 con 0x559ea9569a10 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 -- 172.21.15.138:0/1133404873 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0540083f0 con 0x559ea9569a10 2024-02-16T10:30:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9660500 con 0x559ea9569a10 2024-02-16T10:30:47.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 -- 172.21.15.138:0/1133404873 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc0540083f0 con 0x559ea9569a10 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea965f700 con 0x559ea9569a10 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064818640 1 -- 172.21.15.138:0/1133404873 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0540083f0 con 0x559ea9569a10 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 0x559ea9663880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9663ed0 con 0x559ea9660020 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064017640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 0x559ea9663880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064017640 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 0x559ea9663880 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc064017640 1 -- 172.21.15.138:0/1133404873 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc05c024020 con 0x559ea9660020 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.840+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea940af20 con 0x559ea9671e50 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36512/0 (socket says 172.21.15.138:36512) 2024-02-16T10:30:47.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064818640 1 -- 172.21.15.138:0/993338124 learned_addr learned my addr 172.21.15.138:0/993338124 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064818640 1 -- 172.21.15.138:0/993338124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea96727b0 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064818640 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559ea9658200 tx=0x7fc05400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 -- 172.21.15.138:0/993338124 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05400f040 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 -- 172.21.15.138:0/993338124 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054019550 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ea9672a00 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 -- 172.21.15.138:0/993338124 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0540197f0 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ea9673550 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 -- 172.21.15.138:0/993338124 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc0540199a0 con 0x559ea9671e50 2024-02-16T10:30:47.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 0x7fbf3c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fbf49ffb640 1 -- 172.21.15.138:0/993338124 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc05404b480 con 0x559ea9671e50 2024-02-16T10:30:47.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064017640 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 0x7fbf3c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc064017640 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 0x7fbf3c036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x559ea965f140 tx=0x7fc05c028ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.844+0000 7fc0664fc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea93fe790 con 0x559ea964d750 2024-02-16T10:30:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36518/0 (socket says 172.21.15.138:36518) 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 -- 172.21.15.138:0/3602568425 learned_addr learned my addr 172.21.15.138:0/3602568425 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 -- 172.21.15.138:0/3602568425 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea964e140 con 0x559ea964d750 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- 172.21.15.138:0/3602568425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0540498a0 tx=0x7fc05402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e1f4aa6185004a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf437fe640 1 -- 172.21.15.138:0/3602568425 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc054048070 con 0x559ea964d750 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf437fe640 1 -- 172.21.15.138:0/3602568425 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0540153a0 con 0x559ea964d750 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf437fe640 1 -- 172.21.15.138:0/3602568425 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc054015cc0 con 0x559ea964d750 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/3602568425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 msgr2=0x559ea964db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 --2- 172.21.15.138:0/3602568425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0540498a0 tx=0x7fc05402a410 comp rx=0 tx=0).stop 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/3602568425 shutdown_connections 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 --2- 172.21.15.138:0/3602568425 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea964db70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/3602568425 >> 172.21.15.138:0/3602568425 conn(0x559ea96799d0 msgr2=0x559ea967a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/3602568425 shutdown_connections 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/3602568425 wait complete. 2024-02-16T10:30:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 Processor -- start 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- start start 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea9688290 con 0x559ea964d750 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36528/0 (socket says 172.21.15.138:36528) 2024-02-16T10:30:47.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 learned_addr learned my addr 172.21.15.138:0/2555762931 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:47.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea9673550 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc064818640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc05403e040 tx=0x7fc054049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf41ffb640 1 -- 172.21.15.138:0/2555762931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc054018530 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf41ffb640 1 -- 172.21.15.138:0/2555762931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054015510 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ea9688490 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ea96888c0 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.848+0000 7fbf41ffb640 1 -- 172.21.15.138:0/2555762931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc054048070 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fbf41ffb640 1 -- 172.21.15.138:0/2555762931 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc054032020 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fbf41ffb640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf340342b0 0x7fbf34036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fbf41ffb640 1 -- 172.21.15.138:0/2555762931 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc054045be0 con 0x559ea964d750 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064017640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf340342b0 0x7fbf34036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea96934a0 0x559ea9695940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9696090 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea96934a0 0x559ea9695940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064017640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf340342b0 0x7fbf34036770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x559ea9664270 tx=0x7fc05c035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea96934a0 0x559ea9695940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 realm 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9696480 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9696cd0 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9697030 con 0x559ea96934a0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9697830 con 0x559ea96934a0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 20 searching for the correct realm 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559ea96996e0 0x559ea969bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064818640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559ea96996e0 0x559ea969bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064818640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559ea96996e0 0x559ea969bba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064818640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc054022070 0x7fc054036840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.852+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc054022070 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc064017640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc054022070 0x7fc054036840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc064017640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc054022070 0x7fc054036840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc064017640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc05c012c00 0x7fc05c0079a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc05c012c00 0x7fc05c0079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc05c012c00 0x7fc05c0079a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.856+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc054022070 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc054022070 2024-02-16T10:30:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.860+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc054022070 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc054022070 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96996e0 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.864+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x7fc05c012c00 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c220 con 0x559ea96934a0 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc04c0da080 con 0x7fc054022070 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:47.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9698130 con 0x559ea96934a0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9698980 con 0x559ea96934a0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea9698980 con 0x7fc054022070 2024-02-16T10:30:47.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 zone default found 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 4 Realm: () 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 zonegroup default 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969c660 con 0x7fc05c012c00 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969e420 con 0x559ea96996e0 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969e7b0 con 0x559ea96996e0 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 started sync module instance, tier type = 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969dd00 con 0x7fc054022070 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139935479904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969e0b0 con 0x7fc054022070 2024-02-16T10:30:47.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.868+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969f660 con 0x559ea96934a0 2024-02-16T10:30:47.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.872+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139935479904] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.872+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.872+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139935486400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969fa80 con 0x559ea96934a0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.872+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a02c0 con 0x559ea96996e0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.872+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139935486400] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139935487456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969fea0 con 0x559ea96996e0 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a0c80 con 0x7fc054022070 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139935492064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a14d0 con 0x7fc054022070 2024-02-16T10:30:47.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a1f70 con 0x559ea96934a0 2024-02-16T10:30:47.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139935487456] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139935492064] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139935494192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969fa00 con 0x559ea96934a0 2024-02-16T10:30:47.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.876+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a27c0 con 0x7fc05c012c00 2024-02-16T10:30:47.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139935498960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a26f0 con 0x7fc05c012c00 2024-02-16T10:30:47.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3620 con 0x7fc05c012c00 2024-02-16T10:30:47.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139935494192] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139935498960] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139935501168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3180 con 0x7fc05c012c00 2024-02-16T10:30:47.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.880+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a39c0 con 0x7fc05c012c00 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139935502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a4040 con 0x7fc05c012c00 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=0 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=1 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=2 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=3 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=4 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=5 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139935501168] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=6 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139935502720] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 20 add_watcher() i=7 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a6f60 con 0x559ea96934a0 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139935505040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a4350 con 0x559ea96934a0 2024-02-16T10:30:47.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139935505040] v31'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.884+0000 7fbf1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 5 note: GC not initialized 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbf197e2640 20 reqs_thread_entry: start 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 Filter name: none 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbe8affd640 20 reqs_thread_entry: start 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96c8c90 con 0x559ea96934a0 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-02-16T10:30:47.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rados->read ofs=0 len=0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96c9030 con 0x559ea96934a0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96ce8e0 con 0x559ea96934a0 2024-02-16T10:30:47.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~515] v31'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94139935679488 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96cb4f0 con 0x559ea96934a0 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94139935494192 notify 133143986181 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x559ea956d350 con 0x559ea96934a0 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbf437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94139935494192 notifier 4360 bl.length()=691 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbf437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:47.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbf437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:47.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(65 notify.4 [notify cookie 94139935679488 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fbf437fe640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbf28003ea0 con 0x559ea96934a0 2024-02-16T10:30:47.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94139935679488 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc04c0d0850 con 0x559ea96934a0 2024-02-16T10:30:47.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.888+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96ce400 con 0x559ea96934a0 2024-02-16T10:30:47.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94139935679488 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96cb4f0 con 0x7fc054022070 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== watch-notify(notify (1) cookie 94139935479904 notify 133143986178 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x559ea9658050 con 0x7fc054022070 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fbf437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94139935479904 notifier 4360 bl.length()=166 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fbf437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fbf437fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fbf437fe640 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbf28003ea0 con 0x7fc054022070 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(68 notify.0 [notify cookie 94139935679488 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify_complete (2) cookie 94139935679488 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc05c02d070 con 0x7fc054022070 2024-02-16T10:30:47.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.904 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"yO7xnEE1cHeiarT8BX5wYCaxZHgXl30VXZ0DOQMG","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fbf1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139935505040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a95e0 con 0x559ea96934a0 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94139935505040] v31'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139935479904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3a90 con 0x7fc054022070 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94139935479904] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 20 remove_watcher() i=0 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 2 removed watcher, disabling cache 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.892+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139935486400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3a90 con 0x559ea96934a0 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94139935486400] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc0664fc980 20 remove_watcher() i=1 2024-02-16T10:30:47.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139935487456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969f1c0 con 0x559ea96996e0 2024-02-16T10:30:47.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc064818640 1 -- 172.21.15.138:0/2555762931 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94139935487456] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc054012070 con 0x559ea96996e0 2024-02-16T10:30:47.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc0664fc980 20 remove_watcher() i=2 2024-02-16T10:30:47.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.896+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139935492064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea969f660 con 0x7fc054022070 2024-02-16T10:30:47.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc064017640 1 -- 172.21.15.138:0/2555762931 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94139935492064] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc05c024020 con 0x7fc054022070 2024-02-16T10:30:47.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc0664fc980 20 remove_watcher() i=3 2024-02-16T10:30:47.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139935494192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3a90 con 0x559ea96934a0 2024-02-16T10:30:47.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94139935494192] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x559ea96934a0 2024-02-16T10:30:47.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc0664fc980 20 remove_watcher() i=4 2024-02-16T10:30:47.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.900+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139935498960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a1030 con 0x7fc05c012c00 2024-02-16T10:30:47.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94139935498960] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc0664fc980 20 remove_watcher() i=5 2024-02-16T10:30:47.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139935501168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a3a90 con 0x7fc05c012c00 2024-02-16T10:30:47.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94139935501168] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc0664fc980 20 remove_watcher() i=6 2024-02-16T10:30:47.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.904+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139935502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559ea96a22d0 con 0x7fc05c012c00 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94139935502720] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04c0ab810 con 0x7fc05c012c00 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 20 remove_watcher() i=7 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc05c012c00 msgr2=0x7fc05c0079a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc05c012c00 0x7fc05c0079a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea96934a0 msgr2=0x559ea9695940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea96934a0 0x559ea9695940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc054022070 msgr2=0x7fc054036840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc054022070 0x7fc054036840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559ea96996e0 msgr2=0x559ea969bba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559ea96996e0 0x559ea969bba0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf340342b0 msgr2=0x7fbf34036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf340342b0 0x7fbf34036770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x559ea9664270 tx=0x7fc05c035000 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc063816640 1 -- 172.21.15.138:0/2555762931 reap_dead start 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 msgr2=0x559ea9687d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc05403e040 tx=0x7fc054049800 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 shutdown_connections 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/2555762931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea964d750 0x559ea9687d50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 >> 172.21.15.138:0/2555762931 conn(0x559ea96799d0 msgr2=0x559ea967a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 shutdown_connections 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/2555762931 wait complete. 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 msgr2=0x7fbf3c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 0x7fbf3c036770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x559ea965f140 tx=0x7fc05c028ea0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 msgr2=0x559ea9672270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559ea9658200 tx=0x7fc05400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 shutdown_connections 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c0342b0 0x7fbf3c036770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/993338124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea9671e50 0x559ea9672270 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 >> 172.21.15.138:0/993338124 conn(0x559ea9666c60 msgr2=0x559ea9667770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 shutdown_connections 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/993338124 wait complete. 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 msgr2=0x559ea965e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 0x559ea965e300 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 msgr2=0x559ea9663880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 0x559ea9663880 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 msgr2=0x7fbf4c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 0x7fbf4c036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0ad000 tx=0x7fc04c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 msgr2=0x559ea9657660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x559ea9650430 tx=0x7fc05c000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:47.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 shutdown_connections 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559ea9660020 0x559ea9663880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559ea9569a10 0x559ea965e300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf4c0342b0 0x7fbf4c036770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 --2- 172.21.15.138:0/1133404873 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559ea95654b0 0x559ea9657660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 >> 172.21.15.138:0/1133404873 conn(0x559ea9560d80 msgr2=0x559ea964e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 shutdown_connections 2024-02-16T10:30:47.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.908+0000 7fc0664fc980 1 -- 172.21.15.138:0/1133404873 wait complete. 2024-02-16T10:30:47.925 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'yO7xnEE1cHeiarT8BX5wYCaxZHgXl30VXZ0DOQMG', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:47.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T10:30:47.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-02-16T10:30:47.926 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-02-16T10:30:48.003 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.003 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5436190980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5561562effc0 0x5561562ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5436190980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5561562c5af0 con 0x5561562eeb00 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5436190980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55615628cd30 con 0x5561562effc0 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5433cab640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5561562effc0 0x5561562ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f54334aa640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5561562eeb00 0x556156385db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53358/0 (socket says 172.21.15.138:53358) 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f54334aa640 1 -- 172.21.15.138:0/1636296144 learned_addr learned my addr 172.21.15.138:0/1636296144 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5433cab640 1 -- 172.21.15.138:0/1636296144 >> v1:172.21.15.107:6789/0 conn(0x5561562eeb00 legacy=0x556156385db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:47.996+0000 7f5433cab640 1 -- 172.21.15.138:0/1636296144 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55615637d1b0 con 0x5561562effc0 2024-02-16T10:30:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5433cab640 1 --2- 172.21.15.138:0/1636296144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562effc0 0x5561562ee5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f542400a420 tx=0x7f542401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcfc1f35a4e0911 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5432ca9640 1 -- 172.21.15.138:0/1636296144 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240a3cb0 con 0x5561562effc0 2024-02-16T10:30:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5432ca9640 1 -- 172.21.15.138:0/1636296144 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240a3e10 con 0x5561562effc0 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5432ca9640 1 -- 172.21.15.138:0/1636296144 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240ab570 con 0x5561562effc0 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 -- 172.21.15.138:0/1636296144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562effc0 msgr2=0x5561562ee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 --2- 172.21.15.138:0/1636296144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562effc0 0x5561562ee5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f542400a420 tx=0x7f542401afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 -- 172.21.15.138:0/1636296144 shutdown_connections 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 --2- 172.21.15.138:0/1636296144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562effc0 0x5561562ee5c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 -- 172.21.15.138:0/1636296144 >> 172.21.15.138:0/1636296144 conn(0x556156374e90 msgr2=0x5561563772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 -- 172.21.15.138:0/1636296144 shutdown_connections 2024-02-16T10:30:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.000+0000 7f5436190980 1 -- 172.21.15.138:0/1636296144 wait complete. 2024-02-16T10:30:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5436190980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5436190980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556156289fc0 con 0x5561562eeb00 2024-02-16T10:30:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5433cab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5433cab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36540/0 (socket says 172.21.15.138:36540) 2024-02-16T10:30:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.012+0000 7f5433cab640 1 -- 172.21.15.138:0/1106246085 learned_addr learned my addr 172.21.15.138:0/1106246085 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 -- 172.21.15.138:0/1106246085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542400a100 con 0x5561562eeb00 2024-02-16T10:30:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 --2- 172.21.15.138:0/1106246085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5424018c00 tx=0x7f54240033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7483e4ed2c6e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5321e0b640 1 -- 172.21.15.138:0/1106246085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240ab440 con 0x5561562eeb00 2024-02-16T10:30:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5321e0b640 1 -- 172.21.15.138:0/1106246085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240ab5a0 con 0x5561562eeb00 2024-02-16T10:30:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5321e0b640 1 -- 172.21.15.138:0/1106246085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240ab840 con 0x5561562eeb00 2024-02-16T10:30:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/1106246085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 msgr2=0x55615646a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 --2- 172.21.15.138:0/1106246085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5424018c00 tx=0x7f54240033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/1106246085 shutdown_connections 2024-02-16T10:30:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 --2- 172.21.15.138:0/1106246085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x55615646a4d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/1106246085 >> 172.21.15.138:0/1106246085 conn(0x556156374e90 msgr2=0x556156466060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/1106246085 shutdown_connections 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/1106246085 wait complete. 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561562857a0 con 0x5561562eeb00 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36548/0 (socket says 172.21.15.138:36548) 2024-02-16T10:30:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 -- 172.21.15.138:0/465151722 learned_addr learned my addr 172.21.15.138:0/465151722 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55615637d1b0 con 0x5561562eeb00 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5433cab640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5424018c00 tx=0x7f5424017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f531bfff640 1 -- 172.21.15.138:0/465151722 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240bd8f0 con 0x5561562eeb00 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556156471840 con 0x5561562eeb00 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f531bfff640 1 -- 172.21.15.138:0/465151722 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240bda50 con 0x5561562eeb00 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556156471cf0 con 0x5561562eeb00 2024-02-16T10:30:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.016+0000 7f531bfff640 1 -- 172.21.15.138:0/465151722 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240bdcf0 con 0x5561562eeb00 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f531bfff640 1 -- 172.21.15.138:0/465151722 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f54240b2040 con 0x5561562eeb00 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f531bfff640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 0x7f531c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f531bfff640 1 -- 172.21.15.138:0/465151722 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f54240e3b50 con 0x5561562eeb00 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54334aa640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 0x7f531c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 0x556156477ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556156478530 con 0x5561562effc0 2024-02-16T10:30:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 0x556156477ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54334aa640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 0x7f531c036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5428001da0 tx=0x7f5428001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 0x556156477ff0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 -- 172.21.15.138:0/465151722 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f542c0083f0 con 0x5561562effc0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556156478960 con 0x5561562effc0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 -- 172.21.15.138:0/465151722 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f542c0083f0 con 0x5561562effc0 2024-02-16T10:30:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55615647a210 con 0x5561562effc0 2024-02-16T10:30:48.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 -- 172.21.15.138:0/465151722 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f542c0083f0 con 0x5561562effc0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x556156479410 con 0x5561562effc0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f54344ac640 1 -- 172.21.15.138:0/465151722 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f542c0083f0 con 0x5561562effc0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 0x55615647d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55615647dbe0 con 0x556156479d30 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5433cab640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 0x55615647d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5433cab640 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 0x55615647d590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.020+0000 7f5433cab640 1 -- 172.21.15.138:0/465151722 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f54240c6a00 con 0x556156479d30 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55615621df20 con 0x55615648bb80 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36556/0 (socket says 172.21.15.138:36556) 2024-02-16T10:30:48.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f54344ac640 1 -- 172.21.15.138:0/4280703540 learned_addr learned my addr 172.21.15.138:0/4280703540 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f54344ac640 1 -- 172.21.15.138:0/4280703540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55615648c4e0 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f54344ac640 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5561564723e0 tx=0x7f542c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 -- 172.21.15.138:0/4280703540 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c00f040 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 -- 172.21.15.138:0/4280703540 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c019550 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55615648c730 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 -- 172.21.15.138:0/4280703540 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c0197f0 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55615648d280 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 -- 172.21.15.138:0/4280703540 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f542c0199a0 con 0x55615648bb80 2024-02-16T10:30:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 0x7f530c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f53197fa640 1 -- 172.21.15.138:0/4280703540 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f542c04b480 con 0x55615648bb80 2024-02-16T10:30:48.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5433cab640 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 0x7f530c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5433cab640 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 0x7f530c036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x556156478e50 tx=0x7f54240cff60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.024+0000 7f5436190980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556156211790 con 0x556156498b80 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36568/0 (socket says 172.21.15.138:36568) 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 -- 172.21.15.138:0/1016692107 learned_addr learned my addr 172.21.15.138:0/1016692107 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 -- 172.21.15.138:0/1016692107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556156499570 con 0x556156498b80 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- 172.21.15.138:0/1016692107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f542c0498a0 tx=0x7f542c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f28573a064d3c8f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5312ffd640 1 -- 172.21.15.138:0/1016692107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c048070 con 0x556156498b80 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5312ffd640 1 -- 172.21.15.138:0/1016692107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c0153a0 con 0x556156498b80 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5312ffd640 1 -- 172.21.15.138:0/1016692107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c015cc0 con 0x556156498b80 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/1016692107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 msgr2=0x556156498fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 --2- 172.21.15.138:0/1016692107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f542c0498a0 tx=0x7f542c02a410 comp rx=0 tx=0).stop 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/1016692107 shutdown_connections 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 --2- 172.21.15.138:0/1016692107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x556156498fa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/1016692107 >> 172.21.15.138:0/1016692107 conn(0x556156493700 msgr2=0x5561564945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/1016692107 shutdown_connections 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/1016692107 wait complete. 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 Processor -- start 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- start start 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55615649fdc0 con 0x556156498b80 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36570/0 (socket says 172.21.15.138:36570) 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 learned_addr learned my addr 172.21.15.138:0/3278840259 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55615648d280 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f54344ac640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f542c03e040 tx=0x7f542c049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f53117fa640 1 -- 172.21.15.138:0/3278840259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c018530 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55615649ffc0 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f53117fa640 1 -- 172.21.15.138:0/3278840259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c015510 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f53117fa640 1 -- 172.21.15.138:0/3278840259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542c048070 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.028+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561564a03f0 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f53117fa640 1 -- 172.21.15.138:0/3278840259 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f542c032020 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f53117fa640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f52fc0342b0 0x7f52fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f53117fa640 1 -- 172.21.15.138:0/3278840259 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f542c037c90 con 0x556156498b80 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f52fc0342b0 0x7f52fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561564ab010 0x5561564ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564adc20 con 0x5561564ab010 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561564ab010 0x5561564ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f52fc0342b0 0x7f52fc036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55615647dfa0 tx=0x7f54240e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561564ab010 0x5561564ad4d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 realm 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564aa4f0 con 0x5561564ab010 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564ae6a0 con 0x5561564ab010 2024-02-16T10:30:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564aeb90 con 0x5561564ab010 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564af430 con 0x5561564ab010 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 20 searching for the correct realm 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5561564b1360 0x5561564b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54344ac640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5561564b1360 0x5561564b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54344ac640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5561564b1360 0x5561564b3820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54344ac640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f542c022070 0x7f542c01d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f542c022070 0x7f542c01d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f542c022070 0x7f542c01d070 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f54240ac040 0x7f54240e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.032+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f54240ac040 0x7f54240e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f54240ac040 0x7f54240e30f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.036+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.040+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564b1360 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f54240ac040 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x5561564ab010 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b3ea0 con 0x7f542c022070 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.044+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b0930 con 0x5561564ab010 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b0150 con 0x5561564ab010 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b42e0 con 0x7f542c022070 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 zone default found 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 4 Realm: () 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 zonegroup default 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b4640 con 0x7f54240ac040 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b63d0 con 0x5561564b1360 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b6760 con 0x5561564b1360 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 started sync module instance, tier type = 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b5860 con 0x7f542c022070 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93876547965888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b6060 con 0x7f542c022070 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b7210 con 0x5561564ab010 2024-02-16T10:30:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.048+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93876547965888] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93876547972336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b75c0 con 0x5561564ab010 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b7f30 con 0x5561564b1360 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93876547972336] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93876547967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b7f30 con 0x5561564b1360 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.052+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b8930 con 0x7f542c022070 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93876547978320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b9180 con 0x7f542c022070 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b9ba0 con 0x5561564ab010 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93876547967936] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93876547978320] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93876547980512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b7a90 con 0x5561564ab010 2024-02-16T10:30:48.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.056+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564ba3f0 con 0x7f54240ac040 2024-02-16T10:30:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93876547980512] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93876547982976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564ba350 con 0x7f54240ac040 2024-02-16T10:30:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bacc0 con 0x7f54240ac040 2024-02-16T10:30:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93876547987488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bb0e0 con 0x7f54240ac040 2024-02-16T10:30:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bbb80 con 0x7f54240ac040 2024-02-16T10:30:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.060+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93876547982976] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93876547987488] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93876547991136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bac40 con 0x7f54240ac040 2024-02-16T10:30:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=0 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=1 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=2 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=3 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=4 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=5 2024-02-16T10:30:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=6 2024-02-16T10:30:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93876547991136] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 20 add_watcher() i=7 2024-02-16T10:30:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bec80 con 0x5561564ab010 2024-02-16T10:30:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.064+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93876547984992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564bc0f0 con 0x5561564ab010 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93876547984992] v31'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f52e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 5 note: GC not initialized 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f52e8fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 Filter name: none 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f52627fc640 20 reqs_thread_entry: start 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564e0990 con 0x5561564ab010 2024-02-16T10:30:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:30:48.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:48.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:48.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564e6710 con 0x5561564ab010 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93876548166032 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564e21e0 con 0x5561564ab010 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 93876547980512 notify 133143986182 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7f5428038040 con 0x5561564ab010 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5312ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 93876547980512 notifier 4367 bl.length()=691 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5312ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(64 notify.4 [notify cookie 93876548166032 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5312ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f5312ffd640 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f52f8003ea0 con 0x5561564ab010 2024-02-16T10:30:48.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.068+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 93876548166032 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5561562c5af0 con 0x5561564ab010 2024-02-16T10:30:48.079 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f52e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93876547984992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564e52a0 con 0x5561564ab010 2024-02-16T10:30:48.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93876547984992] v31'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93876547965888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b9e60 con 0x7f542c022070 2024-02-16T10:30:48.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93876547965888] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5436190980 20 remove_watcher() i=0 2024-02-16T10:30:48.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5436190980 2 removed watcher, disabling cache 2024-02-16T10:30:48.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.072+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93876547972336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b53c0 con 0x5561564ab010 2024-02-16T10:30:48.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93876547972336] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f5436190980 20 remove_watcher() i=1 2024-02-16T10:30:48.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93876547967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b53c0 con 0x5561564b1360 2024-02-16T10:30:48.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f54344ac640 1 -- 172.21.15.138:0/3278840259 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93876547967936] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542c012070 con 0x5561564b1360 2024-02-16T10:30:48.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f5436190980 20 remove_watcher() i=2 2024-02-16T10:30:48.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.076+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93876547978320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b5bc0 con 0x7f542c022070 2024-02-16T10:30:48.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5433cab640 1 -- 172.21.15.138:0/3278840259 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93876547978320] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54240ed040 con 0x7f542c022070 2024-02-16T10:30:48.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 20 remove_watcher() i=3 2024-02-16T10:30:48.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93876547980512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b53c0 con 0x5561564ab010 2024-02-16T10:30:48.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93876547980512] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x5561564ab010 2024-02-16T10:30:48.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 20 remove_watcher() i=4 2024-02-16T10:30:48.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93876547982976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b5bc0 con 0x7f54240ac040 2024-02-16T10:30:48.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93876547982976] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 20 remove_watcher() i=5 2024-02-16T10:30:48.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.084+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93876547987488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b8ce0 con 0x7f54240ac040 2024-02-16T10:30:48.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93876547987488] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 20 remove_watcher() i=6 2024-02-16T10:30:48.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93876547991136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561564b53c0 con 0x7f54240ac040 2024-02-16T10:30:48.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93876547991136] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f542800e640 con 0x7f54240ac040 2024-02-16T10:30:48.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 20 remove_watcher() i=7 2024-02-16T10:30:48.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f54240ac040 msgr2=0x7f54240e30f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f54240ac040 0x7f54240e30f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561564ab010 msgr2=0x5561564ad4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561564ab010 0x5561564ad4d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f542c022070 msgr2=0x7f542c01d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f542c022070 0x7f542c01d070 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5561564b1360 msgr2=0x5561564b3820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5561564b1360 0x5561564b3820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f52fc0342b0 msgr2=0x7f52fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f52fc0342b0 0x7f52fc036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55615647dfa0 tx=0x7f54240e6000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f54334aa640 1 -- 172.21.15.138:0/3278840259 reap_dead start 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 msgr2=0x55615649f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f542c03e040 tx=0x7f542c049800 comp rx=0 tx=0).stop 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 shutdown_connections 2024-02-16T10:30:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 --2- 172.21.15.138:0/3278840259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556156498b80 0x55615649f880 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 >> 172.21.15.138:0/3278840259 conn(0x556156493700 msgr2=0x5561564945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 shutdown_connections 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.088+0000 7f5436190980 1 -- 172.21.15.138:0/3278840259 wait complete. 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 msgr2=0x7f530c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 0x7f530c036770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x556156478e50 tx=0x7f54240cff60 comp rx=0 tx=0).stop 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 msgr2=0x55615648bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5561564723e0 tx=0x7f542c00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 shutdown_connections 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f530c0342b0 0x7f530c036770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/4280703540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55615648bb80 0x55615648bfa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 >> 172.21.15.138:0/4280703540 conn(0x556156480990 msgr2=0x5561564814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 shutdown_connections 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/4280703540 wait complete. 2024-02-16T10:30:48.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 msgr2=0x556156477ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 0x556156477ff0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 msgr2=0x55615647d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 0x55615647d590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 msgr2=0x7f531c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 0x7f531c036770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5428001da0 tx=0x7f5428001300 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 msgr2=0x556156471300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5424018c00 tx=0x7f5424017d70 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 shutdown_connections 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556156479d30 0x55615647d590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5561562effc0 0x556156477ff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f531c0342b0 0x7f531c036770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 --2- 172.21.15.138:0/465151722 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5561562eeb00 0x556156471300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 >> 172.21.15.138:0/465151722 conn(0x556156374e90 msgr2=0x556156464b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 shutdown_connections 2024-02-16T10:30:48.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.092+0000 7f5436190980 1 -- 172.21.15.138:0/465151722 wait complete. 2024-02-16T10:30:48.108 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.108 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:48.176 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.176 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10a105980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55de20535710 0x55de205c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10a105980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55de2050db50 con 0x55de205c47d0 2024-02-16T10:30:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10a105980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de204d4d30 con 0x55de20535710 2024-02-16T10:30:48.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff107c20640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55de20535710 0x55de205c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10741f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55de205c47d0 0x55de205c6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53372/0 (socket says 172.21.15.138:53372) 2024-02-16T10:30:48.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.168+0000 7ff10741f640 1 -- 172.21.15.138:0/3216510717 learned_addr learned my addr 172.21.15.138:0/3216510717 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:48.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff107c20640 1 -- 172.21.15.138:0/3216510717 >> v1:172.21.15.107:6789/0 conn(0x55de205c47d0 legacy=0x55de205c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff107c20640 1 -- 172.21.15.138:0/3216510717 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de205c9380 con 0x55de20535710 2024-02-16T10:30:48.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff107c20640 1 --2- 172.21.15.138:0/3216510717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de205c4290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff10000a420 tx=0x7ff10001ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1f0bcc0e06e464 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff106c1e640 1 -- 172.21.15.138:0/3216510717 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000a3ce0 con 0x55de20535710 2024-02-16T10:30:48.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff106c1e640 1 -- 172.21.15.138:0/3216510717 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000a3e40 con 0x55de20535710 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff106c1e640 1 -- 172.21.15.138:0/3216510717 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000ab570 con 0x55de20535710 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 -- 172.21.15.138:0/3216510717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 msgr2=0x55de205c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 --2- 172.21.15.138:0/3216510717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de205c4290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff10000a420 tx=0x7ff10001ae60 comp rx=0 tx=0).stop 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 -- 172.21.15.138:0/3216510717 shutdown_connections 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 --2- 172.21.15.138:0/3216510717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de205c4290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 -- 172.21.15.138:0/3216510717 >> 172.21.15.138:0/3216510717 conn(0x55de205bbd70 msgr2=0x55de205be190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 -- 172.21.15.138:0/3216510717 shutdown_connections 2024-02-16T10:30:48.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.172+0000 7ff10a105980 1 -- 172.21.15.138:0/3216510717 wait complete. 2024-02-16T10:30:48.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.184+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.184+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de204d1fc0 con 0x55de20535710 2024-02-16T10:30:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36598/0 (socket says 172.21.15.138:36598) 2024-02-16T10:30:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 -- 172.21.15.138:0/2328060892 learned_addr learned my addr 172.21.15.138:0/2328060892 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 -- 172.21.15.138:0/2328060892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10000a100 con 0x55de20535710 2024-02-16T10:30:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 --2- 172.21.15.138:0/2328060892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ae040 tx=0x7ff1000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba50b6bb2905ee3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7feff5e0b640 1 -- 172.21.15.138:0/2328060892 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000ab440 con 0x55de20535710 2024-02-16T10:30:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7feff5e0b640 1 -- 172.21.15.138:0/2328060892 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000ab5a0 con 0x55de20535710 2024-02-16T10:30:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7feff5e0b640 1 -- 172.21.15.138:0/2328060892 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000ab840 con 0x55de20535710 2024-02-16T10:30:48.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- 172.21.15.138:0/2328060892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 msgr2=0x55de206ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 --2- 172.21.15.138:0/2328060892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ae040 tx=0x7ff1000033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- 172.21.15.138:0/2328060892 shutdown_connections 2024-02-16T10:30:48.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 --2- 172.21.15.138:0/2328060892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206ab690 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- 172.21.15.138:0/2328060892 >> 172.21.15.138:0/2328060892 conn(0x55de205bbd70 msgr2=0x55de206a7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- 172.21.15.138:0/2328060892 shutdown_connections 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- 172.21.15.138:0/2328060892 wait complete. 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff10a105980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de204cd7a0 con 0x55de20535710 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36614/0 (socket says 172.21.15.138:36614) 2024-02-16T10:30:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 -- 172.21.15.138:0/739752021 learned_addr learned my addr 172.21.15.138:0/739752021 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.188+0000 7ff107c20640 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de205c9380 con 0x55de20535710 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff107c20640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10001b700 tx=0x7ff100017c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 -- 172.21.15.138:0/739752021 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000a3cb0 con 0x55de20535710 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 -- 172.21.15.138:0/739752021 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1000b49c0 con 0x55de20535710 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de206b29e0 con 0x55de20535710 2024-02-16T10:30:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 -- 172.21.15.138:0/739752021 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1000b4c60 con 0x55de20535710 2024-02-16T10:30:48.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de206b2e90 con 0x55de20535710 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 -- 172.21.15.138:0/739752021 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1000b2040 con 0x55de20535710 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 0x7feff00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7fefeffff640 1 -- 172.21.15.138:0/739752021 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff1000e34d0 con 0x55de20535710 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10741f640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 0x7feff00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 0x55de206b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206b96d0 con 0x55de205c47d0 2024-02-16T10:30:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff108421640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 0x55de206b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10741f640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 0x7feff00367c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00b330 tx=0x7ff0fc0014b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff108421640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 0x55de206b9190 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff108421640 1 -- 172.21.15.138:0/739752021 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0f80083f0 con 0x55de205c47d0 2024-02-16T10:30:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206b9a30 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff108421640 1 -- 172.21.15.138:0/739752021 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff0f80083f0 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.192+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206bb2c0 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 -- 172.21.15.138:0/739752021 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff0f80083f0 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206ba4c0 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 -- 172.21.15.138:0/739752021 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff0f80083f0 con 0x55de205c47d0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 0x55de206be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206bec90 con 0x55de206bade0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff107c20640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 0x55de206be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff107c20640 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 0x55de206be640 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff107c20640 1 -- 172.21.15.138:0/739752021 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff1000cfc40 con 0x55de206bade0 2024-02-16T10:30:48.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20465f20 con 0x55de206ccc30 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36626/0 (socket says 172.21.15.138:36626) 2024-02-16T10:30:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 -- 172.21.15.138:0/1865880542 learned_addr learned my addr 172.21.15.138:0/1865880542 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 -- 172.21.15.138:0/1865880542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de206cd590 con 0x55de206ccc30 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff108421640 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55de206b3580 tx=0x7ff0f800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7fefed7fa640 1 -- 172.21.15.138:0/1865880542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f800f040 con 0x55de206ccc30 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7fefed7fa640 1 -- 172.21.15.138:0/1865880542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8019550 con 0x55de206ccc30 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7fefed7fa640 1 -- 172.21.15.138:0/1865880542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80197f0 con 0x55de206ccc30 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de206cd7e0 con 0x55de206ccc30 2024-02-16T10:30:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.196+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de206ce330 con 0x55de206ccc30 2024-02-16T10:30:48.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefed7fa640 1 -- 172.21.15.138:0/1865880542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff0f80199a0 con 0x55de206ccc30 2024-02-16T10:30:48.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefed7fa640 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 0x7fefe0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefed7fa640 1 -- 172.21.15.138:0/1865880542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff0f804b540 con 0x55de206ccc30 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff107c20640 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 0x7fefe0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff107c20640 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 0x7fefe0036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55de206b9f00 tx=0x7ff1000bc450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de20459790 con 0x55de205c0410 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36632/0 (socket says 172.21.15.138:36632) 2024-02-16T10:30:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff108421640 1 -- 172.21.15.138:0/2670867640 learned_addr learned my addr 172.21.15.138:0/2670867640 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff108421640 1 -- 172.21.15.138:0/2670867640 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de205c0e00 con 0x55de205c0410 2024-02-16T10:30:48.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff108421640 1 --2- 172.21.15.138:0/2670867640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80498a0 tx=0x7ff0f804b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be64046bb72f5bb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefe6ffd640 1 -- 172.21.15.138:0/2670867640 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8048070 con 0x55de205c0410 2024-02-16T10:30:48.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefe6ffd640 1 -- 172.21.15.138:0/2670867640 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f80184e0 con 0x55de205c0410 2024-02-16T10:30:48.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7fefe6ffd640 1 -- 172.21.15.138:0/2670867640 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80154d0 con 0x55de205c0410 2024-02-16T10:30:48.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- 172.21.15.138:0/2670867640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 msgr2=0x55de205c0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 --2- 172.21.15.138:0/2670867640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80498a0 tx=0x7ff0f804b420 comp rx=0 tx=0).stop 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- 172.21.15.138:0/2670867640 shutdown_connections 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 --2- 172.21.15.138:0/2670867640 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de205c0830 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- 172.21.15.138:0/2670867640 >> 172.21.15.138:0/2670867640 conn(0x55de206d47b0 msgr2=0x55de206d5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- 172.21.15.138:0/2670867640 shutdown_connections 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- 172.21.15.138:0/2670867640 wait complete. 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 Processor -- start 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- start start 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.200+0000 7ff10a105980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de206e3090 con 0x55de205c0410 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff108421640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36642/0 (socket says 172.21.15.138:36642) 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 learned_addr learned my addr 172.21.15.138:0/753400562 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de206ce330 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff108421640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800efb0 tx=0x7ff0f8049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 -- 172.21.15.138:0/753400562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f8031070 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 -- 172.21.15.138:0/753400562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f8017c60 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de206e3290 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 -- 172.21.15.138:0/753400562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80173b0 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de206e36c0 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 -- 172.21.15.138:0/753400562 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff0f80175a0 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefd00342b0 0x7fefd0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7fefe57fa640 1 -- 172.21.15.138:0/753400562 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff0f8037ca0 con 0x55de205c0410 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff107c20640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefd00342b0 0x7fefd0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de206ee280 0x55de206f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f0e90 con 0x55de206ee280 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10741f640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de206ee280 0x55de206f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff107c20640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefd00342b0 0x7fefd0036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ab040 tx=0x7ff1000de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10741f640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de206ee280 0x55de206f0740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 realm 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206ed760 con 0x55de206ee280 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.204+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f1910 con 0x55de206ee280 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f1e20 con 0x55de206ee280 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f15b0 con 0x55de206ee280 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 20 searching for the correct realm 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55de206f4110 0x55de206f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x55de206f4110 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff108421640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55de206f4110 0x55de206f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff108421640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55de206f4110 0x55de206f65a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff108421640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff0f8022070 0x7ff0f803f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x7ff0f8022070 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff107c20640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff0f8022070 0x7ff0f803f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff107c20640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff0f8022070 0x7ff0f803f1c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff107c20640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1000f1040 0x7ff1000e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x7ff1000f1040 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1000f1040 0x7ff1000e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1000f1040 0x7ff1000e3730 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x55de206ee280 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.208+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x55de206ee280 2024-02-16T10:30:48.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x7ff1000f1040 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f6c70 con 0x7ff1000f1040 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff0f8022070 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff0f8022070 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.212+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8012070 con 0x55de206f4110 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff0f8022070 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.216+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff0f8022070 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206f4110 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x55de206ee280 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff0fc02d040 con 0x7ff0f8022070 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f2d20 con 0x55de206ee280 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f29a0 con 0x55de206ee280 2024-02-16T10:30:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f35f0 con 0x7ff0f8022070 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 zone default found 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 4 Realm: () 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 zonegroup default 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f7100 con 0x7ff1000f1040 2024-02-16T10:30:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f8f80 con 0x55de206f4110 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.220+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f92e0 con 0x55de206f4110 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 20 started sync module instance, tier type = 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f8550 con 0x7ff0f8022070 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412515279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f9690 con 0x7ff0f8022070 2024-02-16T10:30:48.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fa060 con 0x55de206ee280 2024-02-16T10:30:48.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412515279024] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412515285856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fa410 con 0x55de206ee280 2024-02-16T10:30:48.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.224+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fadc0 con 0x55de206f4110 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412515285856] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412515281216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fad80 con 0x55de206f4110 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fb780 con 0x7ff0f8022070 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412515291872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fbfd0 con 0x7ff0f8022070 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fc9a0 con 0x55de206ee280 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412515281216] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.228+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412515291872] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412515294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fa8e0 con 0x55de206ee280 2024-02-16T10:30:48.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fd1f0 con 0x7ff1000f1040 2024-02-16T10:30:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412515294000] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412515296416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fd150 con 0x7ff1000f1040 2024-02-16T10:30:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.232+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fdac0 con 0x7ff1000f1040 2024-02-16T10:30:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412515300896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fdf20 con 0x7ff1000f1040 2024-02-16T10:30:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fe9f0 con 0x7ff1000f1040 2024-02-16T10:30:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412515296416] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412515300896] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412515304656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fcc60 con 0x7ff1000f1040 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=0 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=1 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=2 2024-02-16T10:30:48.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=3 2024-02-16T10:30:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=4 2024-02-16T10:30:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=5 2024-02-16T10:30:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.236+0000 7ff10a105980 20 add_watcher() i=6 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412515304656] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 add_watcher() i=7 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de207019e0 con 0x55de206ee280 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412515301952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fee50 con 0x55de206ee280 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412515301952] v31'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7fefbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 5 note: GC not initialized 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7fefbcfe1640 20 reqs_thread_entry: start 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 Filter name: none 2024-02-16T10:30:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7fef367fc640 20 reqs_thread_entry: start 2024-02-16T10:30:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de207232b0 con 0x55de206ee280 2024-02-16T10:30:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.240+0000 7ff10a105980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7fefbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412515301952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de20703ed0 con 0x55de206ee280 2024-02-16T10:30:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94412515301952] v31'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412515279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fda40 con 0x7ff0f8022070 2024-02-16T10:30:48.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94412515279024] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10a105980 20 remove_watcher() i=0 2024-02-16T10:30:48.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10a105980 2 removed watcher, disabling cache 2024-02-16T10:30:48.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.244+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412515285856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fda40 con 0x55de206ee280 2024-02-16T10:30:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94412515285856] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 20 remove_watcher() i=1 2024-02-16T10:30:48.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412515281216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f9b60 con 0x55de206f4110 2024-02-16T10:30:48.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff108421640 1 -- 172.21.15.138:0/753400562 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94412515281216] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0f8061040 con 0x55de206f4110 2024-02-16T10:30:48.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 20 remove_watcher() i=2 2024-02-16T10:30:48.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412515291872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206fda40 con 0x7ff0f8022070 2024-02-16T10:30:48.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff107c20640 1 -- 172.21.15.138:0/753400562 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94412515291872] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1000cfc40 con 0x7ff0f8022070 2024-02-16T10:30:48.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 20 remove_watcher() i=3 2024-02-16T10:30:48.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.248+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412515294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f8940 con 0x55de206ee280 2024-02-16T10:30:48.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94412515294000] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x55de206ee280 2024-02-16T10:30:48.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10a105980 20 remove_watcher() i=4 2024-02-16T10:30:48.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412515296416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f9b60 con 0x7ff1000f1040 2024-02-16T10:30:48.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94412515296416] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10a105980 20 remove_watcher() i=5 2024-02-16T10:30:48.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.252+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412515300896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f9b60 con 0x7ff1000f1040 2024-02-16T10:30:48.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.256+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94412515300896] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.256+0000 7ff10a105980 20 remove_watcher() i=6 2024-02-16T10:30:48.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.256+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412515304656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de206f9b60 con 0x7ff1000f1040 2024-02-16T10:30:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94412515304656] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff0fc00c040 con 0x7ff1000f1040 2024-02-16T10:30:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 20 remove_watcher() i=7 2024-02-16T10:30:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1000f1040 msgr2=0x7ff1000e3730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1000f1040 0x7ff1000e3730 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de206ee280 msgr2=0x55de206f0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de206ee280 0x55de206f0740 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff0f8022070 msgr2=0x7ff0f803f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff0f8022070 0x7ff0f803f1c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55de206f4110 msgr2=0x55de206f65a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55de206f4110 0x55de206f65a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefd00342b0 msgr2=0x7fefd0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefd00342b0 0x7fefd0036770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1000ab040 tx=0x7ff1000de000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10741f640 1 -- 172.21.15.138:0/753400562 reap_dead start 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 msgr2=0x55de206e2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800efb0 tx=0x7ff0f8049800 comp rx=0 tx=0).stop 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 shutdown_connections 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/753400562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de205c0410 0x55de206e2b50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 >> 172.21.15.138:0/753400562 conn(0x55de206d47b0 msgr2=0x55de206d5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 shutdown_connections 2024-02-16T10:30:48.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/753400562 wait complete. 2024-02-16T10:30:48.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 msgr2=0x7fefe0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 0x7fefe0036770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55de206b9f00 tx=0x7ff1000bc450 comp rx=0 tx=0).stop 2024-02-16T10:30:48.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 msgr2=0x55de206cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55de206b3580 tx=0x7ff0f800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 shutdown_connections 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fefe00342b0 0x7fefe0036770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/1865880542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de206ccc30 0x55de206cd050 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 >> 172.21.15.138:0/1865880542 conn(0x55de206c1a40 msgr2=0x55de206c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 shutdown_connections 2024-02-16T10:30:48.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/1865880542 wait complete. 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 msgr2=0x55de206b9190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 0x55de206b9190 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 msgr2=0x55de206be640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 0x55de206be640 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 msgr2=0x7feff00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 0x7feff00367c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00b330 tx=0x7ff0fc0014b0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 msgr2=0x55de206b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10001b700 tx=0x7ff100017c00 comp rx=0 tx=0).stop 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 shutdown_connections 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55de206bade0 0x55de206be640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55de205c47d0 0x55de206b9190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7feff0034300 0x7feff00367c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 --2- 172.21.15.138:0/739752021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55de20535710 0x55de206b24a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 >> 172.21.15.138:0/739752021 conn(0x55de205bbd70 msgr2=0x55de206a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 shutdown_connections 2024-02-16T10:30:48.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.260+0000 7ff10a105980 1 -- 172.21.15.138:0/739752021 wait complete. 2024-02-16T10:30:48.281 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.281 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.281 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:48.348 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.348 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc75329f980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55adadc36ae0 0x55adadc38ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc75329f980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55adadb7eb50 con 0x55adadc32620 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc75329f980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55adadb45d30 con 0x55adadc36ae0 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc7505b9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55adadc36ae0 0x55adadc38ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc750dba640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55adadc32620 0x55adadc32a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:53386/0 (socket says 172.21.15.138:53386) 2024-02-16T10:30:48.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc750dba640 1 -- 172.21.15.138:0/72775219 learned_addr learned my addr 172.21.15.138:0/72775219 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:48.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc7505b9640 1 -- 172.21.15.138:0/72775219 >> v1:172.21.15.107:6789/0 conn(0x55adadc32620 legacy=0x55adadc32a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.340+0000 7fc7505b9640 1 -- 172.21.15.138:0/72775219 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adadc3a420 con 0x55adadc36ae0 2024-02-16T10:30:48.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc7505b9640 1 --2- 172.21.15.138:0/72775219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc36ae0 0x55adadc38ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc74400a480 tx=0x7fc74401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8530ed0709716d30 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc74fdb8640 1 -- 172.21.15.138:0/72775219 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7440ab540 con 0x55adadc36ae0 2024-02-16T10:30:48.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc74fdb8640 1 -- 172.21.15.138:0/72775219 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440ab6a0 con 0x55adadc36ae0 2024-02-16T10:30:48.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc74fdb8640 1 -- 172.21.15.138:0/72775219 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7440ab960 con 0x55adadc36ae0 2024-02-16T10:30:48.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 -- 172.21.15.138:0/72775219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc36ae0 msgr2=0x55adadc38ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 --2- 172.21.15.138:0/72775219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc36ae0 0x55adadc38ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc74400a480 tx=0x7fc74401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:48.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 -- 172.21.15.138:0/72775219 shutdown_connections 2024-02-16T10:30:48.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 --2- 172.21.15.138:0/72775219 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc36ae0 0x55adadc38ed0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 -- 172.21.15.138:0/72775219 >> 172.21.15.138:0/72775219 conn(0x55adadc2def0 msgr2=0x55adadc30310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 -- 172.21.15.138:0/72775219 shutdown_connections 2024-02-16T10:30:48.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.344+0000 7fc75329f980 1 -- 172.21.15.138:0/72775219 wait complete. 2024-02-16T10:30:48.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.356+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.356+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.356+0000 7fc75329f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.356+0000 7fc75329f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adadb42fc0 con 0x55adadc32620 2024-02-16T10:30:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36656/0 (socket says 172.21.15.138:36656) 2024-02-16T10:30:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 -- 172.21.15.138:0/2776218365 learned_addr learned my addr 172.21.15.138:0/2776218365 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 -- 172.21.15.138:0/2776218365 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744005d30 con 0x55adadc32620 2024-02-16T10:30:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- 172.21.15.138:0/2776218365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc748006fb0 tx=0x7fc748001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0229c1e0012411 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63ee0d640 1 -- 172.21.15.138:0/2776218365 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc748004530 con 0x55adadc32620 2024-02-16T10:30:48.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63ee0d640 1 -- 172.21.15.138:0/2776218365 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748004690 con 0x55adadc32620 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63ee0d640 1 -- 172.21.15.138:0/2776218365 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7480049b0 con 0x55adadc32620 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/2776218365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 msgr2=0x55adadd1c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 --2- 172.21.15.138:0/2776218365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc748006fb0 tx=0x7fc748001940 comp rx=0 tx=0).stop 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/2776218365 shutdown_connections 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 --2- 172.21.15.138:0/2776218365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd1c620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/2776218365 >> 172.21.15.138:0/2776218365 conn(0x55adadc2def0 msgr2=0x55adadd181b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/2776218365 shutdown_connections 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/2776218365 wait complete. 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adadb3e7a0 con 0x55adadc32620 2024-02-16T10:30:48.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36668/0 (socket says 172.21.15.138:36668) 2024-02-16T10:30:48.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 -- 172.21.15.138:0/95796251 learned_addr learned my addr 172.21.15.138:0/95796251 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adadb7eb50 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc750dba640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55adadd1d4b0 tx=0x7fc748000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63d60a640 1 -- 172.21.15.138:0/95796251 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc748013760 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55adadd23b10 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63d60a640 1 -- 172.21.15.138:0/95796251 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480138c0 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc63d60a640 1 -- 172.21.15.138:0/95796251 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc748013b60 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.360+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adadd23fc0 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc63d60a640 1 -- 172.21.15.138:0/95796251 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc748028460 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc63d60a640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 0x7fc638036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc63d60a640 1 -- 172.21.15.138:0/95796251 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc748049630 con 0x55adadc32620 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7505b9640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 0x7fc638036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 0x55adadd2a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd2a800 con 0x55adadc36ae0 2024-02-16T10:30:48.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 0x55adadd2a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7505b9640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 0x7fc638036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ad000 tx=0x7fc7440a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 0x55adadd2a2c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 -- 172.21.15.138:0/95796251 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7400083f0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd2ac10 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 -- 172.21.15.138:0/95796251 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc7400083f0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd2c4c0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 -- 172.21.15.138:0/95796251 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc7400083f0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd2b6c0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc7515bb640 1 -- 172.21.15.138:0/95796251 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc7400083f0 con 0x55adadc36ae0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 0x55adadd2f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd2fe90 con 0x55adadd2bfe0 2024-02-16T10:30:48.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc750dba640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 0x55adadd2f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc750dba640 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 0x55adadd2f840 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.364+0000 7fc750dba640 1 -- 172.21.15.138:0/95796251 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc748024020 con 0x55adadd2bfe0 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adadad6f20 con 0x55adadd3de10 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36672/0 (socket says 172.21.15.138:36672) 2024-02-16T10:30:48.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc7515bb640 1 -- 172.21.15.138:0/3367897198 learned_addr learned my addr 172.21.15.138:0/3367897198 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc7515bb640 1 -- 172.21.15.138:0/3367897198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adadd3e770 con 0x55adadd3de10 2024-02-16T10:30:48.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc7515bb640 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55adadd24a00 tx=0x7fc74000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 -- 172.21.15.138:0/3367897198 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc74000f040 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 -- 172.21.15.138:0/3367897198 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740019550 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55adadd3e9c0 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 -- 172.21.15.138:0/3367897198 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7400197f0 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adadd3f510 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 -- 172.21.15.138:0/3367897198 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc7400199a0 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 0x7fc628036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc6367fc640 1 -- 172.21.15.138:0/3367897198 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc74004b480 con 0x55adadd3de10 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc750dba640 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 0x7fc628036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc750dba640 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 0x7fc628036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55adadd2b100 tx=0x7fc748001e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.368+0000 7fc75329f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adadaca790 con 0x55adadba7840 2024-02-16T10:30:48.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36688/0 (socket says 172.21.15.138:36688) 2024-02-16T10:30:48.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 -- 172.21.15.138:0/3991069141 learned_addr learned my addr 172.21.15.138:0/3991069141 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 -- 172.21.15.138:0/3991069141 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adadba8210 con 0x55adadba7840 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- 172.21.15.138:0/3991069141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc7400498a0 tx=0x7fc74002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa16fc82eddec287 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc627fff640 1 -- 172.21.15.138:0/3991069141 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc740048070 con 0x55adadba7840 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc627fff640 1 -- 172.21.15.138:0/3991069141 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7400153a0 con 0x55adadba7840 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc627fff640 1 -- 172.21.15.138:0/3991069141 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc740015cc0 con 0x55adadba7840 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/3991069141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 msgr2=0x55adadba7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 --2- 172.21.15.138:0/3991069141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc7400498a0 tx=0x7fc74002a410 comp rx=0 tx=0).stop 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/3991069141 shutdown_connections 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 --2- 172.21.15.138:0/3991069141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadba7c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/3991069141 >> 172.21.15.138:0/3991069141 conn(0x55adadd45990 msgr2=0x55adadd46870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/3991069141 shutdown_connections 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/3991069141 wait complete. 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 Processor -- start 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- start start 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adadd54260 con 0x55adadba7840 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36700/0 (socket says 172.21.15.138:36700) 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 learned_addr learned my addr 172.21.15.138:0/4125624318 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adadd3f510 con 0x55adadba7840 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc7515bb640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc740019fd0 tx=0x7fc740049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc6267fc640 1 -- 172.21.15.138:0/4125624318 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc740018530 con 0x55adadba7840 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55adadd54460 con 0x55adadba7840 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc6267fc640 1 -- 172.21.15.138:0/4125624318 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740015510 con 0x55adadba7840 2024-02-16T10:30:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc6267fc640 1 -- 172.21.15.138:0/4125624318 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7400481a0 con 0x55adadba7840 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.372+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adadd54890 con 0x55adadba7840 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc6267fc640 1 -- 172.21.15.138:0/4125624318 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc740032020 con 0x55adadba7840 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc6267fc640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc61c0342b0 0x7fc61c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc6267fc640 1 -- 172.21.15.138:0/4125624318 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc740037c90 con 0x55adadba7840 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc750dba640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc61c0342b0 0x7fc61c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadd5f3f0 0x55adadd61890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd61fe0 con 0x55adadd5f3f0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadd5f3f0 0x55adadd61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc750dba640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc61c0342b0 0x7fc61c036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc74801dfd0 tx=0x7fc748034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadd5f3f0 0x55adadd61890 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 realm 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd623d0 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd62c20 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd62f80 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd628c0 con 0x55adadd5f3f0 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 20 searching for the correct realm 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55adadd651d0 0x55adadd67620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7515bb640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55adadd651d0 0x55adadd67620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7515bb640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55adadd651d0 0x55adadd67620 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7515bb640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc740022070 0x7fc74001d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc740022070 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc750dba640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc740022070 0x7fc74001d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.376+0000 7fc750dba640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc740022070 0x7fc74001d580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc750dba640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc748055040 0x7fc748049910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc748055040 0x7fc748049910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc748055040 0x7fc748049910 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc740022070 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.380+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc740022070 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.384+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc740022070 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc740022070 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd651d0 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x7fc748055040 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd67cf0 con 0x55adadd5f3f0 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc7440da080 con 0x7fc740022070 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.388+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd63de0 con 0x55adadd5f3f0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd63a30 con 0x55adadd5f3f0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd64680 con 0x7fc740022070 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 zone default found 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 4 Realm: () 2024-02-16T10:30:48.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 zonegroup default 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd68180 con 0x7fc748055040 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6a000 con 0x55adadd651d0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6a360 con 0x55adadd651d0 2024-02-16T10:30:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 started sync module instance, tier type = 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd69580 con 0x7fc740022070 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204434223328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6a360 con 0x7fc740022070 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.392+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6ad30 con 0x55adadd5f3f0 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204434223328] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204434229296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6b0e0 con 0x55adadd5f3f0 2024-02-16T10:30:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6ba50 con 0x55adadd651d0 2024-02-16T10:30:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204434232752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6b9d0 con 0x55adadd651d0 2024-02-16T10:30:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6c940 con 0x7fc740022070 2024-02-16T10:30:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.396+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204434229296] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204434236480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6ccf0 con 0x7fc740022070 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6d660 con 0x55adadd5f3f0 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204434232752] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204434236480] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204434234880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd69aa0 con 0x55adadd5f3f0 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6deb0 con 0x7fc748055040 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204434234880] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204434239936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6de30 con 0x7fc748055040 2024-02-16T10:30:48.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.400+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6e7a0 con 0x7fc748055040 2024-02-16T10:30:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.404+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.404+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204434244352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6ec00 con 0x7fc748055040 2024-02-16T10:30:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.404+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6f6b0 con 0x7fc748055040 2024-02-16T10:30:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.404+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204434239936] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.404+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204434244352] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204434248112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6d940 con 0x7fc748055040 2024-02-16T10:30:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=0 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=1 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=2 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=3 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=4 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=5 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=6 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204434248112] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 add_watcher() i=7 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd726a0 con 0x55adadd5f3f0 2024-02-16T10:30:48.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204434245408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6fb80 con 0x55adadd5f3f0 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204434245408] v31'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc606fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 5 note: GC not initialized 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc605fe3640 20 reqs_thread_entry: start 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 Filter name: none 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc5777fe640 20 reqs_thread_entry: start 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.408+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd93f60 con 0x55adadd5f3f0 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:30:48.420 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc606fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204434245408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd74b90 con 0x55adadd5f3f0 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94204434245408] v31'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204434223328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6e720 con 0x7fc740022070 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94204434223328] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 20 remove_watcher() i=0 2024-02-16T10:30:48.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 2 removed watcher, disabling cache 2024-02-16T10:30:48.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.412+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204434229296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd690e0 con 0x55adadd5f3f0 2024-02-16T10:30:48.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94204434229296] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 20 remove_watcher() i=1 2024-02-16T10:30:48.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204434232752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd690e0 con 0x55adadd651d0 2024-02-16T10:30:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc7515bb640 1 -- 172.21.15.138:0/4125624318 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94204434232752] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc740012070 con 0x55adadd651d0 2024-02-16T10:30:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 20 remove_watcher() i=2 2024-02-16T10:30:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204434236480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6b5b0 con 0x7fc740022070 2024-02-16T10:30:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc750dba640 1 -- 172.21.15.138:0/4125624318 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94204434236480] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc748024020 con 0x7fc740022070 2024-02-16T10:30:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 20 remove_watcher() i=3 2024-02-16T10:30:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.416+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204434234880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd690e0 con 0x55adadd5f3f0 2024-02-16T10:30:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94204434234880] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x55adadd5f3f0 2024-02-16T10:30:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc75329f980 20 remove_watcher() i=4 2024-02-16T10:30:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204434239936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6c440 con 0x7fc748055040 2024-02-16T10:30:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94204434239936] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc75329f980 20 remove_watcher() i=5 2024-02-16T10:30:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.420+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204434244352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6c440 con 0x7fc748055040 2024-02-16T10:30:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94204434244352] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 20 remove_watcher() i=6 2024-02-16T10:30:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204434248112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55adadd6c440 con 0x7fc748055040 2024-02-16T10:30:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94204434248112] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc7440ab810 con 0x7fc748055040 2024-02-16T10:30:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 20 remove_watcher() i=7 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc748055040 msgr2=0x7fc748049910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc748055040 0x7fc748049910 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadd5f3f0 msgr2=0x55adadd61890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadd5f3f0 0x55adadd61890 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc740022070 msgr2=0x7fc74001d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc740022070 0x7fc74001d580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55adadd651d0 msgr2=0x55adadd67620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55adadd651d0 0x55adadd67620 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc61c0342b0 msgr2=0x7fc61c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc61c0342b0 0x7fc61c036770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc74801dfd0 tx=0x7fc748034000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc7505b9640 1 -- 172.21.15.138:0/4125624318 reap_dead start 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 msgr2=0x55adadd53d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc740019fd0 tx=0x7fc740049800 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 shutdown_connections 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/4125624318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadba7840 0x55adadd53d20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 >> 172.21.15.138:0/4125624318 conn(0x55adadd45990 msgr2=0x55adadd46870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 shutdown_connections 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/4125624318 wait complete. 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 msgr2=0x7fc628036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 0x7fc628036770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55adadd2b100 tx=0x7fc748001e70 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 msgr2=0x55adadd3e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.424+0000 7fc75329f980 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55adadd24a00 tx=0x7fc74000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 shutdown_connections 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6280342b0 0x7fc628036770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/3367897198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadd3de10 0x55adadd3e230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 >> 172.21.15.138:0/3367897198 conn(0x55adadd32c20 msgr2=0x55adadd33730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 shutdown_connections 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/3367897198 wait complete. 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 msgr2=0x55adadd2a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 0x55adadd2a2c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 msgr2=0x55adadd2f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 0x55adadd2f840 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 msgr2=0x7fc638036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 0x7fc638036770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ad000 tx=0x7fc7440a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 msgr2=0x55adadd235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55adadd1d4b0 tx=0x7fc748000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 shutdown_connections 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55adadd2bfe0 0x55adadd2f840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55adadc36ae0 0x55adadd2a2c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc6380342b0 0x7fc638036770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 --2- 172.21.15.138:0/95796251 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55adadc32620 0x55adadd235d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 >> 172.21.15.138:0/95796251 conn(0x55adadc2def0 msgr2=0x55adadd16cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 shutdown_connections 2024-02-16T10:30:48.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.428+0000 7fc75329f980 1 -- 172.21.15.138:0/95796251 wait complete. 2024-02-16T10:30:48.443 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T10:30:48.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-02-16T10:30:48.444 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-02-16T10:30:48.517 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.517 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.508+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.508+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.508+0000 7f3d2d555980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5595a58319a0 0x5595a5833d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.508+0000 7f3d2d555980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5595a577aaf0 con 0x5595a582d440 2024-02-16T10:30:48.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.508+0000 7f3d2d555980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5595a5741d30 con 0x5595a58319a0 2024-02-16T10:30:48.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2a86f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5595a58319a0 0x5595a5833d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2b070640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5595a582d440 0x5595a582d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52086/0 (socket says 172.21.15.138:52086) 2024-02-16T10:30:48.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2b070640 1 -- 172.21.15.138:0/263002875 learned_addr learned my addr 172.21.15.138:0/263002875 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:48.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2a86f640 1 -- 172.21.15.138:0/263002875 >> v1:172.21.15.107:6789/0 conn(0x5595a582d440 legacy=0x5595a582d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2a86f640 1 -- 172.21.15.138:0/263002875 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a58352e0 con 0x5595a58319a0 2024-02-16T10:30:48.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.512+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/263002875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a58319a0 0x5595a5833d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00a480 tx=0x7f3d1c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a923c6f433291937 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2a06e640 1 -- 172.21.15.138:0/263002875 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c0ab540 con 0x5595a58319a0 2024-02-16T10:30:48.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2a06e640 1 -- 172.21.15.138:0/263002875 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c0ab6a0 con 0x5595a58319a0 2024-02-16T10:30:48.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2a06e640 1 -- 172.21.15.138:0/263002875 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1c0ab960 con 0x5595a58319a0 2024-02-16T10:30:48.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 -- 172.21.15.138:0/263002875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a58319a0 msgr2=0x5595a5833d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 --2- 172.21.15.138:0/263002875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a58319a0 0x5595a5833d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00a480 tx=0x7f3d1c01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:48.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 -- 172.21.15.138:0/263002875 shutdown_connections 2024-02-16T10:30:48.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 --2- 172.21.15.138:0/263002875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a58319a0 0x5595a5833d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 -- 172.21.15.138:0/263002875 >> 172.21.15.138:0/263002875 conn(0x5595a5828d10 msgr2=0x5595a582b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 -- 172.21.15.138:0/263002875 shutdown_connections 2024-02-16T10:30:48.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.516+0000 7f3d2d555980 1 -- 172.21.15.138:0/263002875 wait complete. 2024-02-16T10:30:48.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2d555980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2d555980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a573efc0 con 0x5595a582d440 2024-02-16T10:30:48.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2b070640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2b070640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45390/0 (socket says 172.21.15.138:45390) 2024-02-16T10:30:48.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2b070640 1 -- 172.21.15.138:0/1819423974 learned_addr learned my addr 172.21.15.138:0/1819423974 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2b070640 1 -- 172.21.15.138:0/1819423974 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c005d30 con 0x5595a582d440 2024-02-16T10:30:48.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3d2b070640 1 --2- 172.21.15.138:0/1819423974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001c90 tx=0x7f3d2000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5591637824f40 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3c1960a640 1 -- 172.21.15.138:0/1819423974 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2000e690 con 0x5595a582d440 2024-02-16T10:30:48.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3c1960a640 1 -- 172.21.15.138:0/1819423974 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000e7f0 con 0x5595a582d440 2024-02-16T10:30:48.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.528+0000 7f3c1960a640 1 -- 172.21.15.138:0/1819423974 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2000eaf0 con 0x5595a582d440 2024-02-16T10:30:48.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/1819423974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 msgr2=0x5595a59166b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 --2- 172.21.15.138:0/1819423974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001c90 tx=0x7f3d2000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/1819423974 shutdown_connections 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 --2- 172.21.15.138:0/1819423974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a59166b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/1819423974 >> 172.21.15.138:0/1819423974 conn(0x5595a5828d10 msgr2=0x5595a59121a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/1819423974 shutdown_connections 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/1819423974 wait complete. 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a573a7a0 con 0x5595a582d440 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2b070640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2b070640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45392/0 (socket says 172.21.15.138:45392) 2024-02-16T10:30:48.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2b070640 1 -- 172.21.15.138:0/3280462824 learned_addr learned my addr 172.21.15.138:0/3280462824 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2b070640 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a577aaf0 con 0x5595a582d440 2024-02-16T10:30:48.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2b070640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001ee0 tx=0x7f3d20000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3c17e07640 1 -- 172.21.15.138:0/3280462824 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2001f070 con 0x5595a582d440 2024-02-16T10:30:48.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3c17e07640 1 -- 172.21.15.138:0/3280462824 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2001a4d0 con 0x5595a582d440 2024-02-16T10:30:48.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595a591dc20 con 0x5595a582d440 2024-02-16T10:30:48.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3c17e07640 1 -- 172.21.15.138:0/3280462824 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2001a770 con 0x5595a582d440 2024-02-16T10:30:48.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.532+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595a591e0d0 con 0x5595a582d440 2024-02-16T10:30:48.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3c17e07640 1 -- 172.21.15.138:0/3280462824 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d2000a040 con 0x5595a582d440 2024-02-16T10:30:48.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3c17e07640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 0x7f3c10036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3c17e07640 1 -- 172.21.15.138:0/3280462824 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d20049720 con 0x5595a582d440 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 0x7f3c10036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 0x5595a5924710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5924c50 con 0x5595a5922320 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 0x5595a5924710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 0x7f3c10036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0ad000 tx=0x7f3d1c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 0x5595a5924710 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 -- 172.21.15.138:0/3280462824 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a5922320 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5924ff0 con 0x5595a5922320 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 -- 172.21.15.138:0/3280462824 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a5922320 2024-02-16T10:30:48.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59268a0 con 0x5595a5922320 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 -- 172.21.15.138:0/3280462824 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a5922320 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5925aa0 con 0x5595a5922320 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 -- 172.21.15.138:0/3280462824 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a5922320 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 0x5595a5929c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a592a270 con 0x5595a59263c0 2024-02-16T10:30:48.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b070640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 0x5595a5929c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b070640 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 0x5595a5929c20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b070640 1 -- 172.21.15.138:0/3280462824 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3d20014070 con 0x5595a59263c0 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2d555980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a56d2f20 con 0x5595a5938210 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45406/0 (socket says 172.21.15.138:45406) 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.536+0000 7f3d2b871640 1 -- 172.21.15.138:0/3743641132 learned_addr learned my addr 172.21.15.138:0/3743641132 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 -- 172.21.15.138:0/3743641132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a5938b70 con 0x5595a5938210 2024-02-16T10:30:48.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5595a591ea70 tx=0x7f3d24018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 -- 172.21.15.138:0/3743641132 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2401d070 con 0x5595a5938210 2024-02-16T10:30:48.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595a5938dc0 con 0x5595a5938210 2024-02-16T10:30:48.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 -- 172.21.15.138:0/3743641132 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24014450 con 0x5595a5938210 2024-02-16T10:30:48.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 -- 172.21.15.138:0/3743641132 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d240146f0 con 0x5595a5938210 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595a5939910 con 0x5595a5938210 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 -- 172.21.15.138:0/3743641132 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d24020020 con 0x5595a5938210 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3c15602640 1 -- 172.21.15.138:0/3743641132 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d2404b0d0 con 0x5595a5938210 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b070640 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b070640 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 0x7f3c04036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5595a59254e0 tx=0x7f3d20016ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2d555980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a56c6790 con 0x5595a5945190 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45422/0 (socket says 172.21.15.138:45422) 2024-02-16T10:30:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 -- 172.21.15.138:0/61923283 learned_addr learned my addr 172.21.15.138:0/61923283 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.540+0000 7f3d2b871640 1 -- 172.21.15.138:0/61923283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a5945b80 con 0x5595a5945190 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 --2- 172.21.15.138:0/61923283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d240494c0 tx=0x7f3d240480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a647e024dbbfed server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0effd640 1 -- 172.21.15.138:0/61923283 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2403b050 con 0x5595a5945190 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0effd640 1 -- 172.21.15.138:0/61923283 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2403b1b0 con 0x5595a5945190 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0effd640 1 -- 172.21.15.138:0/61923283 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d24012690 con 0x5595a5945190 2024-02-16T10:30:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/61923283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 msgr2=0x5595a59455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 --2- 172.21.15.138:0/61923283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d240494c0 tx=0x7f3d240480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/61923283 shutdown_connections 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 --2- 172.21.15.138:0/61923283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a59455b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/61923283 >> 172.21.15.138:0/61923283 conn(0x5595a593fd10 msgr2=0x5595a5940bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/61923283 shutdown_connections 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/61923283 wait complete. 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 Processor -- start 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- start start 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595a594c420 con 0x5595a5945190 2024-02-16T10:30:48.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45424/0 (socket says 172.21.15.138:45424) 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 learned_addr learned my addr 172.21.15.138:0/815442572 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595a5939910 con 0x5595a5945190 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2b871640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d24048120 tx=0x7f3d24049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0d7fa640 1 -- 172.21.15.138:0/815442572 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2403b050 con 0x5595a5945190 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0d7fa640 1 -- 172.21.15.138:0/815442572 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2402b720 con 0x5595a5945190 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595a594c620 con 0x5595a5945190 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3c0d7fa640 1 -- 172.21.15.138:0/815442572 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d2402be60 con 0x5595a5945190 2024-02-16T10:30:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.544+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595a594ca50 con 0x5595a5945190 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3c0d7fa640 1 -- 172.21.15.138:0/815442572 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d24049600 con 0x5595a5945190 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3c0d7fa640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf4034210 0x7f3bf40366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3c0d7fa640 1 -- 172.21.15.138:0/815442572 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d2404cc90 con 0x5595a5945190 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf4034210 0x7f3bf40366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a59575e0 0x5595a5959a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595a1d0 con 0x5595a59575e0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a59575e0 0x5595a5959a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf4034210 0x7f3bf40366d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5595a592a630 tx=0x7f3d20048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a59575e0 0x5595a5959a80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 realm 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595a5c0 con 0x5595a59575e0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595ae10 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595b170 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595b970 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 20 searching for the correct realm 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5595a595d880 0x5595a595fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b871640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5595a595d880 0x5595a595fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b871640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5595a595d880 0x5595a595fd10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b871640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d24014850 0x7f3d2403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d24014850 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d24014850 0x7f3d2403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d24014850 0x7f3d2403b620 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d20039070 0x7f3d20049a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.548+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d20039070 0x7f3d20049a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d20039070 0x7f3d20049a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d24014850 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.552+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d24014850 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d24014850 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.556+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d24014850 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a595d880 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5960390 con 0x5595a59575e0 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3d1c0da080 con 0x7f3d24014850 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595c2d0 con 0x5595a59575e0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595cb20 con 0x5595a59575e0 2024-02-16T10:30:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.560+0000 7f3d2d555980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a595cb20 con 0x7f3d24014850 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 zone default found 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 4 Realm: () 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 zonegroup default 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59607d0 con 0x7f3d20039070 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962590 con 0x5595a595d880 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962980 con 0x5595a595d880 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 started sync module instance, tier type = 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5961a20 con 0x7f3d24014850 2024-02-16T10:30:48.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101216564608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962220 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59633b0 con 0x5595a59575e0 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.564+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101216564608] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101216571152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5963330 con 0x5595a59575e0 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59640e0 con 0x5595a595d880 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101216571152] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101216573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5964020 con 0x5595a595d880 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.568+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5964aa0 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101216577024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59652f0 con 0x7f3d24014850 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5965ca0 con 0x5595a59575e0 2024-02-16T10:30:48.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101216573280] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101216577024] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101216579152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59657c0 con 0x5595a59575e0 2024-02-16T10:30:48.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a59664f0 con 0x7f3d20039070 2024-02-16T10:30:48.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.572+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101216579152] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101216574336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5966480 con 0x7f3d20039070 2024-02-16T10:30:48.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5966d80 con 0x7f3d20039070 2024-02-16T10:30:48.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101216585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5966c70 con 0x7f3d20039070 2024-02-16T10:30:48.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5967be0 con 0x7f3d20039070 2024-02-16T10:30:48.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.576+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101216574336] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101216585808] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101216588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5967740 con 0x7f3d20039070 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=0 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=1 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=2 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=3 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=4 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=5 2024-02-16T10:30:48.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=6 2024-02-16T10:30:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101216588080] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 add_watcher() i=7 2024-02-16T10:30:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a596ac10 con 0x5595a59575e0 2024-02-16T10:30:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101216589632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5968070 con 0x5595a59575e0 2024-02-16T10:30:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101216589632] v31'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.580+0000 7f3d2d555980 5 note: GC not initialized 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3be0fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 Filter name: none 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3b5a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a598c9d0 con 0x5595a59575e0 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a598d210 con 0x7f3d24014850 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-02-16T10:30:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~624 in=624b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5992a80 con 0x5595a59575e0 2024-02-16T10:30:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~624] v31'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94101216765184 in=812b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5991610 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94101216579152 notify 133143986183 ret 0) v3 ==== 842+0+0 (crc 0 0 0) 0x5595a58352e0 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94101216579152 notifier 4388 bl.length()=800 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 notify.4 [notify cookie 94101216765184 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3c0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3c0effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3c0effd640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3bf0003ea0 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== watch-notify(notify_complete (2) cookie 94101216765184 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3d1c0db5c0 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.584+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5992500 con 0x7f3d24014850 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94101216765184 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5991170 con 0x7f3d24014850 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify (1) cookie 94101216564608 notify 133143986179 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x5595a591e0d0 con 0x7f3d24014850 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94101216564608 notifier 4388 bl.length()=166 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3c0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3c0effd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(68 notify.0 [notify cookie 94101216765184 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3c0effd640 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3bf0003ea0 con 0x7f3d24014850 2024-02-16T10:30:48.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== watch-notify(notify_complete (2) cookie 94101216765184 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5595a591dc20 con 0x7f3d24014850 2024-02-16T10:30:48.598 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101216589632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5991540 con 0x5595a59575e0 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94101216589632] v31'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.588+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101216564608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5991540 con 0x7f3d24014850 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94101216564608] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2d555980 20 remove_watcher() i=0 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2d555980 2 removed watcher, disabling cache 2024-02-16T10:30:48.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101216571152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5961580 con 0x5595a59575e0 2024-02-16T10:30:48.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94101216571152] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2d555980 20 remove_watcher() i=1 2024-02-16T10:30:48.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.592+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101216573280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962f10 con 0x5595a595d880 2024-02-16T10:30:48.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2b871640 1 -- 172.21.15.138:0/815442572 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94101216573280] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2400a4d0 con 0x5595a595d880 2024-02-16T10:30:48.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 20 remove_watcher() i=2 2024-02-16T10:30:48.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101216577024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962f10 con 0x7f3d24014850 2024-02-16T10:30:48.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2b070640 1 -- 172.21.15.138:0/815442572 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94101216577024] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d2004f040 con 0x7f3d24014850 2024-02-16T10:30:48.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 20 remove_watcher() i=3 2024-02-16T10:30:48.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101216579152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5964600 con 0x5595a59575e0 2024-02-16T10:30:48.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94101216579152] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x5595a59575e0 2024-02-16T10:30:48.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 20 remove_watcher() i=4 2024-02-16T10:30:48.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.596+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101216574336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962f10 con 0x7f3d20039070 2024-02-16T10:30:48.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94101216574336] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2d555980 20 remove_watcher() i=5 2024-02-16T10:30:48.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101216585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5962f10 con 0x7f3d20039070 2024-02-16T10:30:48.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94101216585808] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2d555980 20 remove_watcher() i=6 2024-02-16T10:30:48.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.600+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101216588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5595a5966850 con 0x7f3d20039070 2024-02-16T10:30:48.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94101216588080] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1c0ab810 con 0x7f3d20039070 2024-02-16T10:30:48.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 20 remove_watcher() i=7 2024-02-16T10:30:48.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d20039070 msgr2=0x7f3d20049a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d20039070 0x7f3d20049a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a59575e0 msgr2=0x5595a5959a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a59575e0 0x5595a5959a80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d24014850 msgr2=0x7f3d2403b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d24014850 0x7f3d2403b620 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5595a595d880 msgr2=0x5595a595fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5595a595d880 0x5595a595fd10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf4034210 msgr2=0x7f3bf40366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf4034210 0x7f3bf40366d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5595a592a630 tx=0x7f3d20048000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2a86f640 1 -- 172.21.15.138:0/815442572 reap_dead start 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 msgr2=0x5595a594bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d24048120 tx=0x7f3d24049450 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 shutdown_connections 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/815442572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5945190 0x5595a594bee0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 >> 172.21.15.138:0/815442572 conn(0x5595a593fd10 msgr2=0x5595a5940bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 shutdown_connections 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/815442572 wait complete. 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 msgr2=0x7f3c04036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 0x7f3c04036770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5595a59254e0 tx=0x7f3d20016ca0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 msgr2=0x5595a5938630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5595a591ea70 tx=0x7f3d24018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 shutdown_connections 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c040342b0 0x7f3c04036770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3743641132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a5938210 0x5595a5938630 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 >> 172.21.15.138:0/3743641132 conn(0x5595a592d020 msgr2=0x5595a592db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 shutdown_connections 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3743641132 wait complete. 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 msgr2=0x5595a5924710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 0x5595a5924710 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 msgr2=0x5595a5929c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 0x5595a5929c20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 msgr2=0x7f3c10036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 0x7f3c10036770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0ad000 tx=0x7f3d1c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 msgr2=0x5595a591d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d20001ee0 tx=0x7f3d20000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 shutdown_connections 2024-02-16T10:30:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5595a59263c0 0x5595a5929c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5595a5922320 0x5595a5924710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c100342b0 0x7f3c10036770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 --2- 172.21.15.138:0/3280462824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5595a582d440 0x5595a591d6e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 >> 172.21.15.138:0/3280462824 conn(0x5595a5828d10 msgr2=0x5595a5910cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 shutdown_connections 2024-02-16T10:30:48.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.604+0000 7f3d2d555980 1 -- 172.21.15.138:0/3280462824 wait complete. 2024-02-16T10:30:48.621 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:30:48.622 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:30:48.700 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.700 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd357117980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3e22194a0 0x55e3e22ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd357117980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e3e21f0b50 con 0x55e3e221a7e0 2024-02-16T10:30:48.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd357117980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e3e21b7d30 con 0x55e3e22194a0 2024-02-16T10:30:48.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd354431640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3e22194a0 0x55e3e22ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd354431640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3e22194a0 0x55e3e22ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45430/0 (socket says 172.21.15.138:45430) 2024-02-16T10:30:48.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.692+0000 7fd354431640 1 -- 172.21.15.138:0/3636275175 learned_addr learned my addr 172.21.15.138:0/3636275175 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd354431640 1 -- 172.21.15.138:0/3636275175 >> v1:172.21.15.107:6789/0 conn(0x55e3e221a7e0 legacy=0x55e3e2218d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd354431640 1 -- 172.21.15.138:0/3636275175 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e22198b0 con 0x55e3e22194a0 2024-02-16T10:30:48.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd354431640 1 --2- 172.21.15.138:0/3636275175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e22ad5f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd34400a5c0 tx=0x7fd34401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f38ed8308171d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd353c30640 1 -- 172.21.15.138:0/3636275175 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3440ac460 con 0x55e3e22194a0 2024-02-16T10:30:48.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd353c30640 1 -- 172.21.15.138:0/3636275175 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3440ac5c0 con 0x55e3e22194a0 2024-02-16T10:30:48.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd353c30640 1 -- 172.21.15.138:0/3636275175 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3440ac880 con 0x55e3e22194a0 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 -- 172.21.15.138:0/3636275175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 msgr2=0x55e3e22ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 --2- 172.21.15.138:0/3636275175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e22ad5f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd34400a5c0 tx=0x7fd34401b340 comp rx=0 tx=0).stop 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 -- 172.21.15.138:0/3636275175 shutdown_connections 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 --2- 172.21.15.138:0/3636275175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e22ad5f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 -- 172.21.15.138:0/3636275175 >> 172.21.15.138:0/3636275175 conn(0x55e3e229feb0 msgr2=0x55e3e22a22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 -- 172.21.15.138:0/3636275175 shutdown_connections 2024-02-16T10:30:48.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.696+0000 7fd357117980 1 -- 172.21.15.138:0/3636275175 wait complete. 2024-02-16T10:30:48.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.708+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.708+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e21b4fc0 con 0x55e3e22194a0 2024-02-16T10:30:48.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45438/0 (socket says 172.21.15.138:45438) 2024-02-16T10:30:48.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 -- 172.21.15.138:0/2519544948 learned_addr learned my addr 172.21.15.138:0/2519544948 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 -- 172.21.15.138:0/2519544948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd344005df0 con 0x55e3e22194a0 2024-02-16T10:30:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 --2- 172.21.15.138:0/2519544948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001d60 tx=0x7fd33c00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3c0cbb43e27f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd242e0d640 1 -- 172.21.15.138:0/2519544948 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd33c014070 con 0x55e3e22194a0 2024-02-16T10:30:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd242e0d640 1 -- 172.21.15.138:0/2519544948 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00f540 con 0x55e3e22194a0 2024-02-16T10:30:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd242e0d640 1 -- 172.21.15.138:0/2519544948 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd33c00f820 con 0x55e3e22194a0 2024-02-16T10:30:48.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- 172.21.15.138:0/2519544948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 msgr2=0x55e3e2390be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 --2- 172.21.15.138:0/2519544948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd33c001d60 tx=0x7fd33c00b5c0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- 172.21.15.138:0/2519544948 shutdown_connections 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 --2- 172.21.15.138:0/2519544948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2390be0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- 172.21.15.138:0/2519544948 >> 172.21.15.138:0/2519544948 conn(0x55e3e229feb0 msgr2=0x55e3e238c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- 172.21.15.138:0/2519544948 shutdown_connections 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- 172.21.15.138:0/2519544948 wait complete. 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd357117980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e21b07a0 con 0x55e3e22194a0 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45446/0 (socket says 172.21.15.138:45446) 2024-02-16T10:30:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 -- 172.21.15.138:0/1518695278 learned_addr learned my addr 172.21.15.138:0/1518695278 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.712+0000 7fd354c32640 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e21f0b50 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd354c32640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00f510 tx=0x7fd33c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 -- 172.21.15.138:0/1518695278 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd33c014050 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3e23980b0 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 -- 172.21.15.138:0/1518695278 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c001300 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 -- 172.21.15.138:0/1518695278 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd33c01bae0 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3e23985c0 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 -- 172.21.15.138:0/1518695278 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd33c022020 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 0x7fd23c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd24160a640 1 -- 172.21.15.138:0/1518695278 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd33c0491c0 con 0x55e3e22194a0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd354431640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 0x7fd23c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 0x55e3e239e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e239eda0 con 0x55e3e221a7e0 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 0x55e3e239e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd354431640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 0x7fd23c036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ae000 tx=0x7fd3440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 0x55e3e239e860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 -- 172.21.15.138:0/1518695278 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e221a7e0 2024-02-16T10:30:48.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e239bf60 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 -- 172.21.15.138:0/1518695278 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23a0af0 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 -- 172.21.15.138:0/1518695278 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e239fcf0 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd355433640 1 -- 172.21.15.138:0/1518695278 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e221a7e0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 0x55e3e23a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.716+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23a4430 con 0x55e3e23a0610 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd354c32640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 0x55e3e23a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd354c32640 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 0x55e3e23a3e70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd354c32640 1 -- 172.21.15.138:0/1518695278 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd33c016070 con 0x55e3e23a0610 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e2148f20 con 0x55e3e23b2370 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45448/0 (socket says 172.21.15.138:45448) 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd355433640 1 -- 172.21.15.138:0/629668700 learned_addr learned my addr 172.21.15.138:0/629668700 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd355433640 1 -- 172.21.15.138:0/629668700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e23b2cd0 con 0x55e3e23b2370 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd355433640 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55e3e2398770 tx=0x7fd34c018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd23a7fc640 1 -- 172.21.15.138:0/629668700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c01d070 con 0x55e3e23b2370 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd23a7fc640 1 -- 172.21.15.138:0/629668700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c014450 con 0x55e3e23b2370 2024-02-16T10:30:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3e23b2f20 con 0x55e3e23b2370 2024-02-16T10:30:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd23a7fc640 1 -- 172.21.15.138:0/629668700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c0146f0 con 0x55e3e23b2370 2024-02-16T10:30:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3e23b3a70 con 0x55e3e23b2370 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd23a7fc640 1 -- 172.21.15.138:0/629668700 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd34c020020 con 0x55e3e23b2370 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.720+0000 7fd23a7fc640 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 0x7fd22c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd23a7fc640 1 -- 172.21.15.138:0/629668700 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd34c04b110 con 0x55e3e23b2370 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd354c32640 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 0x7fd22c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd354c32640 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 0x7fd22c036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55e3e239f790 tx=0x7fd33c0490d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e213c790 con 0x55e3e23bf310 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45464/0 (socket says 172.21.15.138:45464) 2024-02-16T10:30:48.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 -- 172.21.15.138:0/257860762 learned_addr learned my addr 172.21.15.138:0/257860762 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 -- 172.21.15.138:0/257860762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e23bfd00 con 0x55e3e23bf310 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 --2- 172.21.15.138:0/257860762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd34c049500 tx=0x7fd34c0480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb73bf436a58a813 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd22bfff640 1 -- 172.21.15.138:0/257860762 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c02b350 con 0x55e3e23bf310 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd22bfff640 1 -- 172.21.15.138:0/257860762 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c02b4b0 con 0x55e3e23bf310 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd22bfff640 1 -- 172.21.15.138:0/257860762 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c0126d0 con 0x55e3e23bf310 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- 172.21.15.138:0/257860762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 msgr2=0x55e3e23bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 --2- 172.21.15.138:0/257860762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd34c049500 tx=0x7fd34c0480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- 172.21.15.138:0/257860762 shutdown_connections 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 --2- 172.21.15.138:0/257860762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23bf730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- 172.21.15.138:0/257860762 >> 172.21.15.138:0/257860762 conn(0x55e3e23b9e90 msgr2=0x55e3e23bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- 172.21.15.138:0/257860762 shutdown_connections 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- 172.21.15.138:0/257860762 wait complete. 2024-02-16T10:30:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 Processor -- start 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- start start 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd357117980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3e23c6590 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45472/0 (socket says 172.21.15.138:45472) 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 learned_addr learned my addr 172.21.15.138:0/27555925 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.724+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3e23b3a70 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd355433640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd34c012f90 tx=0x7fd34c049490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 -- 172.21.15.138:0/27555925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c034070 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 -- 172.21.15.138:0/27555925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c016440 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3e23c6790 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 -- 172.21.15.138:0/27555925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd34c02b350 con 0x55e3e23bf310 2024-02-16T10:30:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3e23c6bc0 con 0x55e3e23bf310 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 -- 172.21.15.138:0/27555925 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd34c013c20 con 0x55e3e23bf310 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd220034280 0x7fd220036740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd22a7fc640 1 -- 172.21.15.138:0/27555925 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd34c02ece0 con 0x55e3e23bf310 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354c32640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd220034280 0x7fd220036740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e23d1730 0x55e3e23d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d4320 con 0x55e3e23d1730 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e23d1730 0x55e3e23d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354c32640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd220034280 0x7fd220036740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e3e23a47f0 tx=0x7fd33c031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e23d1730 0x55e3e23d3bd0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 realm 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d4710 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d4f60 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d52c0 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d4c00 con 0x55e3e23d1730 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 20 searching for the correct realm 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3e23d7510 0x55e3e23d9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23da030 con 0x55e3e23d7510 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd355433640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3e23d7510 0x55e3e23d9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.728+0000 7fd355433640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3e23d7510 0x55e3e23d9960 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd355433640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd34c038070 0x7fd34c011810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354c32640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd34c038070 0x7fd34c011810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354c32640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd34c038070 0x7fd34c011810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354c32640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd33c0476f0 0x7fd33c0185c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd33c0476f0 0x7fd33c0185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd33c0476f0 0x7fd33c0185c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.732+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.736+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.740+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d7510 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd33c0476f0 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x55e3e23d1730 2024-02-16T10:30:48.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd34c053040 con 0x7fd34c038070 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d5ff0 con 0x55e3e23d1730 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d63a0 con 0x55e3e23d1730 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d63a0 con 0x7fd34c038070 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 zone default found 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 4 Realm: () 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 zonegroup default 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23d6c70 con 0x7fd33c0476f0 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dbea0 con 0x55e3e23d7510 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dc230 con 0x55e3e23d7510 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 started sync module instance, tier type = 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.744+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23db330 con 0x7fd34c038070 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94437241630352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dbb30 con 0x7fd34c038070 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dcd10 con 0x55e3e23d1730 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94437241630352] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94437241636848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dd0c0 con 0x55e3e23d1730 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.748+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dda70 con 0x55e3e23d7510 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94437241636848] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94437241632400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dda30 con 0x55e3e23d7510 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23de430 con 0x7fd34c038070 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94437241642896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dec80 con 0x7fd34c038070 2024-02-16T10:30:48.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23df630 con 0x55e3e23d1730 2024-02-16T10:30:48.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94437241632400] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94437241642896] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94437241640336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23de7e0 con 0x55e3e23d1730 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.752+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dfeb0 con 0x7fd33c0476f0 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.756+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94437241640336] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.756+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.756+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94437241647440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23de7e0 con 0x7fd33c0476f0 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.756+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23e03f0 con 0x7fd33c0476f0 2024-02-16T10:30:48.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.756+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94437241647440] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94437241650896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23e03b0 con 0x7fd33c0476f0 2024-02-16T10:30:48.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23e0dd0 con 0x7fd33c0476f0 2024-02-16T10:30:48.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94437241653424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23e1230 con 0x7fd33c0476f0 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=0 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=1 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=2 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=3 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=4 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=5 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94437241650896] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.760+0000 7fd357117980 20 add_watcher() i=6 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94437241653424] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 add_watcher() i=7 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23df890 con 0x55e3e23d1730 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94437241654672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23df890 con 0x55e3e23d1730 2024-02-16T10:30:48.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94437241654672] v31'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 5 note: GC not initialized 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd209fe3640 20 reqs_thread_entry: start 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 Filter name: none 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd17b7fe640 20 reqs_thread_entry: start 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e2405b60 con 0x55e3e23d1730 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T10:30:48.773 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.764+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94437241654672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e2404cf0 con 0x55e3e23d1730 2024-02-16T10:30:48.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94437241654672] v31'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94437241630352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23e0d90 con 0x7fd34c038070 2024-02-16T10:30:48.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94437241630352] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 20 remove_watcher() i=0 2024-02-16T10:30:48.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 2 removed watcher, disabling cache 2024-02-16T10:30:48.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94437241636848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dae90 con 0x55e3e23d1730 2024-02-16T10:30:48.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94437241636848] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 20 remove_watcher() i=1 2024-02-16T10:30:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.768+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94437241632400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dae90 con 0x55e3e23d7510 2024-02-16T10:30:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd355433640 1 -- 172.21.15.138:0/27555925 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94437241632400] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd34c00a4d0 con 0x55e3e23d7510 2024-02-16T10:30:48.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd357117980 20 remove_watcher() i=2 2024-02-16T10:30:48.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94437241642896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23db690 con 0x7fd34c038070 2024-02-16T10:30:48.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd354c32640 1 -- 172.21.15.138:0/27555925 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94437241642896] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd33c016070 con 0x7fd34c038070 2024-02-16T10:30:48.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd357117980 20 remove_watcher() i=3 2024-02-16T10:30:48.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94437241640336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23dae90 con 0x55e3e23d1730 2024-02-16T10:30:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.772+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94437241640336] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x55e3e23d1730 2024-02-16T10:30:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.776+0000 7fd357117980 20 remove_watcher() i=4 2024-02-16T10:30:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.776+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94437241647440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23ddf90 con 0x7fd33c0476f0 2024-02-16T10:30:48.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.776+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94437241647440] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.776+0000 7fd357117980 20 remove_watcher() i=5 2024-02-16T10:30:48.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.776+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94437241650896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23db690 con 0x7fd33c0476f0 2024-02-16T10:30:48.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94437241650896] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 20 remove_watcher() i=6 2024-02-16T10:30:48.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94437241653424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3e23db690 con 0x7fd33c0476f0 2024-02-16T10:30:48.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94437241653424] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3440a9070 con 0x7fd33c0476f0 2024-02-16T10:30:48.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 20 remove_watcher() i=7 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd33c0476f0 msgr2=0x7fd33c0185c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd33c0476f0 0x7fd33c0185c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e23d1730 msgr2=0x55e3e23d3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e23d1730 0x55e3e23d3bd0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd34c038070 msgr2=0x7fd34c011810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd34c038070 0x7fd34c011810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3e23d7510 msgr2=0x55e3e23d9960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3e23d7510 0x55e3e23d9960 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd220034280 msgr2=0x7fd220036740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd220034280 0x7fd220036740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e3e23a47f0 tx=0x7fd33c031000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 msgr2=0x55e3e23c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd354431640 1 -- 172.21.15.138:0/27555925 reap_dead start 2024-02-16T10:30:48.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd34c012f90 tx=0x7fd34c049490 comp rx=0 tx=0).stop 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 shutdown_connections 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/27555925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23bf310 0x55e3e23c6050 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 >> 172.21.15.138:0/27555925 conn(0x55e3e23b9e90 msgr2=0x55e3e23bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 shutdown_connections 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/27555925 wait complete. 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 msgr2=0x7fd22c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 0x7fd22c036770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55e3e239f790 tx=0x7fd33c0490d0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 msgr2=0x55e3e23b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55e3e2398770 tx=0x7fd34c018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 shutdown_connections 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd22c0342b0 0x7fd22c036770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/629668700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e23b2370 0x55e3e23b2790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 >> 172.21.15.138:0/629668700 conn(0x55e3e23a7180 msgr2=0x55e3e23a7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 shutdown_connections 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/629668700 wait complete. 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 msgr2=0x55e3e239e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.780+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 0x55e3e239e860 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 msgr2=0x55e3e23a3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 0x55e3e23a3e70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 msgr2=0x7fd23c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 0x7fd23c036770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ae000 tx=0x7fd3440a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 msgr2=0x55e3e2397b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00f510 tx=0x7fd33c000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 shutdown_connections 2024-02-16T10:30:48.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3e23a0610 0x55e3e23a3e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3e221a7e0 0x55e3e239e860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd23c0342b0 0x7fd23c036770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 --2- 172.21.15.138:0/1518695278 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3e22194a0 0x55e3e2397b70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 >> 172.21.15.138:0/1518695278 conn(0x55e3e229feb0 msgr2=0x55e3e238b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 shutdown_connections 2024-02-16T10:30:48.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.784+0000 7fd357117980 1 -- 172.21.15.138:0/1518695278 wait complete. 2024-02-16T10:30:48.799 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T10:30:48.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-02-16T10:30:48.800 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-02-16T10:30:48.875 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:48.875 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:48.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8dd1d980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560683017630 0x560683017a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8dd1d980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560682f63b60 con 0x560683017f50 2024-02-16T10:30:48.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8dd1d980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x560682f2ad30 con 0x560683017630 2024-02-16T10:30:48.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b838640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560683017630 0x560683017a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b838640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560683017630 0x560683017a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45478/0 (socket says 172.21.15.138:45478) 2024-02-16T10:30:48.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b037640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560683017f50 0x5606830188c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52096/0 (socket says 172.21.15.138:52096) 2024-02-16T10:30:48.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b838640 1 -- 172.21.15.138:0/244588838 learned_addr learned my addr 172.21.15.138:0/244588838 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b838640 1 -- 172.21.15.138:0/244588838 >> v1:172.21.15.107:6789/0 conn(0x560683017f50 legacy=0x5606830188c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8a836640 1 -- 172.21.15.138:0/244588838 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98358078 0 0) 0x560682f63b60 con 0x560683017f50 2024-02-16T10:30:48.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.868+0000 7f6e8b838640 1 -- 172.21.15.138:0/244588838 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606830190f0 con 0x560683017630 2024-02-16T10:30:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8b838640 1 --2- 172.21.15.138:0/244588838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683017a10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00a5c0 tx=0x7f6e7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bca146110f1dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8a836640 1 -- 172.21.15.138:0/244588838 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0aa470 con 0x560683017630 2024-02-16T10:30:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8a836640 1 -- 172.21.15.138:0/244588838 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0aa5d0 con 0x560683017630 2024-02-16T10:30:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8a836640 1 -- 172.21.15.138:0/244588838 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0aa890 con 0x560683017630 2024-02-16T10:30:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/244588838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 msgr2=0x560683017a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/244588838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683017a10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00a5c0 tx=0x7f6e7c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/244588838 shutdown_connections 2024-02-16T10:30:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/244588838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683017a10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/244588838 >> 172.21.15.138:0/244588838 conn(0x560683012f00 msgr2=0x560683015320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/244588838 shutdown_connections 2024-02-16T10:30:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.872+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/244588838 wait complete. 2024-02-16T10:30:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.884+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.884+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560682f27fc0 con 0x560683017630 2024-02-16T10:30:48.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45480/0 (socket says 172.21.15.138:45480) 2024-02-16T10:30:48.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 -- 172.21.15.138:0/2499293610 learned_addr learned my addr 172.21.15.138:0/2499293610 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 -- 172.21.15.138:0/2499293610 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c005df0 con 0x560683017630 2024-02-16T10:30:48.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 --2- 172.21.15.138:0/2499293610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01b380 tx=0x7f6e7c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50074a845d3eb07d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6d79e0b640 1 -- 172.21.15.138:0/2499293610 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0aa9b0 con 0x560683017630 2024-02-16T10:30:48.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6d79e0b640 1 -- 172.21.15.138:0/2499293610 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0aab30 con 0x560683017630 2024-02-16T10:30:48.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6d79e0b640 1 -- 172.21.15.138:0/2499293610 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0aae10 con 0x560683017630 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/2499293610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 msgr2=0x5606831019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/2499293610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c01b380 tx=0x7f6e7c003030 comp rx=0 tx=0).stop 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/2499293610 shutdown_connections 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/2499293610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x5606831019d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/2499293610 >> 172.21.15.138:0/2499293610 conn(0x560683012f00 msgr2=0x5606830fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/2499293610 shutdown_connections 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/2499293610 wait complete. 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8dd1d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560682f237a0 con 0x560683017630 2024-02-16T10:30:48.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45482/0 (socket says 172.21.15.138:45482) 2024-02-16T10:30:48.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.888+0000 7f6e8b838640 1 -- 172.21.15.138:0/470989138 learned_addr learned my addr 172.21.15.138:0/470989138 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8b838640 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606830190f0 con 0x560683017630 2024-02-16T10:30:48.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8b838640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005940 tx=0x7f6e7c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 -- 172.21.15.138:0/470989138 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0aa950 con 0x560683017630 2024-02-16T10:30:48.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 -- 172.21.15.138:0/470989138 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0c6650 con 0x560683017630 2024-02-16T10:30:48.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560683108e40 con 0x560683017630 2024-02-16T10:30:48.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 -- 172.21.15.138:0/470989138 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e7c0c6910 con 0x560683017630 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606831092f0 con 0x560683017630 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 -- 172.21.15.138:0/470989138 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6e7c0c6ac0 con 0x560683017630 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 0x7f6d74036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6d73fff640 1 -- 172.21.15.138:0/470989138 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6e7c0e4e40 con 0x560683017630 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8b037640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 0x7f6d74036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 0x56068310f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068310fb30 con 0x560683017f50 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 0x56068310f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8b037640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 0x7f6d74036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c10 tx=0x7f6e800013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 0x56068310f5f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 -- 172.21.15.138:0/470989138 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x560683017f50 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068310fef0 con 0x560683017f50 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 -- 172.21.15.138:0/470989138 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6e8400a4d0 con 0x560683017f50 2024-02-16T10:30:48.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831117a0 con 0x560683017f50 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 -- 172.21.15.138:0/470989138 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6e8400a4d0 con 0x560683017f50 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831108e0 con 0x560683017f50 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8c039640 1 -- 172.21.15.138:0/470989138 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6e8400a4d0 con 0x560683017f50 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 0x560683114b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.892+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683115170 con 0x560683111200 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8b838640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 0x560683114b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8b838640 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 0x560683114b20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8b838640 1 -- 172.21.15.138:0/470989138 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6e7c0b0020 con 0x560683111200 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560682ebbf20 con 0x560682f8e210 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45486/0 (socket says 172.21.15.138:45486) 2024-02-16T10:30:48.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8c039640 1 -- 172.21.15.138:0/1697320519 learned_addr learned my addr 172.21.15.138:0/1697320519 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8c039640 1 -- 172.21.15.138:0/1697320519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560682f8cbf0 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8c039640 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x560683109d30 tx=0x7f6e84018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 -- 172.21.15.138:0/1697320519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8401d070 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 -- 172.21.15.138:0/1697320519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84014450 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560682f8cea0 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 -- 172.21.15.138:0/1697320519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e84014730 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560682f8d330 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 -- 172.21.15.138:0/1697320519 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6e84020020 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 0x7f6d64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6d717fa640 1 -- 172.21.15.138:0/1697320519 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6e8404b290 con 0x560682f8e210 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.896+0000 7f6e8b838640 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 0x7f6d64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8b838640 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 0x7f6d64036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560683110c40 tx=0x7f6e7c0c7ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560682eaf790 con 0x560683132340 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45496/0 (socket says 172.21.15.138:45496) 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 -- 172.21.15.138:0/773996165 learned_addr learned my addr 172.21.15.138:0/773996165 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 -- 172.21.15.138:0/773996165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560683132cf0 con 0x560683132340 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- 172.21.15.138:0/773996165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e84049680 tx=0x7f6e8402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32a929df357f03b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6d6affd640 1 -- 172.21.15.138:0/773996165 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8403b290 con 0x560683132340 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6d6affd640 1 -- 172.21.15.138:0/773996165 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8403b3f0 con 0x560683132340 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6d6affd640 1 -- 172.21.15.138:0/773996165 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e84016440 con 0x560683132340 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/773996165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 msgr2=0x560683132720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/773996165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e84049680 tx=0x7f6e8402bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/773996165 shutdown_connections 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/773996165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x560683132720 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/773996165 >> 172.21.15.138:0/773996165 conn(0x56068312cf10 msgr2=0x56068312ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/773996165 shutdown_connections 2024-02-16T10:30:48.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/773996165 wait complete. 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 Processor -- start 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- start start 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8dd1d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606831397f0 con 0x560683132340 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45500/0 (socket says 172.21.15.138:45500) 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 learned_addr learned my addr 172.21.15.138:0/3283779589 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560682f8d330 con 0x560683132340 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.900+0000 7f6e8c039640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56068312d610 tx=0x7f6e84049610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 -- 172.21.15.138:0/3283779589 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e840123a0 con 0x560683132340 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606831399f0 con 0x560683132340 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 -- 172.21.15.138:0/3283779589 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e84012500 con 0x560683132340 2024-02-16T10:30:48.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560683139e20 con 0x560683132340 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 -- 172.21.15.138:0/3283779589 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e84012df0 con 0x560683132340 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 -- 172.21.15.138:0/3283779589 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6e84013a90 con 0x560683132340 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d540342b0 0x7f6d54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6d697fa640 1 -- 172.21.15.138:0/3283779589 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6e84007280 con 0x560683132340 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b838640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d540342b0 0x7f6d54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683144900 0x560683146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683147510 con 0x560683144900 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683144900 0x560683146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b838640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d540342b0 0x7f6d54036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c003070 tx=0x7f6e7c0eb000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683144900 0x560683146dc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 realm 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683143d60 con 0x560683144900 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683147f90 con 0x560683144900 2024-02-16T10:30:48.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683147c30 con 0x560683144900 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683148d50 con 0x560683144900 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 20 searching for the correct realm 2024-02-16T10:30:48.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56068314ac50 0x56068314d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314d7e0 con 0x56068314ac50 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8c039640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56068314ac50 0x56068314d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.904+0000 7f6e8c039640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56068314ac50 0x56068314d110 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8c039640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6e84055040 0x7f6e8404b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x7f6e84055040 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b838640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6e84055040 0x7f6e8404b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b838640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6e84055040 0x7f6e8404b960 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b838640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6e7c0fb040 0x7f6e7c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6e7c0fb040 0x7f6e7c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:48.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6e7c0fb040 0x7f6e7c0c73f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x560683144900 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x560683144900 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.908+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e84053040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e84055040 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e84055040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.912+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e84055040 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.916+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e84055040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x56068314ac50 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x560683144900 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6e8002d040 con 0x7f6e84055040 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x560683144900 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683149460 con 0x560683144900 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683149460 con 0x7f6e84055040 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 zone default found 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 4 Realm: () 2024-02-16T10:30:48.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 zonegroup default 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314dc20 con 0x7f6e7c0fb040 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314f600 con 0x56068314ac50 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314f990 con 0x56068314ac50 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 started sync module instance, tier type = 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.920+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314ea90 con 0x7f6e84055040 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585968977392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314f290 con 0x7f6e84055040 2024-02-16T10:30:48.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683150440 con 0x560683144900 2024-02-16T10:30:48.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585968977392] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585968983840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831507f0 con 0x560683144900 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.924+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831511a0 con 0x56068314ac50 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585968987328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831510e0 con 0x56068314ac50 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683152080 con 0x7f6e84055040 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585968983840] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585968991072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683152430 con 0x7f6e84055040 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683152da0 con 0x560683144900 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585968987328] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585968991072] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585968989520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068314ef00 con 0x560683144900 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.928+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831535f0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585968996544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683153980 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831543e0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585968989520] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585968996544] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585969000144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831534e0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.932+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683154c30 con 0x7f6e7c0fb040 2024-02-16T10:30:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585969001712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683154db0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=0 2024-02-16T10:30:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=1 2024-02-16T10:30:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=2 2024-02-16T10:30:48.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=3 2024-02-16T10:30:48.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=4 2024-02-16T10:30:48.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=5 2024-02-16T10:30:48.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585969000144] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=6 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585969001712] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 20 add_watcher() i=7 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683157de0 con 0x560683144900 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.936+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585969002768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831551d0 con 0x560683144900 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585969002768] v31'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 5 note: GC not initialized 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d40fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:48.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 Filter name: none 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6cba7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560683179ab0 con 0x560683144900 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~624 out=624b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+747 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 20 rados_obj.operate() r=0 bl.length=624 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:48.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~541 in=541b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068317fc60 con 0x560683144900 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~541] v31'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94585969178400 in=729b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068317b6e0 con 0x560683144900 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94585968989520 notify 133143986184 ret 0) v3 ==== 759+0+0 (crc 0 0 0) 0x7f6e80037040 con 0x560683144900 2024-02-16T10:30:48.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94585968989520 notifier 4402 bl.length()=717 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d6affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(64 notify.4 [notify cookie 94585969178400 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6d6affd640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6d50003ea0 con 0x560683144900 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94585969178400 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6e80012860 con 0x560683144900 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.940+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94585969178400 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068317b6e0 con 0x7f6e84055040 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== watch-notify(notify (1) cookie 94585968977392 notify 133143986180 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f6e7c0e6040 con 0x7f6e84055040 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6d6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94585968977392 notifier 4402 bl.length()=159 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6d6affd640 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6d50004200 con 0x7f6e84055040 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 notify.0 [notify cookie 94585969178400 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify_complete (2) cookie 94585969178400 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5606831092f0 con 0x7f6e84055040 2024-02-16T10:30:48.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068317b6e0 con 0x560683144900 2024-02-16T10:30:48.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(68 foo:foo1 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.953 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:48.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:48.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585969002768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068317e360 con 0x560683144900 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94585969002768] v31'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.944+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585968977392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068316bc00 con 0x7f6e84055040 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94585968977392] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8dd1d980 20 remove_watcher() i=0 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8dd1d980 2 removed watcher, disabling cache 2024-02-16T10:30:48.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585968983840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x560683144900 2024-02-16T10:30:48.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94585968983840] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8dd1d980 20 remove_watcher() i=1 2024-02-16T10:30:48.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.948+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585968987328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x56068314ac50 2024-02-16T10:30:48.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8c039640 1 -- 172.21.15.138:0/3283779589 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94585968987328] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8400a4d0 con 0x56068314ac50 2024-02-16T10:30:48.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 20 remove_watcher() i=2 2024-02-16T10:30:48.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585968991072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x7f6e84055040 2024-02-16T10:30:48.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8b838640 1 -- 172.21.15.138:0/3283779589 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94585968991072] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e7c0b0020 con 0x7f6e84055040 2024-02-16T10:30:48.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 20 remove_watcher() i=3 2024-02-16T10:30:48.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585968989520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x560683144900 2024-02-16T10:30:48.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94585968989520] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x560683144900 2024-02-16T10:30:48.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 20 remove_watcher() i=4 2024-02-16T10:30:48.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.952+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585968996544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94585968996544] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8dd1d980 20 remove_watcher() i=5 2024-02-16T10:30:48.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585969000144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94585969000144] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8dd1d980 20 remove_watcher() i=6 2024-02-16T10:30:48.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.956+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585969001712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606831490b0 con 0x7f6e7c0fb040 2024-02-16T10:30:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94585969001712] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e8000c040 con 0x7f6e7c0fb040 2024-02-16T10:30:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 20 remove_watcher() i=7 2024-02-16T10:30:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6e7c0fb040 msgr2=0x7f6e7c0c73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6e7c0fb040 0x7f6e7c0c73f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683144900 msgr2=0x560683146dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683144900 0x560683146dc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6e84055040 msgr2=0x7f6e8404b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6e84055040 0x7f6e8404b960 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56068314ac50 msgr2=0x56068314d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56068314ac50 0x56068314d110 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d540342b0 msgr2=0x7f6d54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d540342b0 0x7f6d54036770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c003070 tx=0x7f6e7c0eb000 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 msgr2=0x5606831392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8b037640 1 -- 172.21.15.138:0/3283779589 reap_dead start 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x56068312d610 tx=0x7f6e84049610 comp rx=0 tx=0).stop 2024-02-16T10:30:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 shutdown_connections 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/3283779589 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683132340 0x5606831392b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 >> 172.21.15.138:0/3283779589 conn(0x56068312cf10 msgr2=0x56068312ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 shutdown_connections 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/3283779589 wait complete. 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 msgr2=0x7f6d64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 0x7f6d64036770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560683110c40 tx=0x7f6e7c0c7ba0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 msgr2=0x560682f8c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x560683109d30 tx=0x7f6e84018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 shutdown_connections 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d640342b0 0x7f6d64036770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/1697320519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560682f8e210 0x560682f8c6b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 >> 172.21.15.138:0/1697320519 conn(0x560683117eb0 msgr2=0x5606831189c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 shutdown_connections 2024-02-16T10:30:48.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/1697320519 wait complete. 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 msgr2=0x56068310f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 0x56068310f5f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 msgr2=0x560683114b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 0x560683114b20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 msgr2=0x7f6d74036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 0x7f6d74036770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c10 tx=0x7f6e800013c0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 msgr2=0x560683108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005940 tx=0x7f6e7c0180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 shutdown_connections 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560683111200 0x560683114b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560683017f50 0x56068310f5f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6d740342b0 0x7f6d74036770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 --2- 172.21.15.138:0/470989138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560683017630 0x560683108900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 >> 172.21.15.138:0/470989138 conn(0x560683012f00 msgr2=0x5606830fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 shutdown_connections 2024-02-16T10:30:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:48.960+0000 7f6e8dd1d980 1 -- 172.21.15.138:0/470989138 wait complete. 2024-02-16T10:30:48.977 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:48.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T10:30:48.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-02-16T10:30:48.977 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-02-16T10:30:49.045 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d5afe980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c7ffce620 0x563c7ffcea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d5afe980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563c7ff1ab50 con 0x563c7ffcef40 2024-02-16T10:30:49.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d5afe980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563c7fee1d30 con 0x563c7ffce620 2024-02-16T10:30:49.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d3619640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c7ffce620 0x563c7ffcea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d2e18640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563c7ffcef40 0x563c7ffcf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52112/0 (socket says 172.21.15.138:52112) 2024-02-16T10:30:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d3619640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c7ffce620 0x563c7ffcea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45508/0 (socket says 172.21.15.138:45508) 2024-02-16T10:30:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d2e18640 1 -- 172.21.15.138:0/3824182207 learned_addr learned my addr 172.21.15.138:0/3824182207 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d3619640 1 -- 172.21.15.138:0/3824182207 >> v1:172.21.15.107:6789/0 conn(0x563c7ffcef40 legacy=0x563c7ffcf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d3619640 1 -- 172.21.15.138:0/3824182207 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c7ffd00e0 con 0x563c7ffce620 2024-02-16T10:30:49.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.040+0000 7fb5d3619640 1 --2- 172.21.15.138:0/3824182207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c7ffcea00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400a420 tx=0x7fb5c401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ac3725c201c48a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d2617640 1 -- 172.21.15.138:0/3824182207 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40aa530 con 0x563c7ffce620 2024-02-16T10:30:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d2617640 1 -- 172.21.15.138:0/3824182207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40a6050 con 0x563c7ffce620 2024-02-16T10:30:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d2617640 1 -- 172.21.15.138:0/3824182207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40aa800 con 0x563c7ffce620 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3824182207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 msgr2=0x563c7ffcea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3824182207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c7ffcea00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400a420 tx=0x7fb5c401afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3824182207 shutdown_connections 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3824182207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c7ffcea00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3824182207 >> 172.21.15.138:0/3824182207 conn(0x563c7ffc9ef0 msgr2=0x563c7ffcc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3824182207 shutdown_connections 2024-02-16T10:30:49.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.044+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3824182207 wait complete. 2024-02-16T10:30:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7fedefc0 con 0x563c7ffce620 2024-02-16T10:30:49.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d3619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d3619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45520/0 (socket says 172.21.15.138:45520) 2024-02-16T10:30:49.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d3619640 1 -- 172.21.15.138:0/3501100494 learned_addr learned my addr 172.21.15.138:0/3501100494 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d3619640 1 -- 172.21.15.138:0/3501100494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c400a100 con 0x563c7ffce620 2024-02-16T10:30:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d3619640 1 --2- 172.21.15.138:0/3501100494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40ad040 tx=0x7fb5c40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdd92f2103f003f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb4c160a640 1 -- 172.21.15.138:0/3501100494 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40aa630 con 0x563c7ffce620 2024-02-16T10:30:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb4c160a640 1 -- 172.21.15.138:0/3501100494 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40aa790 con 0x563c7ffce620 2024-02-16T10:30:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb4c160a640 1 -- 172.21.15.138:0/3501100494 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40aaa30 con 0x563c7ffce620 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3501100494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 msgr2=0x563c800b8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3501100494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40ad040 tx=0x7fb5c40033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3501100494 shutdown_connections 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3501100494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800b8bd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3501100494 >> 172.21.15.138:0/3501100494 conn(0x563c7ffc9ef0 msgr2=0x563c800b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3501100494 shutdown_connections 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.056+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3501100494 wait complete. 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7feda7a0 con 0x563c7ffce620 2024-02-16T10:30:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3619640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45528/0 (socket says 172.21.15.138:45528) 2024-02-16T10:30:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3619640 1 -- 172.21.15.138:0/1057548140 learned_addr learned my addr 172.21.15.138:0/1057548140 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3619640 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c7ffd00e0 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3619640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb5c401b870 tx=0x7fb5c4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 -- 172.21.15.138:0/1057548140 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40b6890 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 -- 172.21.15.138:0/1057548140 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c40b69f0 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c800bfee0 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 -- 172.21.15.138:0/1057548140 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5c40b6c90 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c800c0390 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 -- 172.21.15.138:0/1057548140 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5c40c0450 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 0x7fb4b80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb4bfe07640 1 -- 172.21.15.138:0/1057548140 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5c40e4010 con 0x563c7ffce620 2024-02-16T10:30:49.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 0x7fb4b80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 0x563c800c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800c6bd0 con 0x563c7ffcef40 2024-02-16T10:30:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 0x563c800c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.060+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 0x7fb4b80367c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000f70 tx=0x7fb5bc0012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 0x563c800c6690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1057548140 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5cc0083f0 con 0x563c7ffcef40 2024-02-16T10:30:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800c6fe0 con 0x563c7ffcef40 2024-02-16T10:30:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1057548140 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5cc0083f0 con 0x563c7ffcef40 2024-02-16T10:30:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800c8890 con 0x563c7ffcef40 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1057548140 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb5cc0083f0 con 0x563c7ffcef40 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800c79d0 con 0x563c7ffcef40 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1057548140 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5cc0083f0 con 0x563c7ffcef40 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 0x563c800cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800cc220 con 0x563c800c82f0 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3619640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 0x563c800cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3619640 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 0x563c800cbc10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3619640 1 -- 172.21.15.138:0/1057548140 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb5c40b1040 con 0x563c800c82f0 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d5afe980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7fe72f20 con 0x563c800da150 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45542/0 (socket says 172.21.15.138:45542) 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1181647438 learned_addr learned my addr 172.21.15.138:0/1181647438 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/1181647438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c800daab0 con 0x563c800da150 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.064+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563c800c08a0 tx=0x7fb5cc00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 -- 172.21.15.138:0/1181647438 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc00f040 con 0x563c800da150 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c800dad00 con 0x563c800da150 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 -- 172.21.15.138:0/1181647438 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc019550 con 0x563c800da150 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 -- 172.21.15.138:0/1181647438 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc019810 con 0x563c800da150 2024-02-16T10:30:49.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c800db850 con 0x563c800da150 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 -- 172.21.15.138:0/1181647438 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5cc019a00 con 0x563c800da150 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 0x7fb4ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4bd602640 1 -- 172.21.15.138:0/1181647438 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5cc04b4b0 con 0x563c800da150 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3619640 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 0x7fb4ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3619640 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 0x7fb4ac036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x563c800c7410 tx=0x7fb5c40e23b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d5afe980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c7fe66790 con 0x563c800e70b0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45544/0 (socket says 172.21.15.138:45544) 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/3863896482 learned_addr learned my addr 172.21.15.138:0/3863896482 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/3863896482 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c800e7aa0 con 0x563c800e70b0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/3863896482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00bfd0 tx=0x7fb5cc02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ded1029b5cdf38e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4b6ffd640 1 -- 172.21.15.138:0/3863896482 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc048070 con 0x563c800e70b0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4b6ffd640 1 -- 172.21.15.138:0/3863896482 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc04b110 con 0x563c800e70b0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.068+0000 7fb4b6ffd640 1 -- 172.21.15.138:0/3863896482 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc0153a0 con 0x563c800e70b0 2024-02-16T10:30:49.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3863896482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 msgr2=0x563c800e74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3863896482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00bfd0 tx=0x7fb5cc02af40 comp rx=0 tx=0).stop 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3863896482 shutdown_connections 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/3863896482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800e74d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3863896482 >> 172.21.15.138:0/3863896482 conn(0x563c800e1c30 msgr2=0x563c800e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3863896482 shutdown_connections 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/3863896482 wait complete. 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 Processor -- start 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- start start 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c800ee310 con 0x563c800e70b0 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3e1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45556/0 (socket says 172.21.15.138:45556) 2024-02-16T10:30:49.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 learned_addr learned my addr 172.21.15.138:0/306234472 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c800db850 con 0x563c800e70b0 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00efb0 tx=0x7fb5cc049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 -- 172.21.15.138:0/306234472 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc018530 con 0x563c800e70b0 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c800ee510 con 0x563c800e70b0 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 -- 172.21.15.138:0/306234472 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc04b280 con 0x563c800e70b0 2024-02-16T10:30:49.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 -- 172.21.15.138:0/306234472 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc049d20 con 0x563c800e70b0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c800ee9a0 con 0x563c800e70b0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 -- 172.21.15.138:0/306234472 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb5cc032020 con 0x563c800e70b0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb49c0342b0 0x7fb49c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb4b57fa640 1 -- 172.21.15.138:0/306234472 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fb5cc00c0b0 con 0x563c800e70b0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d3619640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb49c0342b0 0x7fb49c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c800f94a0 0x563c800fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fc0b0 con 0x563c800f94a0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.072+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c800f94a0 0x563c800fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb49c0342b0 0x7fb49c036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40e1200 tx=0x7fb5c40e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c800f94a0 0x563c800fb960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 realm 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800f8900 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fcb30 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fd3b0 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fd710 con 0x563c800f94a0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 20 searching for the correct realm 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c800ff7e0 0x563c80101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x563c800ff7e0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c800ff7e0 0x563c80101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c800ff7e0 0x563c80101ca0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3e1a640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb5cc022070 0x7fb5cc038080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x7fb5cc022070 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb5cc022070 0x7fb5cc038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb5cc022070 0x7fb5cc038080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb5c40c9030 0x7fb5c40a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x7fb5c40c9030 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.076+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb5c40c9030 0x7fb5c40a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb5c40c9030 0x7fb5c40a9630 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x563c800f94a0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x563c800f94a0 2024-02-16T10:30:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x7fb5c40c9030 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102370 con 0x7fb5c40c9030 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5cc022070 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.080+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5cc022070 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5cc022070 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.084+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5cc022070 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800ff7e0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5c40c9030 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x563c800f94a0 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb5bc02b040 con 0x7fb5cc022070 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fed90 con 0x563c800f94a0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c800fe5b0 con 0x563c800f94a0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.088+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801027b0 con 0x7fb5cc022070 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 zone default found 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 4 Realm: () 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 zonegroup default 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80102b10 con 0x7fb5c40c9030 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801048d0 con 0x563c800ff7e0 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80104c60 con 0x563c800ff7e0 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 started sync module instance, tier type = 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801041b0 con 0x7fb5cc022070 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817846574352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80104560 con 0x7fb5cc022070 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80105a20 con 0x563c800f94a0 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.092+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817846574352] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817846579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80105dd0 con 0x563c800f94a0 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80106780 con 0x563c800ff7e0 2024-02-16T10:30:49.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817846579296] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817846580352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80106740 con 0x563c800ff7e0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80107140 con 0x7fb5cc022070 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817846586528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80107990 con 0x7fb5cc022070 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.096+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801083b0 con 0x563c800f94a0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817846586528] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817846580352] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817846583968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801074f0 con 0x563c800f94a0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108c00 con 0x7fb5c40c9030 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817846583968] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817846591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108b60 con 0x7fb5c40c9030 2024-02-16T10:30:49.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.100+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801094d0 con 0x7fb5c40c9030 2024-02-16T10:30:49.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817846595632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c801098f0 con 0x7fb5c40c9030 2024-02-16T10:30:49.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c8010a390 con 0x7fb5c40c9030 2024-02-16T10:30:49.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817846591120] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817846595632] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817846599280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80109450 con 0x7fb5c40c9030 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=0 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=1 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=2 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=3 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=4 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=5 2024-02-16T10:30:49.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.104+0000 7fb5d5afe980 20 add_watcher() i=6 2024-02-16T10:30:49.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817846599280] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 20 add_watcher() i=7 2024-02-16T10:30:49.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c8010d490 con 0x563c800f94a0 2024-02-16T10:30:49.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817846593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c8010a900 con 0x563c800f94a0 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817846593136] v31'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.108+0000 7fb5d5afe980 5 note: GC not initialized 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb488fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 20 Filter name: none 2024-02-16T10:30:49.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb4027fc640 20 reqs_thread_entry: start 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c8012f150 con 0x563c800f94a0 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~541 out=541b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+664 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 20 rados_obj.operate() r=0 bl.length=541 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:49.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~515 in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80135060 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~515] v31'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94817846774496 in=703b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80133bb0 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94817846583968 notify 133143986185 ret 0) v3 ==== 733+0+0 (crc 0 0 0) 0x7fb5bc035040 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb4b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94817846583968 notifier 4409 bl.length()=691 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb4b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb4b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(64 notify.4 [notify cookie 94817846774496 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb4b6ffd640 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb498003ea0 con 0x563c800f94a0 2024-02-16T10:30:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== watch-notify(notify_complete (2) cookie 94817846774496 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563c7ff1ab50 con 0x563c800f94a0 2024-02-16T10:30:49.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.123 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.112+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817846593136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80133710 con 0x563c800f94a0 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94817846593136] v31'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817846574352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108670 con 0x7fb5cc022070 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94817846574352] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 20 remove_watcher() i=0 2024-02-16T10:30:49.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 2 removed watcher, disabling cache 2024-02-16T10:30:49.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817846579296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108670 con 0x563c800f94a0 2024-02-16T10:30:49.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94817846579296] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 20 remove_watcher() i=1 2024-02-16T10:30:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.116+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817846580352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80105060 con 0x563c800ff7e0 2024-02-16T10:30:49.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d3e1a640 1 -- 172.21.15.138:0/306234472 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94817846580352] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5cc042040 con 0x563c800ff7e0 2024-02-16T10:30:49.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d5afe980 20 remove_watcher() i=2 2024-02-16T10:30:49.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817846586528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108670 con 0x7fb5cc022070 2024-02-16T10:30:49.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d3619640 1 -- 172.21.15.138:0/306234472 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94817846586528] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5c40b1040 con 0x7fb5cc022070 2024-02-16T10:30:49.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d5afe980 20 remove_watcher() i=3 2024-02-16T10:30:49.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.120+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817846583968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80106ca0 con 0x563c800f94a0 2024-02-16T10:30:49.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94817846583968] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x563c800f94a0 2024-02-16T10:30:49.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d5afe980 20 remove_watcher() i=4 2024-02-16T10:30:49.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817846591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108670 con 0x7fb5c40c9030 2024-02-16T10:30:49.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94817846591120] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d5afe980 20 remove_watcher() i=5 2024-02-16T10:30:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.124+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817846595632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80106ca0 con 0x7fb5c40c9030 2024-02-16T10:30:49.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94817846595632] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 20 remove_watcher() i=6 2024-02-16T10:30:49.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817846599280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563c80108670 con 0x7fb5c40c9030 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94817846599280] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5bc00e5a0 con 0x7fb5c40c9030 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 20 remove_watcher() i=7 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb5c40c9030 msgr2=0x7fb5c40a9630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb5c40c9030 0x7fb5c40a9630 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c800f94a0 msgr2=0x563c800fb960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c800f94a0 0x563c800fb960 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb5cc022070 msgr2=0x7fb5cc038080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb5cc022070 0x7fb5cc038080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c800ff7e0 msgr2=0x563c80101ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c800ff7e0 0x563c80101ca0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb49c0342b0 msgr2=0x7fb49c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb49c0342b0 0x7fb49c036770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40e1200 tx=0x7fb5c40e0000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d2e18640 1 -- 172.21.15.138:0/306234472 reap_dead start 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 msgr2=0x563c800eddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00efb0 tx=0x7fb5cc049830 comp rx=0 tx=0).stop 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 shutdown_connections 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/306234472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800e70b0 0x563c800eddd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 >> 172.21.15.138:0/306234472 conn(0x563c800e1c30 msgr2=0x563c800e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 shutdown_connections 2024-02-16T10:30:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/306234472 wait complete. 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 msgr2=0x7fb4ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 0x7fb4ac036770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x563c800c7410 tx=0x7fb5c40e23b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 msgr2=0x563c800da570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x563c800c08a0 tx=0x7fb5cc00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 shutdown_connections 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4ac0342b0 0x7fb4ac036770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1181647438 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c800da150 0x563c800da570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 >> 172.21.15.138:0/1181647438 conn(0x563c800cef60 msgr2=0x563c800cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 shutdown_connections 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1181647438 wait complete. 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 msgr2=0x563c800c6690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 0x563c800c6690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 msgr2=0x563c800cbc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 0x563c800cbc10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 msgr2=0x7fb4b80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 0x7fb4b80367c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc000f70 tx=0x7fb5bc0012c0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 msgr2=0x563c800bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb5c401b870 tx=0x7fb5c4019810 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 shutdown_connections 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c800c82f0 0x563c800cbc10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c7ffcef40 0x563c800c6690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4b8034300 0x7fb4b80367c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 --2- 172.21.15.138:0/1057548140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c7ffce620 0x563c800bf9a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.128+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 >> 172.21.15.138:0/1057548140 conn(0x563c7ffc9ef0 msgr2=0x563c800b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.132+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 shutdown_connections 2024-02-16T10:30:49.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.132+0000 7fb5d5afe980 1 -- 172.21.15.138:0/1057548140 wait complete. 2024-02-16T10:30:49.147 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:49.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T10:30:49.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-02-16T10:30:49.147 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-02-16T10:30:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.216+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.216+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f6af68980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e66358eca0 0x55e663591090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f6af68980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e6634d6af0 con 0x55e66358bce0 2024-02-16T10:30:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f6af68980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e66349dd30 con 0x55e66358eca0 2024-02-16T10:30:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68282640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e66358eca0 0x55e663591090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68a83640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55e66358bce0 0x55e66358c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52120/0 (socket says 172.21.15.138:52120) 2024-02-16T10:30:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68a83640 1 -- 172.21.15.138:0/1832386414 learned_addr learned my addr 172.21.15.138:0/1832386414 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68282640 1 -- 172.21.15.138:0/1832386414 >> v1:172.21.15.107:6789/0 conn(0x55e66358bce0 legacy=0x55e66358c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68282640 1 -- 172.21.15.138:0/1832386414 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e66358c7d0 con 0x55e66358eca0 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f68282640 1 --2- 172.21.15.138:0/1832386414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358eca0 0x55e663591090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00a480 tx=0x7f8f5c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47239b0a48a23e75 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f67a81640 1 -- 172.21.15.138:0/1832386414 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0ab540 con 0x55e66358eca0 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f67a81640 1 -- 172.21.15.138:0/1832386414 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0ab6a0 con 0x55e66358eca0 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.220+0000 7f8f67a81640 1 -- 172.21.15.138:0/1832386414 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0ab960 con 0x55e66358eca0 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 -- 172.21.15.138:0/1832386414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358eca0 msgr2=0x55e663591090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1832386414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358eca0 0x55e663591090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00a480 tx=0x7f8f5c01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:49.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 -- 172.21.15.138:0/1832386414 shutdown_connections 2024-02-16T10:30:49.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1832386414 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358eca0 0x55e663591090 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 -- 172.21.15.138:0/1832386414 >> 172.21.15.138:0/1832386414 conn(0x55e663584490 msgr2=0x55e6635868b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 -- 172.21.15.138:0/1832386414 shutdown_connections 2024-02-16T10:30:49.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.224+0000 7f8f6af68980 1 -- 172.21.15.138:0/1832386414 wait complete. 2024-02-16T10:30:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e66349afc0 con 0x55e66358bce0 2024-02-16T10:30:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f68a83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f68a83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45574/0 (socket says 172.21.15.138:45574) 2024-02-16T10:30:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f68a83640 1 -- 172.21.15.138:0/2028607256 learned_addr learned my addr 172.21.15.138:0/2028607256 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f68a83640 1 -- 172.21.15.138:0/2028607256 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c005d30 con 0x55e66358bce0 2024-02-16T10:30:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2028607256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f58001c00 tx=0x7f8f5800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8d464297cb05ab server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8e56e0d640 1 -- 172.21.15.138:0/2028607256 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5800e690 con 0x55e66358bce0 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8e56e0d640 1 -- 172.21.15.138:0/2028607256 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5800e810 con 0x55e66358bce0 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8e56e0d640 1 -- 172.21.15.138:0/2028607256 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5800eb30 con 0x55e66358bce0 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 -- 172.21.15.138:0/2028607256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 msgr2=0x55e663674660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2028607256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f58001c00 tx=0x7f8f5800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 -- 172.21.15.138:0/2028607256 shutdown_connections 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2028607256 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e663674660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.236+0000 7f8f6af68980 1 -- 172.21.15.138:0/2028607256 >> 172.21.15.138:0/2028607256 conn(0x55e663584490 msgr2=0x55e6636701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- 172.21.15.138:0/2028607256 shutdown_connections 2024-02-16T10:30:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- 172.21.15.138:0/2028607256 wait complete. 2024-02-16T10:30:49.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6634967a0 con 0x55e66358bce0 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68a83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68a83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45584/0 (socket says 172.21.15.138:45584) 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68a83640 1 -- 172.21.15.138:0/1500205760 learned_addr learned my addr 172.21.15.138:0/1500205760 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68a83640 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6634d6af0 con 0x55e66358bce0 2024-02-16T10:30:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68a83640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800b710 tx=0x7f8f58000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 -- 172.21.15.138:0/1500205760 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5801f070 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e66358b800 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 -- 172.21.15.138:0/1500205760 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5801a910 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 -- 172.21.15.138:0/1500205760 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5801abf0 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e663589ce0 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 -- 172.21.15.138:0/1500205760 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8f5800a040 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 0x7f8e500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8e5560a640 1 -- 172.21.15.138:0/1500205760 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8f58049e50 con 0x55e66358bce0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68282640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 0x7f8e500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 0x55e663684520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e663684a60 con 0x55e66358eca0 2024-02-16T10:30:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f69284640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 0x55e663684520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.240+0000 7f8f68282640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 0x7f8e500367c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ad000 tx=0x7f8f5c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 0x55e663684520 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/1500205760 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f6000a4d0 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e663684e40 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/1500205760 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8f6000a4d0 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636866f0 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/1500205760 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8f6000a4d0 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e663685830 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/1500205760 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8f6000a4d0 con 0x55e66358eca0 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 0x55e663689a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e66368a0c0 con 0x55e663686150 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f68a83640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 0x55e663689a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f68a83640 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 0x55e663689a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f68a83640 1 -- 172.21.15.138:0/1500205760 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8f58017900 con 0x55e663686150 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f6af68980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e66342ef20 con 0x55e663697ff0 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45592/0 (socket says 172.21.15.138:45592) 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/2335584909 learned_addr learned my addr 172.21.15.138:0/2335584909 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 -- 172.21.15.138:0/2335584909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e663698950 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8f69284640 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55e66358ae50 tx=0x7f8f60018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.244+0000 7f8e4e7fc640 1 -- 172.21.15.138:0/2335584909 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f6001d070 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e663698ba0 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e4e7fc640 1 -- 172.21.15.138:0/2335584909 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60014450 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6636996f0 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e4e7fc640 1 -- 172.21.15.138:0/2335584909 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f600146f0 con 0x55e663697ff0 2024-02-16T10:30:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e4e7fc640 1 -- 172.21.15.138:0/2335584909 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8f60020020 con 0x55e663697ff0 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e4e7fc640 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 0x7f8e40036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e4e7fc640 1 -- 172.21.15.138:0/2335584909 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8f6004b1d0 con 0x55e663697ff0 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 0x7f8e40036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 0x7f8e40036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55e663685b90 tx=0x7f8f5800df50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e663422790 con 0x55e6636a4f50 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45596/0 (socket says 172.21.15.138:45596) 2024-02-16T10:30:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f69284640 1 -- 172.21.15.138:0/740285991 learned_addr learned my addr 172.21.15.138:0/740285991 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f69284640 1 -- 172.21.15.138:0/740285991 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6636a5940 con 0x55e6636a4f50 2024-02-16T10:30:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f69284640 1 --2- 172.21.15.138:0/740285991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f600495c0 tx=0x7f8f600133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428b6aa693e1527c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e3ffff640 1 -- 172.21.15.138:0/740285991 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f60048260 con 0x55e6636a4f50 2024-02-16T10:30:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e3ffff640 1 -- 172.21.15.138:0/740285991 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6003b1d0 con 0x55e6636a4f50 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8e3ffff640 1 -- 172.21.15.138:0/740285991 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f6002caf0 con 0x55e6636a4f50 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- 172.21.15.138:0/740285991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 msgr2=0x55e6636a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 --2- 172.21.15.138:0/740285991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f600495c0 tx=0x7f8f600133b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 -- 172.21.15.138:0/740285991 shutdown_connections 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.248+0000 7f8f6af68980 1 --2- 172.21.15.138:0/740285991 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636a5370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/740285991 >> 172.21.15.138:0/740285991 conn(0x55e66369fad0 msgr2=0x55e6636a09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/740285991 shutdown_connections 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/740285991 wait complete. 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 Processor -- start 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- start start 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6636ac1f0 con 0x55e6636a4f50 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f69284640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45598/0 (socket says 172.21.15.138:45598) 2024-02-16T10:30:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 learned_addr learned my addr 172.21.15.138:0/2126908925 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6636996f0 con 0x55e6636a4f50 2024-02-16T10:30:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f69284640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8f600133f0 tx=0x7f8f60049550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 -- 172.21.15.138:0/2126908925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f60032070 con 0x55e6636a4f50 2024-02-16T10:30:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 -- 172.21.15.138:0/2126908925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6002c8e0 con 0x55e6636a4f50 2024-02-16T10:30:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 -- 172.21.15.138:0/2126908925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f600139a0 con 0x55e6636a4f50 2024-02-16T10:30:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6636ac3f0 con 0x55e6636a4f50 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6636ac820 con 0x55e6636a4f50 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 -- 172.21.15.138:0/2126908925 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8f60013b00 con 0x55e6636a4f50 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e34034300 0x7f8e340367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8e3e7fc640 1 -- 172.21.15.138:0/2126908925 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8f6003c400 con 0x55e6636a4f50 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e34034300 0x7f8e340367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e6636b7380 0x55e6636b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636b9f90 con 0x55e6636b7380 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f68282640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e6636b7380 0x55e6636b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e34034300 0x7f8e340367c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802d530 tx=0x7f8f5803f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.252+0000 7f8f68282640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e6636b7380 0x55e6636b9840 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 realm 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636ba380 con 0x55e6636b7380 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636babd0 con 0x55e6636b7380 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636baf30 con 0x55e6636b7380 2024-02-16T10:30:49.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636bb730 con 0x55e6636b7380 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 20 searching for the correct realm 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e6636bd5e0 0x55e6636bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c0120 con 0x55e6636bd5e0 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f69284640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e6636bd5e0 0x55e6636bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f69284640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e6636bd5e0 0x55e6636bfaa0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6000a4d0 con 0x55e6636bd5e0 2024-02-16T10:30:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f69284640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8f60014850 0x7f8f6004b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f60014850 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8f60014850 0x7f8f6004b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8f60014850 0x7f8f6004b870 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68a83640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8f58049900 0x7f8f5800d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.256+0000 7f8f68282640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8f58049900 0x7f8f5800d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8f58049900 0x7f8f5800d3e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f60014850 2024-02-16T10:30:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.260+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f60014850 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f60014850 2024-02-16T10:30:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.264+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f60014850 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636bd5e0 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f60037030 con 0x55e6636b7380 2024-02-16T10:30:49.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8f5c0da080 con 0x7f8f60014850 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636bbf30 con 0x55e6636b7380 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636bc2e0 con 0x55e6636b7380 2024-02-16T10:30:49.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.268+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636bc6c0 con 0x7f8f60014850 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 zone default found 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 4 Realm: () 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 zonegroup default 2024-02-16T10:30:49.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636bcbe0 con 0x7f8f58049900 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c1fe0 con 0x55e6636bd5e0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c23c0 con 0x55e6636bd5e0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 started sync module instance, tier type = 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c1470 con 0x7f8f60014850 2024-02-16T10:30:49.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447998865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c1c70 con 0x7f8f60014850 2024-02-16T10:30:49.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c2e30 con 0x55e6636b7380 2024-02-16T10:30:49.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.272+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447998865360] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447998867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c3210 con 0x55e6636b7380 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c3b80 con 0x55e6636bd5e0 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447998867408] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447998871888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c3b80 con 0x55e6636bd5e0 2024-02-16T10:30:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.276+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c4540 con 0x7f8f60014850 2024-02-16T10:30:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447998877856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c4d90 con 0x7f8f60014850 2024-02-16T10:30:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c5770 con 0x55e6636b7380 2024-02-16T10:30:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447998871888] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447998877856] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447998879984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c5290 con 0x55e6636b7380 2024-02-16T10:30:49.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.280+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c5ff0 con 0x7f8f58049900 2024-02-16T10:30:49.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447998879984] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447998875360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c5f20 con 0x7f8f58049900 2024-02-16T10:30:49.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c6890 con 0x7f8f58049900 2024-02-16T10:30:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447998875360] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447998884480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c6890 con 0x7f8f58049900 2024-02-16T10:30:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.284+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c70f0 con 0x7f8f58049900 2024-02-16T10:30:49.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447998884480] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447998887376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c70b0 con 0x7f8f58049900 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=0 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=1 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=2 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=3 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=4 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=5 2024-02-16T10:30:49.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=6 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447998887376] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 20 add_watcher() i=7 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636ca530 con 0x55e6636b7380 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.288+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447998888560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c79e0 con 0x55e6636b7380 2024-02-16T10:30:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447998888560] v31'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 5 note: GC not initialized 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e1e7e4640 20 reqs_thread_entry: start 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 Filter name: none 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e17fff640 20 reqs_thread_entry: start 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636ec420 con 0x55e6636b7380 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~515 out=515b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+638 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 20 rados_obj.operate() r=0 bl.length=515 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:49.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636f2120 con 0x55e6636b7380 2024-02-16T10:30:49.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v31'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94447999065024 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636edc70 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94447998879984 notify 133143986186 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x55e66358c7d0 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94447998879984 notifier 4416 bl.length()=534 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e3ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(64 notify.4 [notify cookie 94447999065024 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8e3ffff640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8e2c003ea0 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== watch-notify(notify_complete (2) cookie 94447999065024 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8f5c0d0850 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.292+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94447999065024 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636edc70 con 0x7f8f60014850 2024-02-16T10:30:49.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== watch-notify(notify (1) cookie 94447998865360 notify 133143986181 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7f8f58033040 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8e3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94447998865360 notifier 4416 bl.length()=159 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 notify.0 [notify cookie 94447999065024 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8e3f7fe640 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8d900032c0 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify_complete (2) cookie 94447999065024 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e663589ce0 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636f1bc0 con 0x7f8f60014850 2024-02-16T10:30:49.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(68 foo:foo2 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.306 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:49.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8e1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.296+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447998888560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636ecc60 con 0x55e6636b7380 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94447998888560] v31'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447998865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c6a30 con 0x7f8f60014850 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94447998865360] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 20 remove_watcher() i=0 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 2 removed watcher, disabling cache 2024-02-16T10:30:49.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447998867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c0fd0 con 0x55e6636b7380 2024-02-16T10:30:49.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94447998867408] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 20 remove_watcher() i=1 2024-02-16T10:30:49.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.300+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447998871888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c0fd0 con 0x55e6636bd5e0 2024-02-16T10:30:49.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f69284640 1 -- 172.21.15.138:0/2126908925 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94447998871888] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f6005f040 con 0x55e6636bd5e0 2024-02-16T10:30:49.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 20 remove_watcher() i=2 2024-02-16T10:30:49.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447998877856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c2950 con 0x7f8f60014850 2024-02-16T10:30:49.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f68a83640 1 -- 172.21.15.138:0/2126908925 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94447998877856] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f58017900 con 0x7f8f60014850 2024-02-16T10:30:49.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 20 remove_watcher() i=3 2024-02-16T10:30:49.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447998879984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c0fd0 con 0x55e6636b7380 2024-02-16T10:30:49.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94447998879984] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x55e6636b7380 2024-02-16T10:30:49.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 20 remove_watcher() i=4 2024-02-16T10:30:49.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.304+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447998875360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c2950 con 0x7f8f58049900 2024-02-16T10:30:49.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94447998875360] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f6af68980 20 remove_watcher() i=5 2024-02-16T10:30:49.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447998884480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c0fd0 con 0x7f8f58049900 2024-02-16T10:30:49.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94447998884480] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f6af68980 20 remove_watcher() i=6 2024-02-16T10:30:49.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.308+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447998887376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e6636c2950 con 0x7f8f58049900 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94447998887376] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8f5c0ab810 con 0x7f8f58049900 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 20 remove_watcher() i=7 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8f58049900 msgr2=0x7f8f5800d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8f58049900 0x7f8f5800d3e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e6636b7380 msgr2=0x55e6636b9840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e6636b7380 0x55e6636b9840 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8f60014850 msgr2=0x7f8f6004b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8f60014850 0x7f8f6004b870 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e6636bd5e0 msgr2=0x55e6636bfaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e6636bd5e0 0x55e6636bfaa0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e34034300 msgr2=0x7f8e340367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e34034300 0x7f8e340367c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802d530 tx=0x7f8f5803f000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 msgr2=0x55e6636abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f68282640 1 -- 172.21.15.138:0/2126908925 reap_dead start 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8f600133f0 tx=0x7f8f60049550 comp rx=0 tx=0).stop 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 shutdown_connections 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2126908925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e6636a4f50 0x55e6636abcb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 >> 172.21.15.138:0/2126908925 conn(0x55e66369fad0 msgr2=0x55e6636a09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 shutdown_connections 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2126908925 wait complete. 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 msgr2=0x7f8e40036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 0x7f8e40036770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55e663685b90 tx=0x7f8f5800df50 comp rx=0 tx=0).stop 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 msgr2=0x55e663698410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55e66358ae50 tx=0x7f8f60018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 shutdown_connections 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e400342b0 0x7f8e40036770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/2335584909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e663697ff0 0x55e663698410 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 >> 172.21.15.138:0/2335584909 conn(0x55e66368ce00 msgr2=0x55e66368d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 shutdown_connections 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/2335584909 wait complete. 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 msgr2=0x55e663684520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 0x55e663684520 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 msgr2=0x55e663689a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 0x55e663689a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 msgr2=0x7f8e500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 0x7f8e500367c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0ad000 tx=0x7f8f5c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:49.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 msgr2=0x55e66358b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800b710 tx=0x7f8f58000bd0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 shutdown_connections 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e663686150 0x55e663689a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e66358eca0 0x55e663684520 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f8e50034300 0x7f8e500367c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 --2- 172.21.15.138:0/1500205760 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e66358bce0 0x55e66358b2c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 >> 172.21.15.138:0/1500205760 conn(0x55e663584490 msgr2=0x55e66366ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 shutdown_connections 2024-02-16T10:30:49.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.312+0000 7f8f6af68980 1 -- 172.21.15.138:0/1500205760 wait complete. 2024-02-16T10:30:49.331 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:49.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:30:49.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:30:49.331 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T10:30:49.401 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.401 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.392+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.392+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f208bd4d980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5643e051f750 0x5643e05ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f208bd4d980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5643e04f7b50 con 0x5643e05ae790 2024-02-16T10:30:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f208bd4d980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5643e04bed30 con 0x5643e051f750 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089868640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5643e051f750 0x5643e05ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089868640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5643e051f750 0x5643e05ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45602/0 (socket says 172.21.15.138:45602) 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089868640 1 -- 172.21.15.138:0/2907260233 learned_addr learned my addr 172.21.15.138:0/2907260233 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089067640 1 --1- 172.21.15.138:0/2907260233 >> v1:172.21.15.107:6789/0 conn(0x5643e05ae790 0x5643e05b0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52124/0 (socket says 172.21.15.138:52124) 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089868640 1 -- 172.21.15.138:0/2907260233 >> v1:172.21.15.107:6789/0 conn(0x5643e05ae790 legacy=0x5643e05b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2089868640 1 -- 172.21.15.138:0/2907260233 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e05b3370 con 0x5643e051f750 2024-02-16T10:30:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.396+0000 7f2088866640 1 -- 172.21.15.138:0/2907260233 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943605040 0 0) 0x5643e04f7b50 con 0x5643e05ae790 2024-02-16T10:30:49.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f2089868640 1 --2- 172.21.15.138:0/2907260233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e05ae250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f207c00a4e0 tx=0x7f207c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770899494eeeae17 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f2088866640 1 -- 172.21.15.138:0/2907260233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0aa540 con 0x5643e051f750 2024-02-16T10:30:49.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f2088866640 1 -- 172.21.15.138:0/2907260233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c0a6070 con 0x5643e051f750 2024-02-16T10:30:49.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f2088866640 1 -- 172.21.15.138:0/2907260233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0aa850 con 0x5643e051f750 2024-02-16T10:30:49.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 -- 172.21.15.138:0/2907260233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 msgr2=0x5643e05ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 --2- 172.21.15.138:0/2907260233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e05ae250 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f207c00a4e0 tx=0x7f207c01b090 comp rx=0 tx=0).stop 2024-02-16T10:30:49.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 -- 172.21.15.138:0/2907260233 shutdown_connections 2024-02-16T10:30:49.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 --2- 172.21.15.138:0/2907260233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e05ae250 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 -- 172.21.15.138:0/2907260233 >> 172.21.15.138:0/2907260233 conn(0x5643e05a5d70 msgr2=0x5643e05a8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 -- 172.21.15.138:0/2907260233 shutdown_connections 2024-02-16T10:30:49.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.400+0000 7f208bd4d980 1 -- 172.21.15.138:0/2907260233 wait complete. 2024-02-16T10:30:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f208bd4d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f208bd4d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e04bbfc0 con 0x5643e051f750 2024-02-16T10:30:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f2089868640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f2089868640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45612/0 (socket says 172.21.15.138:45612) 2024-02-16T10:30:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f2089868640 1 -- 172.21.15.138:0/3827161280 learned_addr learned my addr 172.21.15.138:0/3827161280 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f2089868640 1 -- 172.21.15.138:0/3827161280 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c00a1c0 con 0x5643e051f750 2024-02-16T10:30:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.412+0000 7f2089868640 1 --2- 172.21.15.138:0/3827161280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f207c018cc0 tx=0x7f207c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67edd162bce5a0d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f77e07640 1 -- 172.21.15.138:0/3827161280 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0aa6b0 con 0x5643e051f750 2024-02-16T10:30:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f77e07640 1 -- 172.21.15.138:0/3827161280 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c0aa810 con 0x5643e051f750 2024-02-16T10:30:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f77e07640 1 -- 172.21.15.138:0/3827161280 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0aaaf0 con 0x5643e051f750 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/3827161280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 msgr2=0x5643e06954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3827161280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f207c018cc0 tx=0x7f207c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/3827161280 shutdown_connections 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3827161280 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e06954e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/3827161280 >> 172.21.15.138:0/3827161280 conn(0x5643e05a5d70 msgr2=0x5643e0691070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/3827161280 shutdown_connections 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/3827161280 wait complete. 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e04b77a0 con 0x5643e051f750 2024-02-16T10:30:49.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f2089868640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f2089868640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45622/0 (socket says 172.21.15.138:45622) 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f2089868640 1 -- 172.21.15.138:0/1621558966 learned_addr learned my addr 172.21.15.138:0/1621558966 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f2089868640 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e05b3370 con 0x5643e051f750 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f2089868640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f207c018cc0 tx=0x7f207c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f76604640 1 -- 172.21.15.138:0/1621558966 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0bd790 con 0x5643e051f750 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f76604640 1 -- 172.21.15.138:0/1621558966 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c0bd8f0 con 0x5643e051f750 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f1f76604640 1 -- 172.21.15.138:0/1621558966 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f207c0bdbd0 con 0x5643e051f750 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643e069a6e0 con 0x5643e051f750 2024-02-16T10:30:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.416+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643e0696cf0 con 0x5643e051f750 2024-02-16T10:30:49.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f1f76604640 1 -- 172.21.15.138:0/1621558966 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f207c0c6030 con 0x5643e051f750 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f1f76604640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 0x7f1f700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f1f76604640 1 -- 172.21.15.138:0/1621558966 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f207c0e4780 con 0x5643e051f750 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f2089067640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 0x7f1f700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 0x5643e06a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06a9da0 con 0x5643e05ae790 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 0x5643e06a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f2089067640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 0x7f1f700367c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c10 tx=0x7f20740013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 0x5643e06a9860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 -- 172.21.15.138:0/1621558966 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f20840083f0 con 0x5643e05ae790 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06aa100 con 0x5643e05ae790 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 -- 172.21.15.138:0/1621558966 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f20840083f0 con 0x5643e05ae790 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ab530 con 0x5643e05ae790 2024-02-16T10:30:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 -- 172.21.15.138:0/1621558966 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f20840083f0 con 0x5643e05ae790 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06aa900 con 0x5643e05ae790 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208a069640 1 -- 172.21.15.138:0/1621558966 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f20840083f0 con 0x5643e05ae790 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 0x5643e06aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06af290 con 0x5643e06ac960 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f2089868640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 0x5643e06aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f2089868640 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 0x5643e06aed50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f2089868640 1 -- 172.21.15.138:0/1621558966 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f207c0c0cb0 con 0x5643e06ac960 2024-02-16T10:30:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.420+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e044ff20 con 0x5643e06bd0d0 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45636/0 (socket says 172.21.15.138:45636) 2024-02-16T10:30:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208a069640 1 -- 172.21.15.138:0/3020697127 learned_addr learned my addr 172.21.15.138:0/3020697127 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208a069640 1 -- 172.21.15.138:0/3020697127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e06bda30 con 0x5643e06bd0d0 2024-02-16T10:30:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208a069640 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5643e0697f40 tx=0x7f208400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 -- 172.21.15.138:0/3020697127 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208400f040 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643e06bdc80 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643e06be7d0 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 -- 172.21.15.138:0/3020697127 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084019550 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 -- 172.21.15.138:0/3020697127 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20840197f0 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 -- 172.21.15.138:0/3020697127 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2084019950 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 0x7f1f64036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f1f6f7fe640 1 -- 172.21.15.138:0/3020697127 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f208404b7f0 con 0x5643e06bd0d0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f2089868640 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 0x7f1f64036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f2089868640 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 0x7f1f64036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5643e06971a0 tx=0x7f207c0e2a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.424+0000 7f208bd4d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e0443790 con 0x5643e06c9f80 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45648/0 (socket says 172.21.15.138:45648) 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 -- 172.21.15.138:0/3411895526 learned_addr learned my addr 172.21.15.138:0/3411895526 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 -- 172.21.15.138:0/3411895526 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e06ca8e0 con 0x5643e06c9f80 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- 172.21.15.138:0/3411895526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2084022fd0 tx=0x7f208402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c774664137fc2ede server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f6d7fa640 1 -- 172.21.15.138:0/3411895526 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2084048070 con 0x5643e06c9f80 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f6d7fa640 1 -- 172.21.15.138:0/3411895526 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20840225f0 con 0x5643e06c9f80 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f6d7fa640 1 -- 172.21.15.138:0/3411895526 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2084007da0 con 0x5643e06c9f80 2024-02-16T10:30:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3411895526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 msgr2=0x5643e06ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3411895526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2084022fd0 tx=0x7f208402b860 comp rx=0 tx=0).stop 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3411895526 shutdown_connections 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3411895526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06ca3a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3411895526 >> 172.21.15.138:0/3411895526 conn(0x5643e06c4b50 msgr2=0x5643e06c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3411895526 shutdown_connections 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3411895526 wait complete. 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 Processor -- start 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- start start 2024-02-16T10:30:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e06d12d0 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45658/0 (socket says 172.21.15.138:45658) 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 learned_addr learned my addr 172.21.15.138:0/3571199061 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e06be7d0 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208a069640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2084048b00 tx=0x7f2084049b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f5b7fe640 1 -- 172.21.15.138:0/3571199061 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208402ba60 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643e06d14d0 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f5b7fe640 1 -- 172.21.15.138:0/3571199061 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208402bbc0 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f1f5b7fe640 1 -- 172.21.15.138:0/3571199061 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208402be60 con 0x5643e06c9f80 2024-02-16T10:30:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.428+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643e06d1900 con 0x5643e06c9f80 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f1f5b7fe640 1 -- 172.21.15.138:0/3571199061 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f208404bb50 con 0x5643e06c9f80 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f1f5b7fe640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f540342b0 0x7f1f54036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f1f5b7fe640 1 -- 172.21.15.138:0/3571199061 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f208404a300 con 0x5643e06c9f80 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089868640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f540342b0 0x7f1f54036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e06dc3f0 0x5643e06de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06df000 con 0x5643e06dc3f0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e06dc3f0 0x5643e06de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089868640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f540342b0 0x7f1f54036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f207c005f60 tx=0x7f207c0e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e06dc3f0 0x5643e06de8b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 realm 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06db960 con 0x5643e06dc3f0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06dfad0 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06dff90 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e0830 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 20 searching for the correct realm 2024-02-16T10:30:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5643e06e2550 0x5643e06e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x5643e06e2550 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208a069640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5643e06e2550 0x5643e06e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208a069640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5643e06e2550 0x5643e06e4940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208a069640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f208402b3a0 0x7f20840435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x7f208402b3a0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.432+0000 7f2089868640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f208402b3a0 0x7f20840435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f208402b3a0 0x7f20840435e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f207c0f3040 0x7f207c0bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x7f207c0f3040 2024-02-16T10:30:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f207c0f3040 0x7f207c0bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f207c0f3040 0x7f207c0bc3b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x5643e06dc3f0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x5643e06dc3f0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x7f207c0f3040 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e4e80 con 0x7f207c0f3040 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f208402b3a0 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.436+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f208402b3a0 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.440+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f208402b3a0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f208402b3a0 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06e2550 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f207c0f3040 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.444+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x5643e06dc3f0 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f207402d040 con 0x7f208402b3a0 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e1190 con 0x5643e06dc3f0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e0e10 con 0x5643e06dc3f0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e1a60 con 0x7f208402b3a0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 zone default found 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 4 Realm: () 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 zonegroup default 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e5270 con 0x7f207c0f3040 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e70f0 con 0x5643e06e2550 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e7450 con 0x5643e06e2550 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 started sync module instance, tier type = 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e66c0 con 0x7f208402b3a0 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849528128032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e7820 con 0x7f208402b3a0 2024-02-16T10:30:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.448+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e81d0 con 0x5643e06dc3f0 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849528128032] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849528130160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e8580 con 0x5643e06dc3f0 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e8ef0 con 0x5643e06e2550 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849528138320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e8e70 con 0x5643e06e2550 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e9de0 con 0x7f208402b3a0 2024-02-16T10:30:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.452+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849528130160] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849528142048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e9da0 con 0x7f208402b3a0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ea7a0 con 0x5643e06dc3f0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849528138320] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849528142048] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849528134896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ea300 con 0x5643e06dc3f0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06eb020 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.456+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849528134896] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849528140448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ead20 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06eb520 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849528140448] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849528146528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06eb440 con 0x7f207c0f3040 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.460+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ebee0 con 0x7f207c0f3040 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849528146528] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849528150464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ebea0 con 0x7f207c0f3040 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=0 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=1 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=2 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=3 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=4 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=5 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=6 2024-02-16T10:30:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849528150464] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 20 add_watcher() i=7 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ef320 con 0x5643e06dc3f0 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.464+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849528147648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06ec790 con 0x5643e06dc3f0 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849528147648] v31'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f1f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 5 note: GC not initialized 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f1f3a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 Filter name: none 2024-02-16T10:30:49.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f1eabfff640 20 reqs_thread_entry: start 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e0710d00 con 0x5643e06dc3f0 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e0710d00 con 0x7f208402b3a0 2024-02-16T10:30:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f1f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849528147648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e0710cc0 con 0x5643e06dc3f0 2024-02-16T10:30:49.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94849528147648] v31'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.468+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849528128032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e0710cc0 con 0x7f208402b3a0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94849528128032] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f208bd4d980 20 remove_watcher() i=0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f208bd4d980 2 removed watcher, disabling cache 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849528130160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e6220 con 0x5643e06dc3f0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94849528130160] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f208bd4d980 20 remove_watcher() i=1 2024-02-16T10:30:49.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.472+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849528138320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e6220 con 0x5643e06e2550 2024-02-16T10:30:49.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208a069640 1 -- 172.21.15.138:0/3571199061 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94849528138320] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2084012070 con 0x5643e06e2550 2024-02-16T10:30:49.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 20 remove_watcher() i=2 2024-02-16T10:30:49.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849528142048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e8a50 con 0x7f208402b3a0 2024-02-16T10:30:49.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f2089868640 1 -- 172.21.15.138:0/3571199061 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94849528142048] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207c0c0cb0 con 0x7f208402b3a0 2024-02-16T10:30:49.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 20 remove_watcher() i=3 2024-02-16T10:30:49.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849528134896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e6220 con 0x5643e06dc3f0 2024-02-16T10:30:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94849528134896] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x5643e06dc3f0 2024-02-16T10:30:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 20 remove_watcher() i=4 2024-02-16T10:30:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.476+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849528140448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e98e0 con 0x7f207c0f3040 2024-02-16T10:30:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94849528140448] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f208bd4d980 20 remove_watcher() i=5 2024-02-16T10:30:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849528146528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e8a50 con 0x7f207c0f3040 2024-02-16T10:30:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94849528146528] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f208bd4d980 20 remove_watcher() i=6 2024-02-16T10:30:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.480+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849528150464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5643e06e6220 con 0x7f207c0f3040 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94849528150464] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f207400c040 con 0x7f207c0f3040 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 20 remove_watcher() i=7 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f207c0f3040 msgr2=0x7f207c0bc3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f207c0f3040 0x7f207c0bc3b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e06dc3f0 msgr2=0x5643e06de8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e06dc3f0 0x5643e06de8b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f208402b3a0 msgr2=0x7f20840435e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f208402b3a0 0x7f20840435e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5643e06e2550 msgr2=0x5643e06e4940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5643e06e2550 0x5643e06e4940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f540342b0 msgr2=0x7f1f54036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f540342b0 0x7f1f54036770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f207c005f60 tx=0x7f207c0e0000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f2089067640 1 -- 172.21.15.138:0/3571199061 reap_dead start 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 msgr2=0x5643e06d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2084048b00 tx=0x7f2084049b70 comp rx=0 tx=0).stop 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 shutdown_connections 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3571199061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06c9f80 0x5643e06d0d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 >> 172.21.15.138:0/3571199061 conn(0x5643e06c4b50 msgr2=0x5643e06c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 shutdown_connections 2024-02-16T10:30:49.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3571199061 wait complete. 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 msgr2=0x7f1f64036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 0x7f1f64036770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5643e06971a0 tx=0x7f207c0e2a40 comp rx=0 tx=0).stop 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 msgr2=0x5643e06bd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5643e0697f40 tx=0x7f208400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 shutdown_connections 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f640342b0 0x7f1f64036770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/3020697127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e06bd0d0 0x5643e06bd4f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 >> 172.21.15.138:0/3020697127 conn(0x5643e06b1ee0 msgr2=0x5643e06b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 shutdown_connections 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/3020697127 wait complete. 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 msgr2=0x5643e06a9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 0x5643e06a9860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 msgr2=0x5643e06aed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 0x5643e06aed50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 msgr2=0x7f1f700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 0x7f1f700367c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c10 tx=0x7f20740013c0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 msgr2=0x5643e069a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f207c018cc0 tx=0x7f207c017e30 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 shutdown_connections 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5643e06ac960 0x5643e06aed50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5643e05ae790 0x5643e06a9860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1f70034300 0x7f1f700367c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 --2- 172.21.15.138:0/1621558966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5643e051f750 0x5643e069a1a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 >> 172.21.15.138:0/1621558966 conn(0x5643e05a5d70 msgr2=0x5643e068fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 shutdown_connections 2024-02-16T10:30:49.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.484+0000 7f208bd4d980 1 -- 172.21.15.138:0/1621558966 wait complete. 2024-02-16T10:30:49.502 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-02-16T10:30:49.502 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:30:49.502 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T10:30:49.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T10:30:49.502 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T10:30:49.572 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.572 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103ea41980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564df6a8eaf0 0x564df6a90ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103ea41980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564df69d6b50 con 0x564df6a8a5e0 2024-02-16T10:30:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103ea41980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x564df699dd30 con 0x564df6a8eaf0 2024-02-16T10:30:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103bd5b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564df6a8eaf0 0x564df6a90ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103c55c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x564df6a8a5e0 0x564df6a8a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52136/0 (socket says 172.21.15.138:52136) 2024-02-16T10:30:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.564+0000 7f103c55c640 1 -- 172.21.15.138:0/370014747 learned_addr learned my addr 172.21.15.138:0/370014747 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103bd5b640 1 -- 172.21.15.138:0/370014747 >> v1:172.21.15.107:6789/0 conn(0x564df6a8a5e0 legacy=0x564df6a8a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103bd5b640 1 -- 172.21.15.138:0/370014747 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564df6a92430 con 0x564df6a8eaf0 2024-02-16T10:30:49.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103bd5b640 1 --2- 172.21.15.138:0/370014747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8eaf0 0x564df6a90ee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f102c00a420 tx=0x7f102c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3165342910f2c4d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103b55a640 1 -- 172.21.15.138:0/370014747 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102c0aa530 con 0x564df6a8eaf0 2024-02-16T10:30:49.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103b55a640 1 -- 172.21.15.138:0/370014747 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0a6050 con 0x564df6a8eaf0 2024-02-16T10:30:49.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103b55a640 1 -- 172.21.15.138:0/370014747 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102c0aa800 con 0x564df6a8eaf0 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 -- 172.21.15.138:0/370014747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8eaf0 msgr2=0x564df6a90ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 --2- 172.21.15.138:0/370014747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8eaf0 0x564df6a90ee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f102c00a420 tx=0x7f102c01afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 -- 172.21.15.138:0/370014747 shutdown_connections 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 --2- 172.21.15.138:0/370014747 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8eaf0 0x564df6a90ee0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 -- 172.21.15.138:0/370014747 >> 172.21.15.138:0/370014747 conn(0x564df6a85eb0 msgr2=0x564df6a882d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 -- 172.21.15.138:0/370014747 shutdown_connections 2024-02-16T10:30:49.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.568+0000 7f103ea41980 1 -- 172.21.15.138:0/370014747 wait complete. 2024-02-16T10:30:49.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.580+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564df699afc0 con 0x564df6a8a5e0 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45674/0 (socket says 172.21.15.138:45674) 2024-02-16T10:30:49.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 -- 172.21.15.138:0/2890130944 learned_addr learned my addr 172.21.15.138:0/2890130944 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 -- 172.21.15.138:0/2890130944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c00a100 con 0x564df6a8a5e0 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 --2- 172.21.15.138:0/2890130944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1024001c90 tx=0x7f102400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4131ed836532e85 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f0f2a60c640 1 -- 172.21.15.138:0/2890130944 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102400e690 con 0x564df6a8a5e0 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f0f2a60c640 1 -- 172.21.15.138:0/2890130944 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400e7f0 con 0x564df6a8a5e0 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f0f2a60c640 1 -- 172.21.15.138:0/2890130944 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102400eaf0 con 0x564df6a8a5e0 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- 172.21.15.138:0/2890130944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 msgr2=0x564df6b746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 --2- 172.21.15.138:0/2890130944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1024001c90 tx=0x7f102400b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- 172.21.15.138:0/2890130944 shutdown_connections 2024-02-16T10:30:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 --2- 172.21.15.138:0/2890130944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6b746d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- 172.21.15.138:0/2890130944 >> 172.21.15.138:0/2890130944 conn(0x564df6a85eb0 msgr2=0x564df6b70260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- 172.21.15.138:0/2890130944 shutdown_connections 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- 172.21.15.138:0/2890130944 wait complete. 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103ea41980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564df69967a0 con 0x564df6a8a5e0 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45680/0 (socket says 172.21.15.138:45680) 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.584+0000 7f103c55c640 1 -- 172.21.15.138:0/2286928538 learned_addr learned my addr 172.21.15.138:0/2286928538 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103c55c640 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564df69d6b50 con 0x564df6a8a5e0 2024-02-16T10:30:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103c55c640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1024001ee0 tx=0x7f1024000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 -- 172.21.15.138:0/2286928538 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102401f070 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564df6a00c70 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 -- 172.21.15.138:0/2286928538 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102401a4d0 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564df69ff170 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 -- 172.21.15.138:0/2286928538 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f102401a770 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 -- 172.21.15.138:0/2286928538 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f102400a040 con 0x564df6a8a5e0 2024-02-16T10:30:49.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 0x7f0f24036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f0f28e09640 1 -- 172.21.15.138:0/2286928538 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1024049800 con 0x564df6a8a5e0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103bd5b640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 0x7f0f24036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 0x564df6b84490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6b849d0 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 0x564df6b84490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103bd5b640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 0x7f0f24036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ac000 tx=0x7f102c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 0x564df6b84490 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 -- 172.21.15.138:0/2286928538 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10340083f0 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df69ff490 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 -- 172.21.15.138:0/2286928538 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f10340083f0 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6b86700 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 -- 172.21.15.138:0/2286928538 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f10340083f0 con 0x564df6a8eaf0 2024-02-16T10:30:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6b85840 con 0x564df6a8eaf0 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.588+0000 7f103cd5d640 1 -- 172.21.15.138:0/2286928538 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f10340083f0 con 0x564df6a8eaf0 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 0x564df6b89a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6b8a040 con 0x564df6b86160 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103c55c640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 0x564df6b89a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103c55c640 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 0x564df6b89a80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103c55c640 1 -- 172.21.15.138:0/2286928538 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1024014070 con 0x564df6b86160 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564df692ef20 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45690/0 (socket says 172.21.15.138:45690) 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103cd5d640 1 -- 172.21.15.138:0/2703412107 learned_addr learned my addr 172.21.15.138:0/2703412107 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103cd5d640 1 -- 172.21.15.138:0/2703412107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564df6b988b0 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103cd5d640 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564df6a004a0 tx=0x7f103400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f0f21ffb640 1 -- 172.21.15.138:0/2703412107 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103400f040 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564df6b98b00 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564df6b99650 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f0f21ffb640 1 -- 172.21.15.138:0/2703412107 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103401a560 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.592+0000 7f0f21ffb640 1 -- 172.21.15.138:0/2703412107 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f103401a800 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f21ffb640 1 -- 172.21.15.138:0/2703412107 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f103401a960 con 0x564df6b97f50 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f21ffb640 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 0x7f0f14036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f21ffb640 1 -- 172.21.15.138:0/2703412107 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f103404b900 con 0x564df6b97f50 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103c55c640 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 0x7f0f14036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103c55c640 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 0x7f0f14036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564df6b852e0 tx=0x7f1024047b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564df6922790 con 0x564df6ba4e20 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45694/0 (socket says 172.21.15.138:45694) 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 -- 172.21.15.138:0/2951201523 learned_addr learned my addr 172.21.15.138:0/2951201523 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 -- 172.21.15.138:0/2951201523 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564df6ba5780 con 0x564df6ba4e20 2024-02-16T10:30:49.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 --2- 172.21.15.138:0/2951201523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1034049d20 tx=0x7f1034018970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b4afa9701f2f86 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f1b7fe640 1 -- 172.21.15.138:0/2951201523 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1034024500 con 0x564df6ba4e20 2024-02-16T10:30:49.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f1b7fe640 1 -- 172.21.15.138:0/2951201523 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034024660 con 0x564df6ba4e20 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f0f1b7fe640 1 -- 172.21.15.138:0/2951201523 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1034019e10 con 0x564df6ba4e20 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- 172.21.15.138:0/2951201523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 msgr2=0x564df6ba5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 --2- 172.21.15.138:0/2951201523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1034049d20 tx=0x7f1034018970 comp rx=0 tx=0).stop 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- 172.21.15.138:0/2951201523 shutdown_connections 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 --2- 172.21.15.138:0/2951201523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6ba5240 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- 172.21.15.138:0/2951201523 >> 172.21.15.138:0/2951201523 conn(0x564df6b9f9f0 msgr2=0x564df6ba08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- 172.21.15.138:0/2951201523 shutdown_connections 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- 172.21.15.138:0/2951201523 wait complete. 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 Processor -- start 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- start start 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103ea41980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564df6bac120 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45700/0 (socket says 172.21.15.138:45700) 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 learned_addr learned my addr 172.21.15.138:0/199360661 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.596+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564df6b99650 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103cd5d640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1034046010 tx=0x7f1034049c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 -- 172.21.15.138:0/199360661 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1034007e60 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 -- 172.21.15.138:0/199360661 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103401acb0 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564df6bac320 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 -- 172.21.15.138:0/199360661 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10340238a0 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564df6bac750 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 -- 172.21.15.138:0/199360661 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1034042040 con 0x564df6ba4e20 2024-02-16T10:30:49.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f0c0342b0 0x7f0f0c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f0f19ffb640 1 -- 172.21.15.138:0/199360661 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f103404a030 con 0x564df6ba4e20 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6bb7300 0x564df6bb97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bb9f10 con 0x564df6bb7300 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103c55c640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f0c0342b0 0x7f0f0c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6bb7300 0x564df6bb97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6bb7300 0x564df6bb97c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103c55c640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f0c0342b0 0x7f0f0c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1024018880 tx=0x7f102403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 realm 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bba300 con 0x564df6bb7300 2024-02-16T10:30:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbab50 con 0x564df6bb7300 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbaeb0 con 0x564df6bb7300 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bba7f0 con 0x564df6bb7300 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 20 searching for the correct realm 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564df6bbd100 0x564df6bbf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.600+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103cd5d640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564df6bbd100 0x564df6bbf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103cd5d640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564df6bbd100 0x564df6bbf570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103cd5d640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f103403bc20 0x7f103403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f103403bc20 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103c55c640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f103403bc20 0x7f103403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103c55c640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f103403bc20 0x7f103403b050 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103c55c640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1024057040 0x7f10240414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1024057040 0x7f10240414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1024057040 0x7f10240414c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.604+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f103403bc20 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f103403bc20 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.608+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f103403bc20 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f103403bc20 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bbd100 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.612+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbfc40 con 0x564df6bb7300 2024-02-16T10:30:49.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f102c0d7080 con 0x7f103403bc20 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbbd40 con 0x564df6bb7300 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbb960 con 0x564df6bb7300 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bbc590 con 0x7f103403bc20 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 zone default found 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 4 Realm: () 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 zonegroup default 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc00d0 con 0x7f1024057040 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1f50 con 0x564df6bbd100 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc22b0 con 0x564df6bbd100 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 started sync module instance, tier type = 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1520 con 0x7f103403bc20 2024-02-16T10:30:49.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.616+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94892851990656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc2610 con 0x7f103403bc20 2024-02-16T10:30:49.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc2f80 con 0x564df6bb7300 2024-02-16T10:30:49.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94892851990656] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94892851997408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc2f00 con 0x564df6bb7300 2024-02-16T10:30:49.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc3cb0 con 0x564df6bbd100 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.620+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94892851997408] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94892851999536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc4060 con 0x564df6bbd100 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc49d0 con 0x7f103403bc20 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94892852004144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc5220 con 0x7f103403bc20 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc5c40 con 0x564df6bb7300 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94892852004144] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94892851999536] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94892852000592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc4d80 con 0x564df6bb7300 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.624+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc6490 con 0x7f1024057040 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94892852000592] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94892852008736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc63a0 con 0x7f1024057040 2024-02-16T10:30:49.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc6d10 con 0x7f1024057040 2024-02-16T10:30:49.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94892852008736] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94892852011232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc6d10 con 0x7f1024057040 2024-02-16T10:30:49.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.628+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc76c0 con 0x7f1024057040 2024-02-16T10:30:49.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94892852011232] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94892852015584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc6d10 con 0x7f1024057040 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=0 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=1 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=2 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=3 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=4 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=5 2024-02-16T10:30:49.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=6 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94892852015584] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 20 add_watcher() i=7 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.632+0000 7f103ea41980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bcab00 con 0x564df6bb7300 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94892852013632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc8080 con 0x564df6bb7300 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94892852013632] v31'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f0ef27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 5 note: GC not initialized 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f0ef17e2640 20 reqs_thread_entry: start 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 Filter name: none 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f0e62ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bec490 con 0x564df6bb7300 2024-02-16T10:30:49.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:49.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bec490 con 0x7f103403bc20 2024-02-16T10:30:49.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f0ef27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.636+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94892852013632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bec450 con 0x564df6bb7300 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94892852013632] v31'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94892851990656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bec450 con 0x7f103403bc20 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94892851990656] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 20 remove_watcher() i=0 2024-02-16T10:30:49.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 2 removed watcher, disabling cache 2024-02-16T10:30:49.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94892851997408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1080 con 0x564df6bb7300 2024-02-16T10:30:49.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94892851997408] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 20 remove_watcher() i=1 2024-02-16T10:30:49.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.640+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94892851999536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1080 con 0x564df6bbd100 2024-02-16T10:30:49.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103cd5d640 1 -- 172.21.15.138:0/199360661 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94892851999536] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1034034070 con 0x564df6bbd100 2024-02-16T10:30:49.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103ea41980 20 remove_watcher() i=2 2024-02-16T10:30:49.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94892852004144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc3330 con 0x7f103403bc20 2024-02-16T10:30:49.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103c55c640 1 -- 172.21.15.138:0/199360661 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94892852004144] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1024014070 con 0x7f103403bc20 2024-02-16T10:30:49.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103ea41980 20 remove_watcher() i=3 2024-02-16T10:30:49.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.644+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94892852000592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1080 con 0x564df6bb7300 2024-02-16T10:30:49.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94892852000592] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x564df6bb7300 2024-02-16T10:30:49.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103ea41980 20 remove_watcher() i=4 2024-02-16T10:30:49.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94892852008736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1080 con 0x7f1024057040 2024-02-16T10:30:49.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94892852008736] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103ea41980 20 remove_watcher() i=5 2024-02-16T10:30:49.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.648+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94892852011232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc1080 con 0x7f1024057040 2024-02-16T10:30:49.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94892852011232] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 20 remove_watcher() i=6 2024-02-16T10:30:49.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94892852015584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564df6bc60e0 con 0x7f1024057040 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94892852015584] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f102c0b1040 con 0x7f1024057040 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 20 remove_watcher() i=7 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1024057040 msgr2=0x7f10240414c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1024057040 0x7f10240414c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6bb7300 msgr2=0x564df6bb97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6bb7300 0x564df6bb97c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f103403bc20 msgr2=0x7f103403b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f103403bc20 0x7f103403b050 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564df6bbd100 msgr2=0x564df6bbf570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564df6bbd100 0x564df6bbf570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f0c0342b0 msgr2=0x7f0f0c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f0c0342b0 0x7f0f0c036770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1024018880 tx=0x7f102403a000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103bd5b640 1 -- 172.21.15.138:0/199360661 reap_dead start 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 msgr2=0x564df6babbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1034046010 tx=0x7f1034049c80 comp rx=0 tx=0).stop 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 shutdown_connections 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/199360661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6ba4e20 0x564df6babbe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 >> 172.21.15.138:0/199360661 conn(0x564df6b9f9f0 msgr2=0x564df6ba08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 shutdown_connections 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/199360661 wait complete. 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 msgr2=0x7f0f14036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 0x7f0f14036770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564df6b852e0 tx=0x7f1024047b80 comp rx=0 tx=0).stop 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 msgr2=0x564df6b98370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564df6a004a0 tx=0x7f103400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 shutdown_connections 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f140342b0 0x7f0f14036770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2703412107 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6b97f50 0x564df6b98370 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 >> 172.21.15.138:0/2703412107 conn(0x564df6b8cd60 msgr2=0x564df6b8d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 shutdown_connections 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2703412107 wait complete. 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 msgr2=0x564df6b84490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 0x564df6b84490 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 msgr2=0x564df6b89a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.652+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 0x564df6b89a80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 msgr2=0x7f0f24036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 0x7f0f24036770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ac000 tx=0x7f102c0a5000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 msgr2=0x564df6a00730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1024001ee0 tx=0x7f1024000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 shutdown_connections 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564df6b86160 0x564df6b89a80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564df6a8eaf0 0x564df6b84490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0f240342b0 0x7f0f24036770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 --2- 172.21.15.138:0/2286928538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564df6a8a5e0 0x564df6a00730 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 >> 172.21.15.138:0/2286928538 conn(0x564df6a85eb0 msgr2=0x564df6b6ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 shutdown_connections 2024-02-16T10:30:49.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.656+0000 7f103ea41980 1 -- 172.21.15.138:0/2286928538 wait complete. 2024-02-16T10:30:49.671 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-02-16T10:30:49.671 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:30:49.688 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:49.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-02-16T10:30:49.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-02-16T10:30:49.689 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-02-16T10:30:49.740 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.740 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c3da5980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55eeb50a77d0 0x55eeb50a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c3da5980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eeb4ff1b50 con 0x55eeb50a80f0 2024-02-16T10:30:49.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c3da5980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eeb4fb8d30 con 0x55eeb50a77d0 2024-02-16T10:30:49.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c10bf640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55eeb50a80f0 0x55eeb50a8aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52148/0 (socket says 172.21.15.138:52148) 2024-02-16T10:30:49.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c10bf640 1 -- 172.21.15.138:0/4209494168 learned_addr learned my addr 172.21.15.138:0/4209494168 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:49.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.732+0000 7f79c18c0640 1 --2- 172.21.15.138:0/4209494168 >> v2:172.21.15.107:3300/0 conn(0x55eeb50a77d0 0x55eeb50a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c08be640 1 -- 172.21.15.138:0/4209494168 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716264166 0 0) 0x55eeb4ff1b50 con 0x55eeb50a80f0 2024-02-16T10:30:49.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c08be640 1 -- 172.21.15.138:0/4209494168 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac001e20 con 0x55eeb50a80f0 2024-02-16T10:30:49.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c18c0640 1 -- 172.21.15.138:0/4209494168 >> v1:172.21.15.107:6789/0 conn(0x55eeb50a80f0 legacy=0x55eeb50a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c18c0640 1 -- 172.21.15.138:0/4209494168 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb50a92d0 con 0x55eeb50a77d0 2024-02-16T10:30:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c18c0640 1 --2- 172.21.15.138:0/4209494168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb50a7bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f79b400a480 tx=0x7f79b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fbf65b5fe81b41 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c08be640 1 -- 172.21.15.138:0/4209494168 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40ab540 con 0x55eeb50a77d0 2024-02-16T10:30:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c08be640 1 -- 172.21.15.138:0/4209494168 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40ab6a0 con 0x55eeb50a77d0 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c08be640 1 -- 172.21.15.138:0/4209494168 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40ab940 con 0x55eeb50a77d0 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 -- 172.21.15.138:0/4209494168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 msgr2=0x55eeb50a7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 --2- 172.21.15.138:0/4209494168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb50a7bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f79b400a480 tx=0x7f79b401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 -- 172.21.15.138:0/4209494168 shutdown_connections 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 --2- 172.21.15.138:0/4209494168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb50a7bb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 -- 172.21.15.138:0/4209494168 >> 172.21.15.138:0/4209494168 conn(0x55eeb501aef0 msgr2=0x55eeb501b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 -- 172.21.15.138:0/4209494168 shutdown_connections 2024-02-16T10:30:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.736+0000 7f79c3da5980 1 -- 172.21.15.138:0/4209494168 wait complete. 2024-02-16T10:30:49.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.748+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4fb5fc0 con 0x55eeb50a77d0 2024-02-16T10:30:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45710/0 (socket says 172.21.15.138:45710) 2024-02-16T10:30:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 -- 172.21.15.138:0/847807002 learned_addr learned my addr 172.21.15.138:0/847807002 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 -- 172.21.15.138:0/847807002 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4005d30 con 0x55eeb50a77d0 2024-02-16T10:30:49.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 --2- 172.21.15.138:0/847807002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f79b401b2c0 tx=0x7f79b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df93ac3531db978 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f78afe07640 1 -- 172.21.15.138:0/847807002 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b400a020 con 0x55eeb50a77d0 2024-02-16T10:30:49.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f78afe07640 1 -- 172.21.15.138:0/847807002 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b400a180 con 0x55eeb50a77d0 2024-02-16T10:30:49.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f78afe07640 1 -- 172.21.15.138:0/847807002 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40ab810 con 0x55eeb50a77d0 2024-02-16T10:30:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- 172.21.15.138:0/847807002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 msgr2=0x55eeb5191c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 --2- 172.21.15.138:0/847807002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f79b401b2c0 tx=0x7f79b4003030 comp rx=0 tx=0).stop 2024-02-16T10:30:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- 172.21.15.138:0/847807002 shutdown_connections 2024-02-16T10:30:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 --2- 172.21.15.138:0/847807002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5191c90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- 172.21.15.138:0/847807002 >> 172.21.15.138:0/847807002 conn(0x55eeb501aef0 msgr2=0x55eeb518d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- 172.21.15.138:0/847807002 shutdown_connections 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- 172.21.15.138:0/847807002 wait complete. 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c3da5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4fb17a0 con 0x55eeb50a77d0 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45718/0 (socket says 172.21.15.138:45718) 2024-02-16T10:30:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.752+0000 7f79c18c0640 1 -- 172.21.15.138:0/252608518 learned_addr learned my addr 172.21.15.138:0/252608518 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c18c0640 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb50a92d0 con 0x55eeb50a77d0 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c18c0640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f79b401b0b0 tx=0x7f79b4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 -- 172.21.15.138:0/252608518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40c4070 con 0x55eeb50a77d0 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 -- 172.21.15.138:0/252608518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40a3e40 con 0x55eeb50a77d0 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb5198f40 con 0x55eeb50a77d0 2024-02-16T10:30:49.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 -- 172.21.15.138:0/252608518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40b5770 con 0x55eeb50a77d0 2024-02-16T10:30:49.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb5199450 con 0x55eeb50a77d0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 -- 172.21.15.138:0/252608518 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79b40b2070 con 0x55eeb50a77d0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 0x7f78a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f78ae604640 1 -- 172.21.15.138:0/252608518 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f79b40e39c0 con 0x55eeb50a77d0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c10bf640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 0x7f78a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 0x55eeb519f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb519fc30 con 0x55eeb50a80f0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 0x55eeb519f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c10bf640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 0x7f78a8036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000f70 tx=0x7f79b80010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 0x55eeb519f6f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 -- 172.21.15.138:0/252608518 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb519cdf0 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 -- 172.21.15.138:0/252608518 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51a1980 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 -- 172.21.15.138:0/252608518 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51a0b80 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c20c1640 1 -- 172.21.15.138:0/252608518 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb50a80f0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 0x55eeb51a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.756+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51a52c0 con 0x55eeb51a14a0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c18c0640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 0x55eeb51a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c18c0640 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 0x55eeb51a4d00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c18c0640 1 -- 172.21.15.138:0/252608518 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f79b40b58d0 con 0x55eeb51a14a0 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4f49f20 con 0x55eeb51b3200 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45726/0 (socket says 172.21.15.138:45726) 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c20c1640 1 -- 172.21.15.138:0/641066857 learned_addr learned my addr 172.21.15.138:0/641066857 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c20c1640 1 -- 172.21.15.138:0/641066857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb51b3b60 con 0x55eeb51b3200 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c20c1640 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55eeb5199600 tx=0x7f79bc018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f78a77fe640 1 -- 172.21.15.138:0/641066857 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc01d070 con 0x55eeb51b3200 2024-02-16T10:30:49.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb51b3db0 con 0x55eeb51b3200 2024-02-16T10:30:49.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f78a77fe640 1 -- 172.21.15.138:0/641066857 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc014450 con 0x55eeb51b3200 2024-02-16T10:30:49.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f78a77fe640 1 -- 172.21.15.138:0/641066857 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc0146f0 con 0x55eeb51b3200 2024-02-16T10:30:49.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb51b4900 con 0x55eeb51b3200 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.760+0000 7f78a77fe640 1 -- 172.21.15.138:0/641066857 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79bc020020 con 0x55eeb51b3200 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f78a77fe640 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 0x7f789c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f78a77fe640 1 -- 172.21.15.138:0/641066857 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f79bc04b1a0 con 0x55eeb51b3200 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c18c0640 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 0x7f789c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c18c0640 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 0x7f789c036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55eeb51a0620 tx=0x7f79b40e1e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb4f3d790 con 0x55eeb51c0130 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45736/0 (socket says 172.21.15.138:45736) 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 -- 172.21.15.138:0/2741127521 learned_addr learned my addr 172.21.15.138:0/2741127521 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 -- 172.21.15.138:0/2741127521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb51c0b00 con 0x55eeb51c0130 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- 172.21.15.138:0/2741127521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79bc049510 tx=0x7f79bc049710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478715f84d4b91a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f78a57fa640 1 -- 172.21.15.138:0/2741127521 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc012c00 con 0x55eeb51c0130 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f78a57fa640 1 -- 172.21.15.138:0/2741127521 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc040030 con 0x55eeb51c0130 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f78a57fa640 1 -- 172.21.15.138:0/2741127521 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc02b990 con 0x55eeb51c0130 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- 172.21.15.138:0/2741127521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 msgr2=0x55eeb51c0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 --2- 172.21.15.138:0/2741127521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79bc049510 tx=0x7f79bc049710 comp rx=0 tx=0).stop 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- 172.21.15.138:0/2741127521 shutdown_connections 2024-02-16T10:30:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 --2- 172.21.15.138:0/2741127521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c0530 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- 172.21.15.138:0/2741127521 >> 172.21.15.138:0/2741127521 conn(0x55eeb51bad00 msgr2=0x55eeb51bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- 172.21.15.138:0/2741127521 shutdown_connections 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- 172.21.15.138:0/2741127521 wait complete. 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 Processor -- start 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- start start 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c3da5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eeb51c73c0 con 0x55eeb51c0130 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45740/0 (socket says 172.21.15.138:45740) 2024-02-16T10:30:49.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 learned_addr learned my addr 172.21.15.138:0/3633764380 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eeb51b4900 con 0x55eeb51c0130 2024-02-16T10:30:49.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.764+0000 7f79c20c1640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02b920 tx=0x7f79bc0494a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 -- 172.21.15.138:0/3633764380 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc034070 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 -- 172.21.15.138:0/3633764380 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc02b760 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eeb51c75c0 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 -- 172.21.15.138:0/3633764380 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79bc0498a0 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eeb51c79f0 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 -- 172.21.15.138:0/3633764380 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79bc049a00 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f788c034300 0x7f788c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f78937fe640 1 -- 172.21.15.138:0/3633764380 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f79bc02e540 con 0x55eeb51c0130 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c18c0640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f788c034300 0x7f788c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb51d2550 0x55eeb51d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d5160 con 0x55eeb51d2550 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb51d2550 0x55eeb51d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c18c0640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f788c034300 0x7f788c0367c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79b40e3010 tx=0x7f79b40e1000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb51d2550 0x55eeb51d4a10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 realm 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d1ac0 con 0x55eeb51d2550 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d5c30 con 0x55eeb51d2550 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d6140 con 0x55eeb51d2550 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d58d0 con 0x55eeb51d2550 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 20 searching for the correct realm 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55eeb51d8430 0x55eeb51da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dafa0 con 0x55eeb51d8430 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c20c1640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55eeb51d8430 0x55eeb51da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.768+0000 7f79c20c1640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55eeb51d8430 0x55eeb51da8d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c20c1640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f79bc014850 0x7f79bc02d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79bc014850 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c18c0640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f79bc014850 0x7f79bc02d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c18c0640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f79bc014850 0x7f79bc02d900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b40b58d0 con 0x7f79bc014850 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c18c0640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f79b40ab030 0x7f79b40b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79b40ab030 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f79b40ab030 0x7f79b40b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f79b40ab030 0x7f79b40b4600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x55eeb51d2550 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x55eeb51d2550 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79b40ab030 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.772+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79b40ab030 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79bc014850 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x55eeb51d8430 2024-02-16T10:30:49.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x55eeb51d2550 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79bc039030 con 0x7f79b40ab030 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d2550 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79bc014850 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79b40ab030 2024-02-16T10:30:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.776+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d2550 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d2550 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79b40ab030 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79bc014850 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d2550 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79b40ab030 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79b40ab030 2024-02-16T10:30:49.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79bc014850 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.780+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d8430 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79bc00a4d0 con 0x55eeb51d8430 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79b40ab030 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x55eeb51d2550 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f79b802e040 con 0x7f79bc014850 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d6f10 con 0x55eeb51d2550 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d72c0 con 0x55eeb51d2550 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d72c0 con 0x7f79bc014850 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 zone default found 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 4 Realm: () 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 zonegroup default 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51d7b90 con 0x7f79b40ab030 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dce10 con 0x55eeb51d8430 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79bc06a040 con 0x55eeb51d8430 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dd170 con 0x55eeb51d8430 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f79bc06a040 con 0x55eeb51d8430 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 started sync module instance, tier type = 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.784+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dc2a0 con 0x7f79bc014850 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483729202688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dcaa0 con 0x7f79bc014850 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51ddca0 con 0x55eeb51d2550 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483729202688] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483729209216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51de050 con 0x55eeb51d2550 2024-02-16T10:30:49.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.788+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dea00 con 0x55eeb51d8430 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483729209216] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79bc06a040 con 0x55eeb51d8430 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483729204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51de9c0 con 0x55eeb51d8430 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51df3f0 con 0x7f79bc014850 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483729215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51dfc40 con 0x7f79bc014850 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e0610 con 0x55eeb51d2550 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483729204736] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79bc06a040 con 0x55eeb51d8430 2024-02-16T10:30:49.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.792+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483729215312] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483729217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51de520 con 0x55eeb51d2550 2024-02-16T10:30:49.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e0e90 con 0x7f79b40ab030 2024-02-16T10:30:49.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483729217440] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483729219856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e0dc0 con 0x7f79b40ab030 2024-02-16T10:30:49.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.796+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e1730 con 0x7f79b40ab030 2024-02-16T10:30:49.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483729219856] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483729222192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e1730 con 0x7f79b40ab030 2024-02-16T10:30:49.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e20a0 con 0x7f79b40ab030 2024-02-16T10:30:49.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483729222192] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483729224336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e2280 con 0x7f79b40ab030 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=0 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=1 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=2 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=3 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=4 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=5 2024-02-16T10:30:49.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.800+0000 7f79c3da5980 20 add_watcher() i=6 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483729224336] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 add_watcher() i=7 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e5460 con 0x55eeb51d2550 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483729239648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb51e2220 con 0x55eeb51d2550 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483729239648] v31'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f78737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 5 note: GC not initialized 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f78727fc640 20 reqs_thread_entry: start 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 Filter name: none 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f77e3fff640 20 reqs_thread_entry: start 2024-02-16T10:30:49.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206ed0 con 0x55eeb51d2550 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206ed0 con 0x7f79bc014850 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.804+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f78737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483729239648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x55eeb51d2550 2024-02-16T10:30:49.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94483729239648] v31'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483729202688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x7f79bc014850 2024-02-16T10:30:49.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94483729202688] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c3da5980 20 remove_watcher() i=0 2024-02-16T10:30:49.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c3da5980 2 removed watcher, disabling cache 2024-02-16T10:30:49.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483729209216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x55eeb51d2550 2024-02-16T10:30:49.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.808+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94483729209216] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 20 remove_watcher() i=1 2024-02-16T10:30:49.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483729204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x55eeb51d8430 2024-02-16T10:30:49.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c20c1640 1 -- 172.21.15.138:0/3633764380 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94483729204736] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79bc06a040 con 0x55eeb51d8430 2024-02-16T10:30:49.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 20 remove_watcher() i=2 2024-02-16T10:30:49.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483729215312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x7f79bc014850 2024-02-16T10:30:49.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c18c0640 1 -- 172.21.15.138:0/3633764380 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94483729215312] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b40fa040 con 0x7f79bc014850 2024-02-16T10:30:49.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 20 remove_watcher() i=3 2024-02-16T10:30:49.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.812+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483729217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x55eeb51d2550 2024-02-16T10:30:49.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94483729217440] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x55eeb51d2550 2024-02-16T10:30:49.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c3da5980 20 remove_watcher() i=4 2024-02-16T10:30:49.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483729219856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x7f79b40ab030 2024-02-16T10:30:49.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94483729219856] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c3da5980 20 remove_watcher() i=5 2024-02-16T10:30:49.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.816+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483729222192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x7f79b40ab030 2024-02-16T10:30:49.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94483729222192] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 20 remove_watcher() i=6 2024-02-16T10:30:49.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483729224336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eeb5206af0 con 0x7f79b40ab030 2024-02-16T10:30:49.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94483729224336] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f79b800e640 con 0x7f79b40ab030 2024-02-16T10:30:49.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 20 remove_watcher() i=7 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f79b40ab030 msgr2=0x7f79b40b4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f79b40ab030 0x7f79b40b4600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb51d2550 msgr2=0x55eeb51d4a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb51d2550 0x55eeb51d4a10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f79bc014850 msgr2=0x7f79bc02d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f79bc014850 0x7f79bc02d900 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55eeb51d8430 msgr2=0x55eeb51da8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55eeb51d8430 0x55eeb51da8d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f788c034300 msgr2=0x7f788c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f788c034300 0x7f788c0367c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79b40e3010 tx=0x7f79b40e1000 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c10bf640 1 -- 172.21.15.138:0/3633764380 reap_dead start 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 msgr2=0x55eeb51c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02b920 tx=0x7f79bc0494a0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 shutdown_connections 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/3633764380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51c0130 0x55eeb51c6e80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 >> 172.21.15.138:0/3633764380 conn(0x55eeb51bad00 msgr2=0x55eeb51bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 shutdown_connections 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/3633764380 wait complete. 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 msgr2=0x7f789c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 0x7f789c036770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55eeb51a0620 tx=0x7f79b40e1e30 comp rx=0 tx=0).stop 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 msgr2=0x55eeb51b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55eeb5199600 tx=0x7f79bc018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 shutdown_connections 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f789c0342b0 0x7f789c036770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/641066857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb51b3200 0x55eeb51b3620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 >> 172.21.15.138:0/641066857 conn(0x55eeb51a8010 msgr2=0x55eeb51a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 shutdown_connections 2024-02-16T10:30:49.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/641066857 wait complete. 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 msgr2=0x55eeb519f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 0x55eeb519f6f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 msgr2=0x55eeb51a4d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 0x55eeb51a4d00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 msgr2=0x7f78a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 0x7f78a8036770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f79b8000f70 tx=0x7f79b80010b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 msgr2=0x55eeb5198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f79b401b0b0 tx=0x7f79b4018020 comp rx=0 tx=0).stop 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 shutdown_connections 2024-02-16T10:30:49.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55eeb51a14a0 0x55eeb51a4d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55eeb50a80f0 0x55eeb519f6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f78a80342b0 0x7f78a8036770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 --2- 172.21.15.138:0/252608518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55eeb50a77d0 0x55eeb5198a00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 >> 172.21.15.138:0/252608518 conn(0x55eeb501aef0 msgr2=0x55eeb518c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 shutdown_connections 2024-02-16T10:30:49.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.820+0000 7f79c3da5980 1 -- 172.21.15.138:0/252608518 wait complete. 2024-02-16T10:30:49.838 INFO:teuthology.orchestra.run.smithi138.stdout:["myfoo"] 2024-02-16T10:30:49.839 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T10:30:49.846 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:49.846 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-02-16T10:30:49.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-02-16T10:30:49.847 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-02-16T10:30:49.913 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:49.913 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:49.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.904+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.904+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.904+0000 7fc057fd4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5601cc4ae740 0x5601cc53f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.904+0000 7fc057fd4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5601cc486b40 con 0x5601cc53fb80 2024-02-16T10:30:49.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.904+0000 7fc057fd4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5601cc44dd30 con 0x5601cc4ae740 2024-02-16T10:30:49.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5601cc4ae740 0x5601cc53f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5601cc4ae740 0x5601cc53f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45752/0 (socket says 172.21.15.138:45752) 2024-02-16T10:30:49.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 -- 172.21.15.138:0/3240323742 learned_addr learned my addr 172.21.15.138:0/3240323742 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 -- 172.21.15.138:0/3240323742 >> v1:172.21.15.107:6789/0 conn(0x5601cc53fb80 legacy=0x5601cc541f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 -- 172.21.15.138:0/3240323742 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601cc5446a0 con 0x5601cc4ae740 2024-02-16T10:30:49.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc055aef640 1 --2- 172.21.15.138:0/3240323742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc53f640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc04800a4e0 tx=0x7fc04801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890dc16fa7f850db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc054aed640 1 -- 172.21.15.138:0/3240323742 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480aa540 con 0x5601cc4ae740 2024-02-16T10:30:49.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc054aed640 1 -- 172.21.15.138:0/3240323742 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0480a6070 con 0x5601cc4ae740 2024-02-16T10:30:49.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc054aed640 1 -- 172.21.15.138:0/3240323742 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480aa850 con 0x5601cc4ae740 2024-02-16T10:30:49.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc057fd4980 1 -- 172.21.15.138:0/3240323742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 msgr2=0x5601cc53f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc057fd4980 1 --2- 172.21.15.138:0/3240323742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc53f640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc04800a4e0 tx=0x7fc04801b090 comp rx=0 tx=0).stop 2024-02-16T10:30:49.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc057fd4980 1 -- 172.21.15.138:0/3240323742 shutdown_connections 2024-02-16T10:30:49.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc057fd4980 1 --2- 172.21.15.138:0/3240323742 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc53f640 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.908+0000 7fc057fd4980 1 -- 172.21.15.138:0/3240323742 >> 172.21.15.138:0/3240323742 conn(0x5601cc534d60 msgr2=0x5601cc537180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.912+0000 7fc057fd4980 1 -- 172.21.15.138:0/3240323742 shutdown_connections 2024-02-16T10:30:49.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.912+0000 7fc057fd4980 1 -- 172.21.15.138:0/3240323742 wait complete. 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cc44afc0 con 0x5601cc4ae740 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc055aef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc055aef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45762/0 (socket says 172.21.15.138:45762) 2024-02-16T10:30:49.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc055aef640 1 -- 172.21.15.138:0/2148429757 learned_addr learned my addr 172.21.15.138:0/2148429757 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc055aef640 1 -- 172.21.15.138:0/2148429757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04800a1c0 con 0x5601cc4ae740 2024-02-16T10:30:49.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc055aef640 1 --2- 172.21.15.138:0/2148429757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc048019740 tx=0x7fc0480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f690f787792ed server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fbf43e07640 1 -- 172.21.15.138:0/2148429757 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480aa6f0 con 0x5601cc4ae740 2024-02-16T10:30:49.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fbf43e07640 1 -- 172.21.15.138:0/2148429757 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0480aa850 con 0x5601cc4ae740 2024-02-16T10:30:49.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fbf43e07640 1 -- 172.21.15.138:0/2148429757 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480aaaf0 con 0x5601cc4ae740 2024-02-16T10:30:49.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 -- 172.21.15.138:0/2148429757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 msgr2=0x5601cc6268a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 --2- 172.21.15.138:0/2148429757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc048019740 tx=0x7fc0480033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 -- 172.21.15.138:0/2148429757 shutdown_connections 2024-02-16T10:30:49.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 --2- 172.21.15.138:0/2148429757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc6268a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.924+0000 7fc057fd4980 1 -- 172.21.15.138:0/2148429757 >> 172.21.15.138:0/2148429757 conn(0x5601cc534d60 msgr2=0x5601cc622430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- 172.21.15.138:0/2148429757 shutdown_connections 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- 172.21.15.138:0/2148429757 wait complete. 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cc4467a0 con 0x5601cc4ae740 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc055aef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc055aef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45776/0 (socket says 172.21.15.138:45776) 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc055aef640 1 -- 172.21.15.138:0/1040597516 learned_addr learned my addr 172.21.15.138:0/1040597516 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc055aef640 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601cc5446a0 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc055aef640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc048019740 tx=0x7fc048017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 -- 172.21.15.138:0/1040597516 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480c4070 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 -- 172.21.15.138:0/1040597516 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0480b5780 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 -- 172.21.15.138:0/1040597516 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0480b5a20 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601cc62db50 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601cc62e000 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 -- 172.21.15.138:0/1040597516 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc0480a8070 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 0x7fbf3c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fbf42604640 1 -- 172.21.15.138:0/1040597516 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc0480e3d20 con 0x5601cc4ae740 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc0552ee640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 0x7fbf3c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 0x5601cc634300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc634840 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.928+0000 7fc0562f0640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 0x5601cc634300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0552ee640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 0x7fbf3c0367c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc040000f70 tx=0x7fc040001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 0x5601cc634300 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1040597516 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0500083f0 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc634c50 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1040597516 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0500083f0 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc636500 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1040597516 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc0500083f0 con 0x5601cc53fb80 2024-02-16T10:30:49.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc635700 con 0x5601cc53fb80 2024-02-16T10:30:49.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1040597516 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0500083f0 con 0x5601cc53fb80 2024-02-16T10:30:49.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 0x5601cc639880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc639ed0 con 0x5601cc636020 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc055aef640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 0x5601cc639880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc055aef640 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 0x5601cc639880 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc055aef640 1 -- 172.21.15.138:0/1040597516 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc0480c9480 con 0x5601cc636020 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc057fd4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cc3def20 con 0x5601cc647e70 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45780/0 (socket says 172.21.15.138:45780) 2024-02-16T10:30:49.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1758572889 learned_addr learned my addr 172.21.15.138:0/1758572889 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 -- 172.21.15.138:0/1758572889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601cc6487d0 con 0x5601cc647e70 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.932+0000 7fc0562f0640 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5601cc62e860 tx=0x7fc05000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 -- 172.21.15.138:0/1758572889 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05000f040 con 0x5601cc647e70 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601cc648a20 con 0x5601cc647e70 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601cc649570 con 0x5601cc647e70 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 -- 172.21.15.138:0/1758572889 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc050019550 con 0x5601cc647e70 2024-02-16T10:30:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 -- 172.21.15.138:0/1758572889 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0500197f0 con 0x5601cc647e70 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 -- 172.21.15.138:0/1758572889 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc050019950 con 0x5601cc647e70 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 0x7fbf30036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf3b7fe640 1 -- 172.21.15.138:0/1758572889 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc05004b440 con 0x5601cc647e70 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc055aef640 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 0x7fbf30036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc055aef640 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 0x7fbf30036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5601cc635140 tx=0x7fc0480d0440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cc3d2790 con 0x5601cc654e10 2024-02-16T10:30:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45792/0 (socket says 172.21.15.138:45792) 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc0562f0640 1 -- 172.21.15.138:0/181756277 learned_addr learned my addr 172.21.15.138:0/181756277 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc0562f0640 1 -- 172.21.15.138:0/181756277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601cc6557e0 con 0x5601cc654e10 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc0562f0640 1 --2- 172.21.15.138:0/181756277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc050008b60 tx=0x7fc050015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c3101d59a4ddcd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf397fa640 1 -- 172.21.15.138:0/181756277 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc050048070 con 0x5601cc654e10 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf397fa640 1 -- 172.21.15.138:0/181756277 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05003a070 con 0x5601cc654e10 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fbf397fa640 1 -- 172.21.15.138:0/181756277 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05004b110 con 0x5601cc654e10 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/181756277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 msgr2=0x5601cc655210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 --2- 172.21.15.138:0/181756277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc050008b60 tx=0x7fc050015f90 comp rx=0 tx=0).stop 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/181756277 shutdown_connections 2024-02-16T10:30:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 --2- 172.21.15.138:0/181756277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc655210 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/181756277 >> 172.21.15.138:0/181756277 conn(0x5601cc64f990 msgr2=0x5601cc650870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/181756277 shutdown_connections 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.936+0000 7fc057fd4980 1 -- 172.21.15.138:0/181756277 wait complete. 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 Processor -- start 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- start start 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cc65bf90 con 0x5601cc654e10 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0562f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45798/0 (socket says 172.21.15.138:45798) 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 learned_addr learned my addr 172.21.15.138:0/999713980 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:49.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601cc649570 con 0x5601cc654e10 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0562f0640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc050008b60 tx=0x7fc0500497c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 -- 172.21.15.138:0/999713980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc05003b3b0 con 0x5601cc654e10 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5601cc65c190 con 0x5601cc654e10 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 -- 172.21.15.138:0/999713980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05003b510 con 0x5601cc654e10 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 -- 172.21.15.138:0/999713980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc050022580 con 0x5601cc654e10 2024-02-16T10:30:49.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601cc65c620 con 0x5601cc654e10 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 -- 172.21.15.138:0/999713980 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc050032020 con 0x5601cc654e10 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf200342b0 0x7fbf20036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fbf277fe640 1 -- 172.21.15.138:0/999713980 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc050036c80 con 0x5601cc654e10 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc055aef640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf200342b0 0x7fbf20036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc6671e0 0x5601cc669680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc669dd0 con 0x5601cc6671e0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0552ee640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc6671e0 0x5601cc669680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc055aef640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf200342b0 0x7fbf20036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0480d0ff0 tx=0x7fc0480e8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0552ee640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc6671e0 0x5601cc669680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 20 realm 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.940+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc666700 con 0x5601cc6671e0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66a850 con 0x5601cc6671e0 2024-02-16T10:30:49.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66b0d0 con 0x5601cc6671e0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66b430 con 0x5601cc6671e0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 20 searching for the correct realm 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5601cc66d150 0x5601cc66f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66fc50 con 0x5601cc66d150 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0562f0640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5601cc66d150 0x5601cc66f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0562f0640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5601cc66d150 0x5601cc66f580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050041070 con 0x5601cc66d150 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0562f0640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc050022070 0x7fc05002b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc055aef640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc050022070 0x7fc05002b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc055aef640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc050022070 0x7fc05002b840 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc055aef640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc0480fd040 0x7fc0480e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc0480fd040 0x7fc0480e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.944+0000 7fc0552ee640 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc0480fd040 0x7fc0480e32c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050041070 con 0x5601cc66d150 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050041070 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.948+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.952+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc66d150 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc0480fd040 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x5601cc6671e0 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc050056040 con 0x7fc050022070 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:49.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bc30 con 0x5601cc6671e0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x5601cc6671e0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66c3c0 con 0x7fc050022070 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 zone default found 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 4 Realm: () 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 zonegroup default 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6700e0 con 0x7fc0480fd040 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671f60 con 0x5601cc66d150 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6722c0 con 0x5601cc66d150 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 started sync module instance, tier type = 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.956+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671530 con 0x7fc050022070 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565724262544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6722c0 con 0x7fc050022070 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc672c30 con 0x5601cc6671e0 2024-02-16T10:30:49.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565724262544] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565724268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc672bb0 con 0x5601cc6671e0 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.960+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc673920 con 0x5601cc66d150 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565724268432] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565724270560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6738a0 con 0x5601cc66d150 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565724274288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674b60 con 0x7fc050022070 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc675570 con 0x5601cc6671e0 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.964+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565724270560] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565724274288] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565724271616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6746c0 con 0x5601cc6671e0 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc675dc0 con 0x7fc0480fd040 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565724271616] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565724278880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6746c0 con 0x7fc0480fd040 2024-02-16T10:30:49.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.968+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc676310 con 0x7fc0480fd040 2024-02-16T10:30:49.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565724278880] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565724282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc6762d0 con 0x7fc0480fd040 2024-02-16T10:30:49.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc676cc0 con 0x7fc0480fd040 2024-02-16T10:30:49.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565724282352] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565724284832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc676c80 con 0x7fc0480fd040 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=0 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=1 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=2 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=3 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=4 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=5 2024-02-16T10:30:49.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.972+0000 7fc057fd4980 20 add_watcher() i=6 2024-02-16T10:30:49.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565724284832] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 20 add_watcher() i=7 2024-02-16T10:30:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc67a100 con 0x5601cc6671e0 2024-02-16T10:30:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565724280672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc677610 con 0x5601cc6671e0 2024-02-16T10:30:49.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565724280672] v31'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fbf077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 5 note: GC not initialized 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fbf067fc640 20 reqs_thread_entry: start 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 20 Filter name: none 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fbe77fff640 20 reqs_thread_entry: start 2024-02-16T10:30:49.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.976+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc69b710 con 0x5601cc66d150 2024-02-16T10:30:49.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671f60 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671f60 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x7fc050022070 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.980+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.984+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc0480fd040 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc6671e0 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x5601cc66d150 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc674310 con 0x7fc050022070 2024-02-16T10:30:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc057fd4980 20 RGWRados::pool_iterate: got myfoo 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.988+0000 7fc057fd4980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fbf077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565724280672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671f60 con 0x5601cc6671e0 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94565724280672] v31'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565724262544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x7fc050022070 2024-02-16T10:30:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94565724262544] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc057fd4980 20 remove_watcher() i=0 2024-02-16T10:30:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc057fd4980 2 removed watcher, disabling cache 2024-02-16T10:30:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.992+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565724268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x5601cc6671e0 2024-02-16T10:30:50.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94565724268432] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:50.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 20 remove_watcher() i=1 2024-02-16T10:30:50.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565724270560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc66bfe0 con 0x5601cc66d150 2024-02-16T10:30:50.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc0562f0640 1 -- 172.21.15.138:0/999713980 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94565724270560] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc050060040 con 0x5601cc66d150 2024-02-16T10:30:50.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 20 remove_watcher() i=2 2024-02-16T10:30:50.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565724274288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc671090 con 0x7fc050022070 2024-02-16T10:30:50.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc055aef640 1 -- 172.21.15.138:0/999713980 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94565724274288] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc0480c9480 con 0x7fc050022070 2024-02-16T10:30:50.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 20 remove_watcher() i=3 2024-02-16T10:30:50.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:49.996+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565724271616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc672790 con 0x5601cc6671e0 2024-02-16T10:30:50.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94565724271616] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x5601cc6671e0 2024-02-16T10:30:50.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc057fd4980 20 remove_watcher() i=4 2024-02-16T10:30:50.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565724278880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc673e70 con 0x7fc0480fd040 2024-02-16T10:30:50.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94565724278880] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:50.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc057fd4980 20 remove_watcher() i=5 2024-02-16T10:30:50.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.000+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565724282352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc673e70 con 0x7fc0480fd040 2024-02-16T10:30:50.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94565724282352] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:50.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 20 remove_watcher() i=6 2024-02-16T10:30:50.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565724284832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5601cc673e70 con 0x7fc0480fd040 2024-02-16T10:30:50.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94565724284832] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc04000bdd0 con 0x7fc0480fd040 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 20 remove_watcher() i=7 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc0480fd040 msgr2=0x7fc0480e32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc0480fd040 0x7fc0480e32c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc6671e0 msgr2=0x5601cc669680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc6671e0 0x5601cc669680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc050022070 msgr2=0x7fc05002b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc050022070 0x7fc05002b840 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5601cc66d150 msgr2=0x5601cc66f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5601cc66d150 0x5601cc66f580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf200342b0 msgr2=0x7fbf20036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf200342b0 0x7fbf20036770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0480d0ff0 tx=0x7fc0480e8000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 msgr2=0x5601cc65ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc0552ee640 1 -- 172.21.15.138:0/999713980 reap_dead start 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc050008b60 tx=0x7fc0500497c0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 shutdown_connections 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 --2- 172.21.15.138:0/999713980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc654e10 0x5601cc65ba50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.004+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 >> 172.21.15.138:0/999713980 conn(0x5601cc64f990 msgr2=0x5601cc650870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 shutdown_connections 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/999713980 wait complete. 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 msgr2=0x7fbf30036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 0x7fbf30036770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5601cc635140 tx=0x7fc0480d0440 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 msgr2=0x5601cc648290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5601cc62e860 tx=0x7fc05000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 shutdown_connections 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf300342b0 0x7fbf30036770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1758572889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc647e70 0x5601cc648290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 >> 172.21.15.138:0/1758572889 conn(0x5601cc63cc80 msgr2=0x5601cc63d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 shutdown_connections 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1758572889 wait complete. 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 msgr2=0x5601cc634300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 0x5601cc634300 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 msgr2=0x5601cc639880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 0x5601cc639880 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 msgr2=0x7fbf3c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 0x7fbf3c0367c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc040000f70 tx=0x7fc040001420 comp rx=0 tx=0).stop 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 msgr2=0x5601cc62d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc048019740 tx=0x7fc048017e30 comp rx=0 tx=0).stop 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 shutdown_connections 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5601cc636020 0x5601cc639880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5601cc53fb80 0x5601cc634300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbf3c034300 0x7fbf3c0367c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 --2- 172.21.15.138:0/1040597516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5601cc4ae740 0x5601cc62d610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 >> 172.21.15.138:0/1040597516 conn(0x5601cc534d60 msgr2=0x5601cc620f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 shutdown_connections 2024-02-16T10:30:50.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.008+0000 7fc057fd4980 1 -- 172.21.15.138:0/1040597516 wait complete. 2024-02-16T10:30:50.027 INFO:teuthology.orchestra.run.smithi138.stdout:["myfoo"] 2024-02-16T10:30:50.027 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-02-16T10:30:50.042 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.059 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.073 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.116 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-02-16T10:30:50.159 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.208 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.265 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:50.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:50.266 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:30:50.298 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:50.299 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d7216980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2e716b7e0 0x55d2e7169d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d7216980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d2e7141b50 con 0x55d2e716a2d0 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d7216980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d2e7108d30 con 0x55d2e716b7e0 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d4d31640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2e716b7e0 0x55d2e7169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23cffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55d2e716a2d0 0x55d2e71fd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52170/0 (socket says 172.21.15.138:52170) 2024-02-16T10:30:50.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d4d31640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d2e716b7e0 0x55d2e7169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45804/0 (socket says 172.21.15.138:45804) 2024-02-16T10:30:50.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23cffff640 1 -- 172.21.15.138:0/3828312155 learned_addr learned my addr 172.21.15.138:0/3828312155 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:50.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d4d31640 1 -- 172.21.15.138:0/3828312155 >> v1:172.21.15.107:6789/0 conn(0x55d2e716a2d0 legacy=0x55d2e71fd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.292+0000 7f23d4d31640 1 -- 172.21.15.138:0/3828312155 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e716a6e0 con 0x55d2e716b7e0 2024-02-16T10:30:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d4d31640 1 --2- 172.21.15.138:0/3828312155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716b7e0 0x55d2e7169d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23c000a480 tx=0x7f23c001b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7528d3a7c252fc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23cf7fe640 1 -- 172.21.15.138:0/3828312155 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c00aa400 con 0x55d2e716b7e0 2024-02-16T10:30:50.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23cf7fe640 1 -- 172.21.15.138:0/3828312155 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c00a6050 con 0x55d2e716b7e0 2024-02-16T10:30:50.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23cf7fe640 1 -- 172.21.15.138:0/3828312155 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c00aa6b0 con 0x55d2e716b7e0 2024-02-16T10:30:50.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 -- 172.21.15.138:0/3828312155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716b7e0 msgr2=0x55d2e7169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 --2- 172.21.15.138:0/3828312155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716b7e0 0x55d2e7169d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23c000a480 tx=0x7f23c001b220 comp rx=0 tx=0).stop 2024-02-16T10:30:50.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 -- 172.21.15.138:0/3828312155 shutdown_connections 2024-02-16T10:30:50.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 --2- 172.21.15.138:0/3828312155 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716b7e0 0x55d2e7169d90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 -- 172.21.15.138:0/3828312155 >> 172.21.15.138:0/3828312155 conn(0x55d2e71f0eb0 msgr2=0x55d2e71f32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 -- 172.21.15.138:0/3828312155 shutdown_connections 2024-02-16T10:30:50.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.296+0000 7f23d7216980 1 -- 172.21.15.138:0/3828312155 wait complete. 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d7216980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d7216980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e7105fc0 con 0x55d2e716a2d0 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d4d31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d4d31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45806/0 (socket says 172.21.15.138:45806) 2024-02-16T10:30:50.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d4d31640 1 -- 172.21.15.138:0/3931454889 learned_addr learned my addr 172.21.15.138:0/3931454889 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d4d31640 1 -- 172.21.15.138:0/3931454889 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0005d30 con 0x55d2e716a2d0 2024-02-16T10:30:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f23d4d31640 1 --2- 172.21.15.138:0/3931454889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23c0018eb0 tx=0x7f23c0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9a1e84ac2d2de server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f22c2e05640 1 -- 172.21.15.138:0/3931454889 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c000a330 con 0x55d2e716a2d0 2024-02-16T10:30:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.308+0000 7f22c2e05640 1 -- 172.21.15.138:0/3931454889 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c00b4410 con 0x55d2e716a2d0 2024-02-16T10:30:50.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f22c2e05640 1 -- 172.21.15.138:0/3931454889 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c00b46b0 con 0x55d2e716a2d0 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/3931454889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 msgr2=0x55d2e72e1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 --2- 172.21.15.138:0/3931454889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f23c0018eb0 tx=0x7f23c0003030 comp rx=0 tx=0).stop 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/3931454889 shutdown_connections 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 --2- 172.21.15.138:0/3931454889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e1de0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/3931454889 >> 172.21.15.138:0/3931454889 conn(0x55d2e71f0eb0 msgr2=0x55d2e72dd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/3931454889 shutdown_connections 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/3931454889 wait complete. 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e71017a0 con 0x55d2e716a2d0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d4d31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d4d31640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45808/0 (socket says 172.21.15.138:45808) 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d4d31640 1 -- 172.21.15.138:0/66184868 learned_addr learned my addr 172.21.15.138:0/66184868 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d4d31640 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e716a6e0 con 0x55d2e716a2d0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d4d31640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23c0018eb0 tx=0x7f23c0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f22c1602640 1 -- 172.21.15.138:0/66184868 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c00c3070 con 0x55d2e716a2d0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e72e9090 con 0x55d2e716a2d0 2024-02-16T10:30:50.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f22c1602640 1 -- 172.21.15.138:0/66184868 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c00bc610 con 0x55d2e716a2d0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f22c1602640 1 -- 172.21.15.138:0/66184868 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23c00bc8b0 con 0x55d2e716a2d0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e72e95a0 con 0x55d2e716a2d0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.312+0000 7f22c1602640 1 -- 172.21.15.138:0/66184868 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f23c00b1070 con 0x55d2e716a2d0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f22c1602640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 0x7f22bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f22c1602640 1 -- 172.21.15.138:0/66184868 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f23c00e3d40 con 0x55d2e716a2d0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23cffff640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 0x7f22bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 0x55d2e72ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e72efd80 con 0x55d2e716b7e0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 0x55d2e72ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23cffff640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 0x7f22bc036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f70 tx=0x7f23c80012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 0x55d2e72ef840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 -- 172.21.15.138:0/66184868 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e716b7e0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e72ecf40 con 0x55d2e716b7e0 2024-02-16T10:30:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 -- 172.21.15.138:0/66184868 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e716b7e0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e72f1a80 con 0x55d2e716b7e0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 -- 172.21.15.138:0/66184868 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e716b7e0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e72f0c80 con 0x55d2e716b7e0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 -- 172.21.15.138:0/66184868 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e716b7e0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 0x55d2e72f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e72f5410 con 0x55d2e72f15a0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d4d31640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 0x55d2e72f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d4d31640 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 0x55d2e72f4e00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d4d31640 1 -- 172.21.15.138:0/66184868 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f23c00c8420 con 0x55d2e72f15a0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d7216980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e7099f20 con 0x55d2e73033b0 2024-02-16T10:30:50.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45814/0 (socket says 172.21.15.138:45814) 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.316+0000 7f23d5532640 1 -- 172.21.15.138:0/4195157683 learned_addr learned my addr 172.21.15.138:0/4195157683 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 -- 172.21.15.138:0/4195157683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e7303d10 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55d2e72e9da0 tx=0x7f23d0018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 -- 172.21.15.138:0/4195157683 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d001d070 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 -- 172.21.15.138:0/4195157683 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0014450 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e7303f60 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 -- 172.21.15.138:0/4195157683 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d00146f0 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e7304ab0 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 -- 172.21.15.138:0/4195157683 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f23d0020020 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 0x7f22ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f22ba7fc640 1 -- 172.21.15.138:0/4195157683 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f23d004b190 con 0x55d2e73033b0 2024-02-16T10:30:50.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d4d31640 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 0x7f22ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d4d31640 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 0x7f22ac036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55d2e72f06c0 tx=0x7f23c00053a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d7216980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e708d790 con 0x55d2e7310350 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45824/0 (socket says 172.21.15.138:45824) 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 -- 172.21.15.138:0/3417618128 learned_addr learned my addr 172.21.15.138:0/3417618128 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 -- 172.21.15.138:0/3417618128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e7310d40 con 0x55d2e7310350 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.320+0000 7f23d5532640 1 --2- 172.21.15.138:0/3417618128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23d00494c0 tx=0x7f23d00480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51f16cd83ab2b00 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22abfff640 1 -- 172.21.15.138:0/3417618128 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0013630 con 0x55d2e7310350 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22abfff640 1 -- 172.21.15.138:0/3417618128 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d003b050 con 0x55d2e7310350 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22abfff640 1 -- 172.21.15.138:0/3417618128 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0012560 con 0x55d2e7310350 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/3417618128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 msgr2=0x55d2e7310770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 --2- 172.21.15.138:0/3417618128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23d00494c0 tx=0x7f23d00480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/3417618128 shutdown_connections 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 --2- 172.21.15.138:0/3417618128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e7310770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/3417618128 >> 172.21.15.138:0/3417618128 conn(0x55d2e730aed0 msgr2=0x55d2e730bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/3417618128 shutdown_connections 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/3417618128 wait complete. 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 Processor -- start 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- start start 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e7317610 con 0x55d2e7310350 2024-02-16T10:30:50.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d5532640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45840/0 (socket says 172.21.15.138:45840) 2024-02-16T10:30:50.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 learned_addr learned my addr 172.21.15.138:0/1554498398 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e7304ab0 con 0x55d2e7310350 2024-02-16T10:30:50.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d5532640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23d0012f90 tx=0x7f23d0049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22aa7fc640 1 -- 172.21.15.138:0/1554498398 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0034070 con 0x55d2e7310350 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22aa7fc640 1 -- 172.21.15.138:0/1554498398 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d002be80 con 0x55d2e7310350 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2e7317810 con 0x55d2e7310350 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f22aa7fc640 1 -- 172.21.15.138:0/1554498398 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0013630 con 0x55d2e7310350 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e7317c40 con 0x55d2e7310350 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.324+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f22aa7fc640 1 -- 172.21.15.138:0/1554498398 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f23d0013800 con 0x55d2e7310350 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f22aa7fc640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22a00342b0 0x7f22a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f22aa7fc640 1 -- 172.21.15.138:0/1554498398 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f23d004ccd0 con 0x55d2e7310350 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22a00342b0 0x7f22a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e7322760 0x55d2e7324c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7325370 con 0x55d2e7322760 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e7322760 0x55d2e7324c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22a00342b0 0x7f22a0036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f23c00c8730 tx=0x7f23c00db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e7322760 0x55d2e7324c20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 realm 2024-02-16T10:30:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7321cd0 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7325e40 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7326350 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7325ae0 con 0x55d2e7322760 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 20 searching for the correct realm 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d2e7328640 0x55d2e732ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x55d2e7328640 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d5532640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d2e7328640 0x55d2e732ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d5532640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d2e7328640 0x55d2e732ab00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d5532640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f23d0056040 0x7f23d0011810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x7f23d0056040 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f23d0056040 0x7f23d0011810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f23d0056040 0x7f23d0011810 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f23c0009040 0x7f23c00a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.328+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x7f23c0009040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f23c0009040 0x7f23c00a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f23c0009040 0x7f23c00a9820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x55d2e7322760 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x55d2e7322760 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x7f23c0009040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b1d0 con 0x7f23c0009040 2024-02-16T10:30:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23d0056040 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.332+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23d0056040 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.336+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23d0056040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23d0056040 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7328640 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23c0009040 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x55d2e7322760 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.340+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f23c802b040 con 0x7f23d0056040 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:50.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7327250 con 0x55d2e7322760 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7326ed0 con 0x55d2e7322760 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7327b20 con 0x7f23d0056040 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 zone default found 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 4 Realm: () 2024-02-16T10:30:50.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 zonegroup default 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732b660 con 0x7f23c0009040 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732d4e0 con 0x55d2e7328640 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732d840 con 0x55d2e7328640 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 started sync module instance, tier type = 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:50.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732ca60 con 0x7f23d0056040 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94364310357440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732d840 con 0x7f23d0056040 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.344+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732e1b0 con 0x55d2e7322760 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94364310357440] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94364310363408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732e130 con 0x55d2e7322760 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732eea0 con 0x55d2e7328640 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94364310366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732ee60 con 0x55d2e7328640 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732fdf0 con 0x7f23d0056040 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.348+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94364310363408] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364310370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73301a0 con 0x7f23d0056040 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7330b10 con 0x55d2e7322760 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94364310366720] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94364310370544] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94364310365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7330670 con 0x55d2e7322760 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7331360 con 0x7f23c0009040 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.352+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94364310365536] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364310368896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7331060 con 0x7f23c0009040 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7331860 con 0x7f23c0009040 2024-02-16T10:30:50.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364310377024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7331ca0 con 0x7f23c0009040 2024-02-16T10:30:50.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7332770 con 0x7f23c0009040 2024-02-16T10:30:50.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94364310368896] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.356+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94364310377024] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94364310381136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7331700 con 0x7f23c0009040 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=0 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=1 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=2 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=3 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=4 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=5 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=6 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94364310381136] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 add_watcher() i=7 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7335760 con 0x55d2e7322760 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94364310375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7332ca0 con 0x55d2e7322760 2024-02-16T10:30:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94364310375360] v31'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f228b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f23d7216980 5 note: GC not initialized 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.360+0000 7f228a7e4640 20 reqs_thread_entry: start 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 Filter name: none 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f22837fe640 20 reqs_thread_entry: start 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73575d0 con 0x7f23d0056040 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7357ba0 con 0x55d2e7322760 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(63 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7356c50 con 0x7f23d0056040 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7359140 con 0x55d2e7322760 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 4.21 4:84770a22:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7358740 con 0x7f23c0009040 2024-02-16T10:30:50.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 4.26 4:67063283:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e735dc60 con 0x7f23c0009040 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 4.2a 4:54a76138:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7360480 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 4.2f 4:f5540289:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7362ca0 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 4.2f 4:f6dbaf5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73654c0 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 4.2f 4:f765b22e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7367d20 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e736a740 con 0x7f23d0056040 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 4.32 4:4e4a0ab4:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e736d160 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:74 4.d 4:b229da45:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e736ffd0 con 0x55d2e7328640 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 4.c 4:32cbddb3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e7372a50 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 4.4 4:208ef0a8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73753f0 con 0x7f23c0009040 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(70 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(71 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(67 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(76 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(66 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.1d 6:bf22f782:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e736e780 con 0x7f23c0009040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.364+0000 7f23d7216980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f228b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94364310375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x55d2e7322760 2024-02-16T10:30:50.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94364310375360] v31'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94364310357440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x7f23d0056040 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94364310357440] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d7216980 20 remove_watcher() i=0 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d7216980 2 removed watcher, disabling cache 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.368+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94364310363408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x55d2e7322760 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94364310363408] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 20 remove_watcher() i=1 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94364310366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x55d2e7328640 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d5532640 1 -- 172.21.15.138:0/1554498398 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94364310366720] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23d000a4d0 con 0x55d2e7328640 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 20 remove_watcher() i=2 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94364310370544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x7f23d0056040 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d4d31640 1 -- 172.21.15.138:0/1554498398 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94364310370544] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c00c8420 con 0x7f23d0056040 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 20 remove_watcher() i=3 2024-02-16T10:30:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.372+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94364310365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x55d2e7322760 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94364310365536] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x55d2e7322760 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23d7216980 20 remove_watcher() i=4 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94364310368896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e73353f0 con 0x7f23c0009040 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94364310368896] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23d7216980 20 remove_watcher() i=5 2024-02-16T10:30:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.376+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94364310377024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732f280 con 0x7f23c0009040 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94364310377024] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 20 remove_watcher() i=6 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94364310381136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d2e732f280 con 0x7f23c0009040 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94364310381136] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f23c800e5a0 con 0x7f23c0009040 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 20 remove_watcher() i=7 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f23c0009040 msgr2=0x7f23c00a9820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f23c0009040 0x7f23c00a9820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e7322760 msgr2=0x55d2e7324c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e7322760 0x55d2e7324c20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f23d0056040 msgr2=0x7f23d0011810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f23d0056040 0x7f23d0011810 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d2e7328640 msgr2=0x55d2e732ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.380+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d2e7328640 0x55d2e732ab00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22a00342b0 msgr2=0x7f22a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22a00342b0 0x7f22a0036770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f23c00c8730 tx=0x7f23c00db000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 msgr2=0x55d2e73170d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23cffff640 1 -- 172.21.15.138:0/1554498398 reap_dead start 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23d0012f90 tx=0x7f23d0049450 comp rx=0 tx=0).stop 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 shutdown_connections 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/1554498398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e7310350 0x55d2e73170d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 >> 172.21.15.138:0/1554498398 conn(0x55d2e730aed0 msgr2=0x55d2e730bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 shutdown_connections 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/1554498398 wait complete. 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 msgr2=0x7f22ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 0x7f22ac036770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55d2e72f06c0 tx=0x7f23c00053a0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 msgr2=0x55d2e73037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55d2e72e9da0 tx=0x7f23d0018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 shutdown_connections 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22ac0342b0 0x7f22ac036770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/4195157683 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e73033b0 0x55d2e73037d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 >> 172.21.15.138:0/4195157683 conn(0x55d2e72f81c0 msgr2=0x55d2e72f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 shutdown_connections 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/4195157683 wait complete. 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 msgr2=0x55d2e72ef840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 0x55d2e72ef840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 msgr2=0x55d2e72f4e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 0x55d2e72f4e00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 msgr2=0x7f22bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 0x7f22bc036770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f70 tx=0x7f23c80012c0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 msgr2=0x55d2e72e8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23c0018eb0 tx=0x7f23c0018020 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 shutdown_connections 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d2e72f15a0 0x55d2e72f4e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d2e716b7e0 0x55d2e72ef840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f22bc0342b0 0x7f22bc036770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 --2- 172.21.15.138:0/66184868 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d2e716a2d0 0x55d2e72e8b50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 >> 172.21.15.138:0/66184868 conn(0x55d2e71f0eb0 msgr2=0x55d2e72dc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 shutdown_connections 2024-02-16T10:30:50.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.384+0000 7f23d7216980 1 -- 172.21.15.138:0/66184868 wait complete. 2024-02-16T10:30:50.400 INFO:teuthology.orchestra.run.smithi138.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"813c5b9c-efe5-457a-a257-626d766e0618","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:30:49.679079Z","creation_time":"2024-02-16T10:30:49.675956Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:30:50.401 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '813c5b9c-efe5-457a-a257-626d766e0618', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:30:49.679079Z', 'creation_time': '2024-02-16T10:30:49.675956Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:30:50.401 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:30:50.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-02-16T10:30:50.401 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-02-16T10:30:50.469 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:50.469 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.460+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.460+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.460+0000 7f1a1050f980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557a37587620 0x557a37587a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.460+0000 7f1a1050f980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557a374d3b50 con 0x557a37587f40 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.460+0000 7f1a1050f980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x557a3749ad30 con 0x557a37587620 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557a37587620 0x557a37587a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x557a37587620 0x557a37587a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45854/0 (socket says 172.21.15.138:45854) 2024-02-16T10:30:50.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 -- 172.21.15.138:0/731174395 learned_addr learned my addr 172.21.15.138:0/731174395 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0d829640 1 --1- 172.21.15.138:0/731174395 >> v1:172.21.15.107:6789/0 conn(0x557a37587f40 0x557a375888b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52182/0 (socket says 172.21.15.138:52182) 2024-02-16T10:30:50.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 -- 172.21.15.138:0/731174395 >> v1:172.21.15.107:6789/0 conn(0x557a37587f40 legacy=0x557a375888b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 -- 172.21.15.138:0/731174395 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a375890e0 con 0x557a37587620 2024-02-16T10:30:50.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/731174395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37587a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000a5c0 tx=0x7f1a0001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d4b0604dbdc023 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0d028640 1 -- 172.21.15.138:0/731174395 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000aa470 con 0x557a37587620 2024-02-16T10:30:50.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0d028640 1 -- 172.21.15.138:0/731174395 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000aa5d0 con 0x557a37587620 2024-02-16T10:30:50.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a0d028640 1 -- 172.21.15.138:0/731174395 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000aa890 con 0x557a37587620 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 -- 172.21.15.138:0/731174395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 msgr2=0x557a37587a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 --2- 172.21.15.138:0/731174395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37587a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000a5c0 tx=0x7f1a0001b340 comp rx=0 tx=0).stop 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 -- 172.21.15.138:0/731174395 shutdown_connections 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 --2- 172.21.15.138:0/731174395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37587a00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 -- 172.21.15.138:0/731174395 >> 172.21.15.138:0/731174395 conn(0x557a37582ef0 msgr2=0x557a37585310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 -- 172.21.15.138:0/731174395 shutdown_connections 2024-02-16T10:30:50.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.464+0000 7f1a1050f980 1 -- 172.21.15.138:0/731174395 wait complete. 2024-02-16T10:30:50.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.476+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.476+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a37497fc0 con 0x557a37587620 2024-02-16T10:30:50.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45860/0 (socket says 172.21.15.138:45860) 2024-02-16T10:30:50.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 -- 172.21.15.138:0/1056270562 learned_addr learned my addr 172.21.15.138:0/1056270562 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 -- 172.21.15.138:0/1056270562 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00005df0 con 0x557a37587620 2024-02-16T10:30:50.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/1056270562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a0001b380 tx=0x7f1a00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858040bf38399ae server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f18fc608640 1 -- 172.21.15.138:0/1056270562 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000aa9b0 con 0x557a37587620 2024-02-16T10:30:50.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f18fc608640 1 -- 172.21.15.138:0/1056270562 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000aab30 con 0x557a37587620 2024-02-16T10:30:50.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f18fc608640 1 -- 172.21.15.138:0/1056270562 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000aae10 con 0x557a37587620 2024-02-16T10:30:50.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- 172.21.15.138:0/1056270562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 msgr2=0x557a37671bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1056270562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a0001b380 tx=0x7f1a00003030 comp rx=0 tx=0).stop 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- 172.21.15.138:0/1056270562 shutdown_connections 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1056270562 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37671bd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- 172.21.15.138:0/1056270562 >> 172.21.15.138:0/1056270562 conn(0x557a37582ef0 msgr2=0x557a3766d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- 172.21.15.138:0/1056270562 shutdown_connections 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- 172.21.15.138:0/1056270562 wait complete. 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a1050f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a374937a0 con 0x557a37587620 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45870/0 (socket says 172.21.15.138:45870) 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 -- 172.21.15.138:0/1603449405 learned_addr learned my addr 172.21.15.138:0/1603449405 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.480+0000 7f1a0e02a640 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a375890e0 con 0x557a37587620 2024-02-16T10:30:50.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a000aa5a0 tx=0x7f1a000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 -- 172.21.15.138:0/1603449405 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000cb070 con 0x557a37587620 2024-02-16T10:30:50.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 -- 172.21.15.138:0/1603449405 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000c6690 con 0x557a37587620 2024-02-16T10:30:50.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a37678f60 con 0x557a37587620 2024-02-16T10:30:50.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 -- 172.21.15.138:0/1603449405 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a000c6930 con 0x557a37587620 2024-02-16T10:30:50.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a37679410 con 0x557a37587620 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 -- 172.21.15.138:0/1603449405 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a000c6b20 con 0x557a37587620 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f18fae05640 1 -- 172.21.15.138:0/1603449405 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a000e4890 con 0x557a37587620 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0d829640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 0x557a3767f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a3767fc50 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 0x557a3767f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0d829640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 0x7f18f4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a04000f70 tx=0x7f1a04001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 0x557a3767f710 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1603449405 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a0800a4d0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a3767fff0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1603449405 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a0800a4d0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376818a0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1603449405 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1a0800a4d0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.484+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a37680aa0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1603449405 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a0800a4d0 con 0x557a37587f40 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 0x557a37684c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a37685270 con 0x557a376813c0 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 0x557a37684c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 0x557a37684c20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e02a640 1 -- 172.21.15.138:0/1603449405 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1a000cd070 con 0x557a376813c0 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3742bf20 con 0x557a37693210 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45880/0 (socket says 172.21.15.138:45880) 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 -- 172.21.15.138:0/3720313785 learned_addr learned my addr 172.21.15.138:0/3720313785 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 -- 172.21.15.138:0/3720313785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a37693b70 con 0x557a37693210 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557a37679e50 tx=0x7f1a08018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f18f3fff640 1 -- 172.21.15.138:0/3720313785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0801d070 con 0x557a37693210 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a37693dc0 con 0x557a37693210 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f18f3fff640 1 -- 172.21.15.138:0/3720313785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08014450 con 0x557a37693210 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a37694910 con 0x557a37693210 2024-02-16T10:30:50.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.488+0000 7f18f3fff640 1 -- 172.21.15.138:0/3720313785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a080146f0 con 0x557a37693210 2024-02-16T10:30:50.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f3fff640 1 -- 172.21.15.138:0/3720313785 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a08020020 con 0x557a37693210 2024-02-16T10:30:50.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f3fff640 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 0x7f18e8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f3fff640 1 -- 172.21.15.138:0/3720313785 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a0804b160 con 0x557a37693210 2024-02-16T10:30:50.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 0x7f18e8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 0x7f18e8036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x557a376804e0 tx=0x7f1a000e2ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3741f790 con 0x557a374fc840 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45882/0 (socket says 172.21.15.138:45882) 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1819925264 learned_addr learned my addr 172.21.15.138:0/1819925264 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 -- 172.21.15.138:0/1819925264 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a374fd230 con 0x557a374fc840 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/1819925264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a08049550 tx=0x7f1a08014ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1524dd9afa0eb725 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f1ffb640 1 -- 172.21.15.138:0/1819925264 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08048070 con 0x557a374fc840 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f1ffb640 1 -- 172.21.15.138:0/1819925264 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080225e0 con 0x557a374fc840 2024-02-16T10:30:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f18f1ffb640 1 -- 172.21.15.138:0/1819925264 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08013c70 con 0x557a374fc840 2024-02-16T10:30:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- 172.21.15.138:0/1819925264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 msgr2=0x557a374fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1819925264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a08049550 tx=0x7f1a08014ed0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- 172.21.15.138:0/1819925264 shutdown_connections 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1819925264 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a374fcc60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- 172.21.15.138:0/1819925264 >> 172.21.15.138:0/1819925264 conn(0x557a3769acf0 msgr2=0x557a3769bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- 172.21.15.138:0/1819925264 shutdown_connections 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- 172.21.15.138:0/1819925264 wait complete. 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 Processor -- start 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- start start 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a1050f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a376a9680 con 0x557a374fc840 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45888/0 (socket says 172.21.15.138:45888) 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.492+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 learned_addr learned my addr 172.21.15.138:0/2071012318 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a37694910 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a0804b0d0 tx=0x7f1a080494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 -- 172.21.15.138:0/2071012318 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a08034070 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a376a9880 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 -- 172.21.15.138:0/2071012318 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0802c760 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 -- 172.21.15.138:0/2071012318 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a0803b260 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a376a9cb0 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 -- 172.21.15.138:0/2071012318 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a08022a40 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18d80342b0 0x7f18d8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f18dffff640 1 -- 172.21.15.138:0/2071012318 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f1a0804cd40 con 0x557a374fc840 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18d80342b0 0x7f18d8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a376b47d0 0x557a376b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b73e0 con 0x557a376b47d0 2024-02-16T10:30:50.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a376b47d0 0x557a376b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18d80342b0 0x7f18d8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a000e2da0 tx=0x7f1a000e1000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a376b47d0 0x557a376b6c90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 realm 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b3cb0 con 0x557a376b47d0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b7e60 con 0x557a376b47d0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b8320 con 0x557a376b47d0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.496+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b7ae0 con 0x557a376b47d0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a1050f980 20 searching for the correct realm 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557a376ba660 0x557a376bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x557a376ba660 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557a376ba660 0x557a376bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557a376ba660 0x557a376bcaf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e82b640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a08056040 0x7f1a080249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x7f1a08056040 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a08056040 0x7f1a080249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a08056040 0x7f1a080249b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e02a640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a00009040 0x7f1a000d3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x7f1a00009040 2024-02-16T10:30:50.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a00009040 0x7f1a000d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a00009040 0x7f1a000d3110 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x557a376b47d0 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x557a376b47d0 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.500+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x7f1a00009040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd1c0 con 0x7f1a00009040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a08056040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a08056040 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.504+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a08056040 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.508+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a08056040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376ba660 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a00009040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x557a376b47d0 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1a0402d040 con 0x7f1a08056040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:50.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b9250 con 0x557a376b47d0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b8ed0 con 0x557a376b47d0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376b9b20 con 0x7f1a08056040 2024-02-16T10:30:50.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 zone default found 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 4 Realm: () 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 zonegroup default 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bd600 con 0x7f1a00009040 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bf480 con 0x557a376ba660 2024-02-16T10:30:50.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.512+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bf7e0 con 0x557a376ba660 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 20 started sync module instance, tier type = 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bea50 con 0x7f1a08056040 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93983404189104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376bf7e0 con 0x7f1a08056040 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c0150 con 0x557a376b47d0 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93983404189104] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93983404194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c00d0 con 0x557a376b47d0 2024-02-16T10:30:50.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.516+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c0e80 con 0x557a376ba660 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93983404194992] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93983404197120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c0dc0 con 0x557a376ba660 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c1840 con 0x7f1a08056040 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93983404200864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c2090 con 0x7f1a08056040 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c2a80 con 0x557a376b47d0 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93983404197120] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.520+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93983404200864] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93983404205408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c1bf0 con 0x557a376b47d0 2024-02-16T10:30:50.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c32d0 con 0x7f1a00009040 2024-02-16T10:30:50.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93983404205408] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93983404198176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c1bf0 con 0x7f1a00009040 2024-02-16T10:30:50.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.524+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c37e0 con 0x7f1a00009040 2024-02-16T10:30:50.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93983404198176] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93983404208864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c37a0 con 0x7f1a00009040 2024-02-16T10:30:50.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c4190 con 0x7f1a00009040 2024-02-16T10:30:50.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93983404208864] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93983404211312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c4150 con 0x7f1a00009040 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=0 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=1 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=2 2024-02-16T10:30:50.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=3 2024-02-16T10:30:50.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=4 2024-02-16T10:30:50.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=5 2024-02-16T10:30:50.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.528+0000 7f1a1050f980 20 add_watcher() i=6 2024-02-16T10:30:50.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93983404211312] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 add_watcher() i=7 2024-02-16T10:30:50.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:50.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c75a0 con 0x557a376b47d0 2024-02-16T10:30:50.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93983404207184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c4a40 con 0x557a376b47d0 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93983404207184] v31'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f18c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 5 note: GC not initialized 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f183f7fe640 20 reqs_thread_entry: start 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 Filter name: none 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f183d7fa640 20 reqs_thread_entry: start 2024-02-16T10:30:50.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376e9090 con 0x557a376b47d0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.532+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376e9090 con 0x7f1a08056040 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376e7fe0 con 0x7f1a08056040 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376e83e0 con 0x557a376b47d0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 4.21 4:84770a22:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376eb930 con 0x7f1a00009040 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 4.26 4:67063283:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376ee480 con 0x7f1a00009040 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 4.2a 4:54a76138:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376f1010 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 4.2f 4:f5540289:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376f3870 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 4.2f 4:f6dbaf5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376f6170 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 4.2f 4:f765b22e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376f8be0 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376fb4c0 con 0x7f1a08056040 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 4.32 4:4e4a0ab4:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376fdce0 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:74 4.d 4:b229da45:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376fb4c0 con 0x557a376ba660 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 4.c 4:32cbddb3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a37702fb0 con 0x557a376b47d0 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 4.4 4:208ef0a8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a377059f0 con 0x7f1a00009040 2024-02-16T10:30:50.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(70 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(66 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(71 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(67 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.1d 6:bf22f782:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376f8600 con 0x7f1a00009040 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.536+0000 7f1a1050f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f18c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93983404207184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x557a376b47d0 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93983404207184] v31'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93983404189104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x7f1a08056040 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93983404189104] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a1050f980 20 remove_watcher() i=0 2024-02-16T10:30:50.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a1050f980 2 removed watcher, disabling cache 2024-02-16T10:30:50.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.540+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93983404194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x557a376b47d0 2024-02-16T10:30:50.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93983404194992] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 20 remove_watcher() i=1 2024-02-16T10:30:50.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93983404197120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x557a376ba660 2024-02-16T10:30:50.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a0e82b640 1 -- 172.21.15.138:0/2071012318 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93983404197120] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a08041020 con 0x557a376ba660 2024-02-16T10:30:50.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 20 remove_watcher() i=2 2024-02-16T10:30:50.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93983404200864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x7f1a08056040 2024-02-16T10:30:50.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a0e02a640 1 -- 172.21.15.138:0/2071012318 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93983404200864] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a000cd070 con 0x7f1a08056040 2024-02-16T10:30:50.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 20 remove_watcher() i=3 2024-02-16T10:30:50.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.544+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93983404205408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x557a376b47d0 2024-02-16T10:30:50.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93983404205408] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x557a376b47d0 2024-02-16T10:30:50.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a1050f980 20 remove_watcher() i=4 2024-02-16T10:30:50.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93983404198176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x7f1a00009040 2024-02-16T10:30:50.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93983404198176] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a1050f980 20 remove_watcher() i=5 2024-02-16T10:30:50.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.548+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93983404208864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x7f1a00009040 2024-02-16T10:30:50.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93983404208864] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 20 remove_watcher() i=6 2024-02-16T10:30:50.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93983404211312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557a376c7350 con 0x7f1a00009040 2024-02-16T10:30:50.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93983404211312] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a0400f620 con 0x7f1a00009040 2024-02-16T10:30:50.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 20 remove_watcher() i=7 2024-02-16T10:30:50.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a00009040 msgr2=0x7f1a000d3110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a00009040 0x7f1a000d3110 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a376b47d0 msgr2=0x557a376b6c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a376b47d0 0x557a376b6c90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a08056040 msgr2=0x7f1a080249b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a08056040 0x7f1a080249b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557a376ba660 msgr2=0x557a376bcaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x557a376ba660 0x557a376bcaf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18d80342b0 msgr2=0x7f18d8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18d80342b0 0x7f18d8036770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a000e2da0 tx=0x7f1a000e1000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 msgr2=0x557a376a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a0804b0d0 tx=0x7f1a080494e0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a0d829640 1 -- 172.21.15.138:0/2071012318 reap_dead start 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 shutdown_connections 2024-02-16T10:30:50.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/2071012318 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a374fc840 0x557a376a9140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 >> 172.21.15.138:0/2071012318 conn(0x557a3769acf0 msgr2=0x557a3769bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 shutdown_connections 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/2071012318 wait complete. 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 msgr2=0x7f18e8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 0x7f18e8036770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x557a376804e0 tx=0x7f1a000e2ca0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 msgr2=0x557a37693630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x557a37679e50 tx=0x7f1a08018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 shutdown_connections 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18e80342b0 0x7f18e8036770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 --2- 172.21.15.138:0/3720313785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37693210 0x557a37693630 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 >> 172.21.15.138:0/3720313785 conn(0x557a37688020 msgr2=0x557a37688b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.552+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 shutdown_connections 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/3720313785 wait complete. 2024-02-16T10:30:50.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 msgr2=0x557a3767f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 0x557a3767f710 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 msgr2=0x557a37684c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 0x557a37684c20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 msgr2=0x7f18f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 0x7f18f4036770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a04000f70 tx=0x7f1a04001380 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 msgr2=0x557a37678a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a000aa5a0 tx=0x7f1a000180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 shutdown_connections 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x557a376813c0 0x557a37684c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x557a37587f40 0x557a3767f710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f18f40342b0 0x7f18f4036770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 --2- 172.21.15.138:0/1603449405 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557a37587620 0x557a37678a20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 >> 172.21.15.138:0/1603449405 conn(0x557a37582ef0 msgr2=0x557a3766c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 shutdown_connections 2024-02-16T10:30:50.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.556+0000 7f1a1050f980 1 -- 172.21.15.138:0/1603449405 wait complete. 2024-02-16T10:30:50.571 INFO:teuthology.orchestra.run.smithi138.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"813c5b9c-efe5-457a-a257-626d766e0618","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:30:49.679079Z","creation_time":"2024-02-16T10:30:49.675956Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-02-16T10:30:50.571 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '813c5b9c-efe5-457a-a257-626d766e0618', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:30:49.679079Z', 'creation_time': '2024-02-16T10:30:49.675956Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-02-16T10:30:50.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:30:50.579 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:50.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:50.580 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:30:50.646 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:50.646 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faece1da980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5625acebbdb0 0x5625acebe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faece1da980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5625ace01b50 con 0x5625ace29f90 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faece1da980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5625acdc8d30 con 0x5625acebbdb0 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecb4f4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5625acebbdb0 0x5625acebe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecb4f4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5625acebbdb0 0x5625acebe1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45892/0 (socket says 172.21.15.138:45892) 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecb4f4640 1 -- 172.21.15.138:0/3560685320 learned_addr learned my addr 172.21.15.138:0/3560685320 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecbcf5640 1 --1- 172.21.15.138:0/3560685320 >> v1:172.21.15.107:6789/0 conn(0x5625ace29f90 0x5625aceba690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52196/0 (socket says 172.21.15.138:52196) 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecb4f4640 1 -- 172.21.15.138:0/3560685320 >> v1:172.21.15.107:6789/0 conn(0x5625ace29f90 legacy=0x5625aceba690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.640+0000 7faecb4f4640 1 -- 172.21.15.138:0/3560685320 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625acebf6f0 con 0x5625acebbdb0 2024-02-16T10:30:50.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3560685320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acebbdb0 0x5625acebe1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faec000a5c0 tx=0x7faec001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee69ab167d1bbeb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faecacf3640 1 -- 172.21.15.138:0/3560685320 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec00aa470 con 0x5625acebbdb0 2024-02-16T10:30:50.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faecacf3640 1 -- 172.21.15.138:0/3560685320 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00aa5d0 con 0x5625acebbdb0 2024-02-16T10:30:50.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faecacf3640 1 -- 172.21.15.138:0/3560685320 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec00aa890 con 0x5625acebbdb0 2024-02-16T10:30:50.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 -- 172.21.15.138:0/3560685320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acebbdb0 msgr2=0x5625acebe1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 --2- 172.21.15.138:0/3560685320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acebbdb0 0x5625acebe1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faec000a5c0 tx=0x7faec001b340 comp rx=0 tx=0).stop 2024-02-16T10:30:50.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 -- 172.21.15.138:0/3560685320 shutdown_connections 2024-02-16T10:30:50.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 --2- 172.21.15.138:0/3560685320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acebbdb0 0x5625acebe1a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 -- 172.21.15.138:0/3560685320 >> 172.21.15.138:0/3560685320 conn(0x5625aceafdb0 msgr2=0x5625aceb21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 -- 172.21.15.138:0/3560685320 shutdown_connections 2024-02-16T10:30:50.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.644+0000 7faece1da980 1 -- 172.21.15.138:0/3560685320 wait complete. 2024-02-16T10:30:50.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faece1da980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faece1da980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625acdc5fc0 con 0x5625ace29f90 2024-02-16T10:30:50.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faecbcf5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faecbcf5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45896/0 (socket says 172.21.15.138:45896) 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faecbcf5640 1 -- 172.21.15.138:0/829918944 learned_addr learned my addr 172.21.15.138:0/829918944 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faecbcf5640 1 -- 172.21.15.138:0/829918944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0005df0 con 0x5625ace29f90 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7faecbcf5640 1 --2- 172.21.15.138:0/829918944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faec4006fb0 tx=0x7faec4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e5fdddd965bf67 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7fadb9e0b640 1 -- 172.21.15.138:0/829918944 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec4013420 con 0x5625ace29f90 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7fadb9e0b640 1 -- 172.21.15.138:0/829918944 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4013580 con 0x5625ace29f90 2024-02-16T10:30:50.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.656+0000 7fadb9e0b640 1 -- 172.21.15.138:0/829918944 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec4013860 con 0x5625ace29f90 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/829918944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 msgr2=0x5625acfa1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 --2- 172.21.15.138:0/829918944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faec4006fb0 tx=0x7faec4001940 comp rx=0 tx=0).stop 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/829918944 shutdown_connections 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 --2- 172.21.15.138:0/829918944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa1a30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/829918944 >> 172.21.15.138:0/829918944 conn(0x5625aceafdb0 msgr2=0x5625acf9d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/829918944 shutdown_connections 2024-02-16T10:30:50.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/829918944 wait complete. 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625acdc17a0 con 0x5625ace29f90 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faecbcf5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faecbcf5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45906/0 (socket says 172.21.15.138:45906) 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faecbcf5640 1 -- 172.21.15.138:0/3887086651 learned_addr learned my addr 172.21.15.138:0/3887086651 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faecbcf5640 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625ace01b50 con 0x5625ace29f90 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5625acfa28c0 tx=0x7faec4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7fadb3fff640 1 -- 172.21.15.138:0/3887086651 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec40037a0 con 0x5625ace29f90 2024-02-16T10:30:50.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625acfa8e20 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7fadb3fff640 1 -- 172.21.15.138:0/3887086651 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4003900 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7fadb3fff640 1 -- 172.21.15.138:0/3887086651 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faec4003ba0 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625acfa92d0 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.660+0000 7fadb3fff640 1 -- 172.21.15.138:0/3887086651 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faec4028460 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7fadb3fff640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 0x7fadb4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7fadb3fff640 1 -- 172.21.15.138:0/3887086651 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faec4049610 con 0x5625ace29f90 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 0x7fadb4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 0x5625acfaf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfafef0 con 0x5625acfad5c0 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 0x5625acfaf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 0x7fadb4036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faec00ae000 tx=0x7faec00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 0x5625acfaf9b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 -- 172.21.15.138:0/3887086651 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faebc0083f0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfaccd0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 -- 172.21.15.138:0/3887086651 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faebc0083f0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfb1bf0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 -- 172.21.15.138:0/3887086651 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7faebc0083f0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfb0df0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 -- 172.21.15.138:0/3887086651 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faebc0083f0 con 0x5625acfad5c0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 0x5625acfb4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfb5660 con 0x5625acfb1710 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 0x5625acfb4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 0x5625acfb4f70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecbcf5640 1 -- 172.21.15.138:0/3887086651 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faec4024020 con 0x5625acfb1710 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faece1da980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625acd59f20 con 0x5625acfc3590 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45918/0 (socket says 172.21.15.138:45918) 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.664+0000 7faecc4f6640 1 -- 172.21.15.138:0/85105690 learned_addr learned my addr 172.21.15.138:0/85105690 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecc4f6640 1 -- 172.21.15.138:0/85105690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625acfc3ef0 con 0x5625acfc3590 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecc4f6640 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5625acfa9d10 tx=0x7faebc00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 -- 172.21.15.138:0/85105690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc00f040 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625acfc4140 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 -- 172.21.15.138:0/85105690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc019550 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 -- 172.21.15.138:0/85105690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc019830 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625acfc4c90 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 -- 172.21.15.138:0/85105690 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faebc0199e0 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 0x7fada4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7fadb17fa640 1 -- 172.21.15.138:0/85105690 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faebc04b4a0 con 0x5625acfc3590 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecbcf5640 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 0x7fada4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecbcf5640 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 0x7fada4036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5625acfb0770 tx=0x7faec4003e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faece1da980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625acd4d790 con 0x5625acfd0480 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45924/0 (socket says 172.21.15.138:45924) 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.668+0000 7faecc4f6640 1 -- 172.21.15.138:0/1625703963 learned_addr learned my addr 172.21.15.138:0/1625703963 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 -- 172.21.15.138:0/1625703963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625acfd0e70 con 0x5625acfd0480 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 --2- 172.21.15.138:0/1625703963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faebc0056e0 tx=0x7faebc0156b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1200dd41a578cd8d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fadaaffd640 1 -- 172.21.15.138:0/1625703963 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc020490 con 0x5625acfd0480 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fadaaffd640 1 -- 172.21.15.138:0/1625703963 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc020c80 con 0x5625acfd0480 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fadaaffd640 1 -- 172.21.15.138:0/1625703963 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc0481b0 con 0x5625acfd0480 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/1625703963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 msgr2=0x5625acfd08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 --2- 172.21.15.138:0/1625703963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faebc0056e0 tx=0x7faebc0156b0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/1625703963 shutdown_connections 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 --2- 172.21.15.138:0/1625703963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd08a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/1625703963 >> 172.21.15.138:0/1625703963 conn(0x5625acfcb050 msgr2=0x5625acfcbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/1625703963 shutdown_connections 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/1625703963 wait complete. 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 Processor -- start 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- start start 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625acfd76f0 con 0x5625acfd0480 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45930/0 (socket says 172.21.15.138:45930) 2024-02-16T10:30:50.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 learned_addr learned my addr 172.21.15.138:0/3102467119 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625acfc4c90 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd71b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faebc016010 tx=0x7faebc049820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fada97fa640 1 -- 172.21.15.138:0/3102467119 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc019c90 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625acfd78f0 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fada97fa640 1 -- 172.21.15.138:0/3102467119 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc020900 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7fada97fa640 1 -- 172.21.15.138:0/3102467119 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faebc017a50 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.672+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625acfd7d80 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7fada97fa640 1 -- 172.21.15.138:0/3102467119 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faebc042070 con 0x5625acfd0480 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7fada97fa640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad940342b0 0x7fad94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7fada97fa640 1 -- 172.21.15.138:0/3102467119 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7faebc036ca0 con 0x5625acfd0480 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad940342b0 0x7fad94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfe28e0 0x5625acfe4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe54c0 con 0x5625acfe28e0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfe28e0 0x5625acfe4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad940342b0 0x7fad94036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5625acfb5a00 tx=0x7faec403c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfe28e0 0x5625acfe4d70 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 realm 2024-02-16T10:30:50.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe58b0 con 0x5625acfe28e0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe6100 con 0x5625acfe28e0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe6460 con 0x5625acfe28e0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe5da0 con 0x5625acfe28e0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 20 searching for the correct realm 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5625acfe86b0 0x5625acfeab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfeb1d0 con 0x5625acfe86b0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5625acfe86b0 0x5625acfeab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5625acfe86b0 0x5625acfeab00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecc4f6640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faebc022070 0x7faebc007a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faebc022070 0x7faebc007a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faebc022070 0x7faebc007a50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faec4057040 0x7faec40460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.676+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faec4057040 0x7faec40460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faec4057040 0x7faec40460d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.680+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.684+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe86b0 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faec4057040 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x5625acfe28e0 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7faebc053040 con 0x7faebc022070 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:50.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.688+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe72f0 con 0x5625acfe28e0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe6f70 con 0x5625acfe28e0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfe7bc0 con 0x7faebc022070 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:50.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 zone default found 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 4 Realm: () 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 zonegroup default 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfeb660 con 0x7faec4057040 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfed4e0 con 0x5625acfe86b0 2024-02-16T10:30:50.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfed840 con 0x5625acfe86b0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 started sync module instance, tier type = 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfeca60 con 0x7faebc022070 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719816156608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfed840 con 0x7faebc022070 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfee230 con 0x5625acfe28e0 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.692+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719816156608] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719816162576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfee5e0 con 0x5625acfe28e0 2024-02-16T10:30:50.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfeef90 con 0x5625acfe86b0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719816162576] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719816158864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfeef50 con 0x5625acfe86b0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.696+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfef950 con 0x7faebc022070 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719816168624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff01a0 con 0x7faebc022070 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff0b70 con 0x5625acfe28e0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719816158864] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719816168624] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719816173168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfefd00 con 0x5625acfe28e0 2024-02-16T10:30:50.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.700+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff13f0 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719816173168] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719816166064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acfefd00 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff18c0 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719816166064] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719816176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff1880 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.704+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff21f0 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719816179024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff2650 con 0x7faec4057040 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=0 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=1 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=2 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=3 2024-02-16T10:30:50.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=4 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=5 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719816176576] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=6 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719816179024] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 add_watcher() i=7 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff0db0 con 0x5625acfe28e0 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719816174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625acff2b50 con 0x5625acfe28e0 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719816174944] v31'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7fad81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.708+0000 7faece1da980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:50.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 5 note: GC not initialized 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7fad80fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 Filter name: none 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7facfa7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad017560 con 0x7faebc022070 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad017af0 con 0x5625acfe28e0 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(63 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad016be0 con 0x7faebc022070 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad019000 con 0x5625acfe28e0 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 4.21 4:84770a22:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad0186d0 con 0x7faec4057040 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 4.26 4:67063283:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad01db20 con 0x7faec4057040 2024-02-16T10:30:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 4.2a 4:54a76138:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad020340 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 4.2f 4:f5540289:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad022b60 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 4.2f 4:f6dbaf5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad0255e0 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 4.2f 4:f765b22e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad027fb0 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad02a7d0 con 0x7faebc022070 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 4.32 4:4e4a0ab4:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad02d0f0 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:74 4.d 4:b229da45:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad02faa0 con 0x5625acfe86b0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 4.c 4:32cbddb3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad032730 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 4.4 4:208ef0a8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad034f50 con 0x7faec4057040 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(70 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(71 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(66 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(67 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.712+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.1d 6:bf22f782:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad023f30 con 0x7faec4057040 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7fad81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719816174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad009290 con 0x5625acfe28e0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94719816174944] v31'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719816156608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x7faebc022070 2024-02-16T10:30:50.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94719816156608] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 20 remove_watcher() i=0 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 2 removed watcher, disabling cache 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.716+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719816162576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x5625acfe28e0 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94719816162576] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faece1da980 20 remove_watcher() i=1 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719816158864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x5625acfe86b0 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faecc4f6640 1 -- 172.21.15.138:0/3102467119 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94719816158864] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faebc012070 con 0x5625acfe86b0 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faece1da980 20 remove_watcher() i=2 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.720+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719816168624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x7faebc022070 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faecbcf5640 1 -- 172.21.15.138:0/3102467119 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94719816168624] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec4024020 con 0x7faebc022070 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 20 remove_watcher() i=3 2024-02-16T10:30:50.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719816173168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x5625acfe28e0 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94719816173168] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x5625acfe28e0 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 20 remove_watcher() i=4 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719816166064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x7faec4057040 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94719816166064] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 20 remove_watcher() i=5 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.724+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719816176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x7faec4057040 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.728+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94719816176576] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.728+0000 7faece1da980 20 remove_watcher() i=6 2024-02-16T10:30:50.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.728+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719816179024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5625ad018fb0 con 0x7faec4057040 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94719816179024] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faec00b0020 con 0x7faec4057040 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 20 remove_watcher() i=7 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faec4057040 msgr2=0x7faec40460d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faec4057040 0x7faec40460d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfe28e0 msgr2=0x5625acfe4d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfe28e0 0x5625acfe4d70 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faebc022070 msgr2=0x7faebc007a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faebc022070 0x7faebc007a50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5625acfe86b0 msgr2=0x5625acfeab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5625acfe86b0 0x5625acfeab00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad940342b0 msgr2=0x7fad94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fad940342b0 0x7fad94036770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5625acfb5a00 tx=0x7faec403c000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 msgr2=0x5625acfd71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3102467119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfd0480 0x5625acfd71b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faebc016010 tx=0x7faebc049820 comp rx=0 tx=0).stop 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 reap_dead start 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faecb4f4640 1 -- 172.21.15.138:0/3102467119 reap_dead start 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 shutdown_connections 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 >> 172.21.15.138:0/3102467119 conn(0x5625acfcb050 msgr2=0x5625acfcbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 shutdown_connections 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3102467119 wait complete. 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 msgr2=0x7fada4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 0x7fada4036770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5625acfb0770 tx=0x7faec4003e10 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 msgr2=0x5625acfc39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5625acfa9d10 tx=0x7faebc00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 shutdown_connections 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fada40342b0 0x7fada4036770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/85105690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625acfc3590 0x5625acfc39b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 >> 172.21.15.138:0/85105690 conn(0x5625acfb83a0 msgr2=0x5625acfb8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 shutdown_connections 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/85105690 wait complete. 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 msgr2=0x5625acfaf9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 0x5625acfaf9b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 msgr2=0x5625acfb4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 0x5625acfb4f70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 msgr2=0x7fadb4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 0x7fadb4036770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faec00ae000 tx=0x7faec00a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 msgr2=0x5625acfa88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5625acfa28c0 tx=0x7faec4000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 shutdown_connections 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5625acfb1710 0x5625acfb4f70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5625acfad5c0 0x5625acfaf9b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fadb40342b0 0x7fadb4036770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 --2- 172.21.15.138:0/3887086651 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625ace29f90 0x5625acfa88e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 >> 172.21.15.138:0/3887086651 conn(0x5625aceafdb0 msgr2=0x5625acf9c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 shutdown_connections 2024-02-16T10:30:50.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.732+0000 7faece1da980 1 -- 172.21.15.138:0/3887086651 wait complete. 2024-02-16T10:30:50.752 INFO:teuthology.orchestra.run.smithi138.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"813c5b9c-efe5-457a-a257-626d766e0618","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:30:49.679079Z","creation_time":"2024-02-16T10:30:49.675956Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:30:50.752 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '813c5b9c-efe5-457a-a257-626d766e0618', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:30:49.679079Z', 'creation_time': '2024-02-16T10:30:49.675956Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:30:50.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T10:30:50.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-02-16T10:30:50.753 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-02-16T10:30:50.827 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:50.827 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:50.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f28f0980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e29f87fd50 0x55e29f880130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f28f0980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e29f7cab60 con 0x55e29f880670 2024-02-16T10:30:50.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f28f0980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e29f791d30 con 0x55e29f87fd50 2024-02-16T10:30:50.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f040b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e29f87fd50 0x55e29f880130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f040b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e29f87fd50 0x55e29f880130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45934/0 (socket says 172.21.15.138:45934) 2024-02-16T10:30:50.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f040b640 1 -- 172.21.15.138:0/2384987807 learned_addr learned my addr 172.21.15.138:0/2384987807 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8efc0a640 1 --1- 172.21.15.138:0/2384987807 >> v1:172.21.15.107:6789/0 conn(0x55e29f880670 0x55e29f87c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52202/0 (socket says 172.21.15.138:52202) 2024-02-16T10:30:50.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f040b640 1 -- 172.21.15.138:0/2384987807 >> v1:172.21.15.107:6789/0 conn(0x55e29f880670 legacy=0x55e29f87c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.820+0000 7fe8f040b640 1 -- 172.21.15.138:0/2384987807 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e29f87ced0 con 0x55e29f87fd50 2024-02-16T10:30:50.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f040b640 1 --2- 172.21.15.138:0/2384987807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f87fd50 0x55e29f880130 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000a5c0 tx=0x7fe8e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff7951deedfd71d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8ef409640 1 -- 172.21.15.138:0/2384987807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00aa470 con 0x55e29f87fd50 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8ef409640 1 -- 172.21.15.138:0/2384987807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00aa5d0 con 0x55e29f87fd50 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8ef409640 1 -- 172.21.15.138:0/2384987807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00aa890 con 0x55e29f87fd50 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2384987807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f87fd50 msgr2=0x55e29f880130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/2384987807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f87fd50 0x55e29f880130 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000a5c0 tx=0x7fe8e001b340 comp rx=0 tx=0).stop 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2384987807 shutdown_connections 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/2384987807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f87fd50 0x55e29f880130 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2384987807 >> 172.21.15.138:0/2384987807 conn(0x55e29f878500 msgr2=0x55e29f87a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2384987807 shutdown_connections 2024-02-16T10:30:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.824+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2384987807 wait complete. 2024-02-16T10:30:50.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.836+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.836+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e29f78efc0 con 0x55e29f880670 2024-02-16T10:30:50.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45948/0 (socket says 172.21.15.138:45948) 2024-02-16T10:30:50.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 -- 172.21.15.138:0/2430013799 learned_addr learned my addr 172.21.15.138:0/2430013799 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 -- 172.21.15.138:0/2430013799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0005df0 con 0x55e29f880670 2024-02-16T10:30:50.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- 172.21.15.138:0/2430013799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00199f0 tx=0x7fe8e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1f57aa36ef176d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe7de60c640 1 -- 172.21.15.138:0/2430013799 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00aa970 con 0x55e29f880670 2024-02-16T10:30:50.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe7de60c640 1 -- 172.21.15.138:0/2430013799 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00aaad0 con 0x55e29f880670 2024-02-16T10:30:50.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe7de60c640 1 -- 172.21.15.138:0/2430013799 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00aad70 con 0x55e29f880670 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2430013799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 msgr2=0x55e29f87f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/2430013799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00199f0 tx=0x7fe8e0003030 comp rx=0 tx=0).stop 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2430013799 shutdown_connections 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/2430013799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f87f250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2430013799 >> 172.21.15.138:0/2430013799 conn(0x55e29f878500 msgr2=0x55e29f964990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2430013799 shutdown_connections 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- 172.21.15.138:0/2430013799 wait complete. 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f28f0980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e29f78a7a0 con 0x55e29f880670 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45962/0 (socket says 172.21.15.138:45962) 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 -- 172.21.15.138:0/4242823159 learned_addr learned my addr 172.21.15.138:0/4242823159 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e29f87ced0 con 0x55e29f880670 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.840+0000 7fe8f040b640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001b170 tx=0x7fe8e00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 -- 172.21.15.138:0/4242823159 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00c6780 con 0x55e29f880670 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e29f9723e0 con 0x55e29f880670 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 -- 172.21.15.138:0/4242823159 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00c68e0 con 0x55e29f880670 2024-02-16T10:30:50.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 -- 172.21.15.138:0/4242823159 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00c6b80 con 0x55e29f880670 2024-02-16T10:30:50.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e29f972890 con 0x55e29f880670 2024-02-16T10:30:50.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 -- 172.21.15.138:0/4242823159 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe8e00bd3f0 con 0x55e29f880670 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 0x7fe7d80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe7dce09640 1 -- 172.21.15.138:0/4242823159 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe8e00e4df0 con 0x55e29f880670 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 0x7fe7d80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 0x55e29f978f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9794b0 con 0x55e29f976b80 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 0x55e29f978f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 0x7fe7d80367c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000f70 tx=0x7fe8e4001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 0x55e29f978f70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/4242823159 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f976b80 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9762b0 con 0x55e29f976b80 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/4242823159 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f976b80 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f97b1e0 con 0x55e29f976b80 2024-02-16T10:30:50.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/4242823159 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f976b80 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f97a2f0 con 0x55e29f976b80 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/4242823159 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f976b80 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 0x55e29f97e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f97eae0 con 0x55e29f97ac10 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f040b640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 0x55e29f97e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.844+0000 7fe8f040b640 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 0x55e29f97e560 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f040b640 1 -- 172.21.15.138:0/4242823159 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe8e00cd070 con 0x55e29f97ac10 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e29f722f20 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45966/0 (socket says 172.21.15.138:45966) 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/3984861967 learned_addr learned my addr 172.21.15.138:0/3984861967 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/3984861967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e29f98d3e0 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55e29f9730f0 tx=0x7fe8e80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 -- 172.21.15.138:0/3984861967 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e801d070 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 -- 172.21.15.138:0/3984861967 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8014580 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e29f98d630 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 -- 172.21.15.138:0/3984861967 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8014860 con 0x55e29f98ca80 2024-02-16T10:30:50.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e29f98e180 con 0x55e29f98ca80 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 -- 172.21.15.138:0/3984861967 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe8e8020020 con 0x55e29f98ca80 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 0x7fe7c8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe7d5ffb640 1 -- 172.21.15.138:0/3984861967 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe8e804b1e0 con 0x55e29f98ca80 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.848+0000 7fe8f040b640 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 0x7fe7c8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f040b640 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 0x7fe7c8036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00b5fd0 tx=0x7fe8e00b5f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e29f716790 con 0x55e29f999a20 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45972/0 (socket says 172.21.15.138:45972) 2024-02-16T10:30:50.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/881552783 learned_addr learned my addr 172.21.15.138:0/881552783 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/881552783 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e29f99a410 con 0x55e29f999a20 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/881552783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80495d0 tx=0x7fe8e802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1da09ba7c1a942 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe7cf7fe640 1 -- 172.21.15.138:0/881552783 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e80149c0 con 0x55e29f999a20 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe7cf7fe640 1 -- 172.21.15.138:0/881552783 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8014b20 con 0x55e29f999a20 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe7cf7fe640 1 -- 172.21.15.138:0/881552783 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e80124d0 con 0x55e29f999a20 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- 172.21.15.138:0/881552783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 msgr2=0x55e29f999e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/881552783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80495d0 tx=0x7fe8e802bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- 172.21.15.138:0/881552783 shutdown_connections 2024-02-16T10:30:50.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/881552783 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f999e40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- 172.21.15.138:0/881552783 >> 172.21.15.138:0/881552783 conn(0x55e29f9945a0 msgr2=0x55e29f995480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- 172.21.15.138:0/881552783 shutdown_connections 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- 172.21.15.138:0/881552783 wait complete. 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 Processor -- start 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- start start 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f28f0980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e29f9a0cd0 con 0x55e29f999a20 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:45986/0 (socket says 172.21.15.138:45986) 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 learned_addr learned my addr 172.21.15.138:0/636865017 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.852+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e29f98e180 con 0x55e29f999a20 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8014cd0 tx=0x7fe8e8049560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 -- 172.21.15.138:0/636865017 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e8032070 con 0x55e29f999a20 2024-02-16T10:30:50.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 -- 172.21.15.138:0/636865017 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e802b940 con 0x55e29f999a20 2024-02-16T10:30:50.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e29f9a0ed0 con 0x55e29f999a20 2024-02-16T10:30:50.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 -- 172.21.15.138:0/636865017 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8e80149c0 con 0x55e29f999a20 2024-02-16T10:30:50.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e29f9a1360 con 0x55e29f999a20 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 -- 172.21.15.138:0/636865017 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe8e803b210 con 0x55e29f999a20 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c0034350 0x7fe7c0036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe7cdffb640 1 -- 172.21.15.138:0/636865017 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fe8e804cda0 con 0x55e29f999a20 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f040b640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c0034350 0x7fe7c0036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f9abe90 0x55e29f9ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9aea50 con 0x55e29f9abe90 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f9abe90 0x55e29f9ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f040b640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c0034350 0x7fe7c0036810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00e3260 tx=0x7fe8e00dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f9abe90 0x55e29f9ae300 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 realm 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9ab400 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9af520 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9af9e0 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.856+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9af1a0 con 0x55e29f9abe90 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f28f0980 20 searching for the correct realm 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e29f9b1d20 0x55e29f9b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x55e29f9b1d20 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e29f9b1d20 0x55e29f9b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e29f9b1d20 0x55e29f9b41b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f0c0c640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe8e8014070 0x7fe8e8023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x7fe8e8014070 2024-02-16T10:30:50.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f040b640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe8e8014070 0x7fe8e8023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f040b640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe8e8014070 0x7fe8e8023420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f040b640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe8e00da040 0x7fe8e00e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x7fe8e00da040 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe8e00da040 0x7fe8e00e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe8e00da040 0x7fe8e00e43f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x55e29f9abe90 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x55e29f9abe90 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.860+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x7fe8e00da040 2024-02-16T10:30:50.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4880 con 0x7fe8e00da040 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e8014070 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e8014070 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.864+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e8014070 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.868+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e8014070 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9b1d20 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e00da040 2024-02-16T10:30:50.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x55e29f9abe90 2024-02-16T10:30:50.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe8e402d040 con 0x7fe8e8014070 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b0910 con 0x55e29f9abe90 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b0590 con 0x55e29f9abe90 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b11e0 con 0x7fe8e8014070 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 zone default found 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 4 Realm: () 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 zonegroup default 2024-02-16T10:30:50.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b4cc0 con 0x7fe8e00da040 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b6b40 con 0x55e29f9b1d20 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b6ea0 con 0x55e29f9b1d20 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 started sync module instance, tier type = 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:50.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.872+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b5f80 con 0x7fe8e8014070 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94431828728544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b67d0 con 0x7fe8e8014070 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b78e0 con 0x55e29f9abe90 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94431828728544] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94431828734912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b7c90 con 0x55e29f9abe90 2024-02-16T10:30:50.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.876+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b8600 con 0x55e29f9b1d20 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94431828738400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b85c0 con 0x55e29f9b1d20 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b9530 con 0x7fe8e8014070 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94431828734912] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94431828730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b9910 con 0x7fe8e8014070 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9ba280 con 0x55e29f9abe90 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94431828730672] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94431828738400] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.880+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94431828740576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9b9de0 con 0x55e29f9abe90 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.884+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9baad0 con 0x7fe8e00da040 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.884+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94431828740576] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.884+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.884+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94431828742224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9ba830 con 0x7fe8e00da040 2024-02-16T10:30:50.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.884+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9bb030 con 0x7fe8e00da040 2024-02-16T10:30:50.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94431828742224] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94431828747632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9baef0 con 0x7fe8e00da040 2024-02-16T10:30:50.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9bb990 con 0x7fe8e00da040 2024-02-16T10:30:50.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94431828747632] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94431828751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9bb950 con 0x7fe8e00da040 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=0 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=1 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=2 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=3 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=4 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=5 2024-02-16T10:30:50.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.888+0000 7fe8f28f0980 20 add_watcher() i=6 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94431828751472] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 add_watcher() i=7 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9bed70 con 0x55e29f9abe90 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94431828748688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9bc250 con 0x55e29f9abe90 2024-02-16T10:30:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94431828748688] v31'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe7a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 5 note: GC not initialized 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe7a57e2640 20 reqs_thread_entry: start 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 Filter name: none 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe716ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e07d0 con 0x55e29f9abe90 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e07d0 con 0x7fe8e8014070 2024-02-16T10:30:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9dfbe0 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 4.21 4:84770a22:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e3030 con 0x7fe8e00da040 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 4.26 4:67063283:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e5ae0 con 0x7fe8e00da040 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 4.2a 4:54a76138:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e87e0 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 4.2f 4:f5540289:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9e5ae0 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 4.2f 4:f6dbaf5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9ed540 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 4.2f 4:f765b22e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9f01a0 con 0x55e29f9abe90 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9ed540 con 0x7fe8e8014070 2024-02-16T10:30:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 4.32 4:4e4a0ab4:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9f4fc0 con 0x55e29f9abe90 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 4.d 4:b229da45:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9f7b20 con 0x55e29f9b1d20 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 4.c 4:32cbddb3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fa660 con 0x55e29f9abe90 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.892+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 4.4 4:208ef0a8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e00da040 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(71 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(72 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(65 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(66 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(69 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(70 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e8014070 2024-02-16T10:30:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(76 foo.buckets [call] v31'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.896+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e8014070 2024-02-16T10:30:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(77 foo.buckets [call] v31'18 uv18 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 20 rados->read ofs=0 len=0 2024-02-16T10:30:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x55e29f9abe90 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 foo [stat out=16b,read 0~358 out=358b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+374 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e8014070 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv18 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe7a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:50.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94431828748688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x55e29f9abe90 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94431828748688] v31'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.900+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94431828728544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e8014070 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94431828728544] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 20 remove_watcher() i=0 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 2 removed watcher, disabling cache 2024-02-16T10:30:50.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94431828734912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x55e29f9abe90 2024-02-16T10:30:50.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94431828734912] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 20 remove_watcher() i=1 2024-02-16T10:30:50.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94431828738400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x55e29f9b1d20 2024-02-16T10:30:50.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f0c0c640 1 -- 172.21.15.138:0/636865017 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94431828738400] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e800a4d0 con 0x55e29f9b1d20 2024-02-16T10:30:50.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 20 remove_watcher() i=2 2024-02-16T10:30:50.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.904+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94431828730672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e8014070 2024-02-16T10:30:50.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8f040b640 1 -- 172.21.15.138:0/636865017 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94431828730672] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e00cd070 con 0x7fe8e8014070 2024-02-16T10:30:50.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8f28f0980 20 remove_watcher() i=3 2024-02-16T10:30:50.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94431828740576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x55e29f9abe90 2024-02-16T10:30:50.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94431828740576] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x55e29f9abe90 2024-02-16T10:30:50.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8f28f0980 20 remove_watcher() i=4 2024-02-16T10:30:50.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.908+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94431828742224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e00da040 2024-02-16T10:30:50.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94431828742224] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8f28f0980 20 remove_watcher() i=5 2024-02-16T10:30:50.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94431828747632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e00da040 2024-02-16T10:30:50.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94431828747632] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8f28f0980 20 remove_watcher() i=6 2024-02-16T10:30:50.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.912+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94431828751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e29f9fd390 con 0x7fe8e00da040 2024-02-16T10:30:50.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94431828751472] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe8e400f620 con 0x7fe8e00da040 2024-02-16T10:30:50.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 20 remove_watcher() i=7 2024-02-16T10:30:50.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe8e00da040 msgr2=0x7fe8e00e43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe8e00da040 0x7fe8e00e43f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f9abe90 msgr2=0x55e29f9ae300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f9abe90 0x55e29f9ae300 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe8e8014070 msgr2=0x7fe8e8023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe8e8014070 0x7fe8e8023420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e29f9b1d20 msgr2=0x55e29f9b41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e29f9b1d20 0x55e29f9b41b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c0034350 msgr2=0x7fe7c0036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c0034350 0x7fe7c0036810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00e3260 tx=0x7fe8e00dc000 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8efc0a640 1 -- 172.21.15.138:0/636865017 reap_dead start 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 msgr2=0x55e29f9a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8014cd0 tx=0x7fe8e8049560 comp rx=0 tx=0).stop 2024-02-16T10:30:50.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 shutdown_connections 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/636865017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f999a20 0x55e29f9a0790 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 >> 172.21.15.138:0/636865017 conn(0x55e29f9945a0 msgr2=0x55e29f995480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 shutdown_connections 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/636865017 wait complete. 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 msgr2=0x7fe7c8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 0x7fe7c8036770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00b5fd0 tx=0x7fe8e00b5f60 comp rx=0 tx=0).stop 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 msgr2=0x55e29f98cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55e29f9730f0 tx=0x7fe8e80188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 shutdown_connections 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7c80342b0 0x7fe7c8036770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/3984861967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f98ca80 0x55e29f98cea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 >> 172.21.15.138:0/3984861967 conn(0x55e29f981890 msgr2=0x55e29f9823a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 shutdown_connections 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/3984861967 wait complete. 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 msgr2=0x55e29f978f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 0x55e29f978f70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 msgr2=0x55e29f97e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 0x55e29f97e560 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 msgr2=0x7fe7d80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 0x7fe7d80367c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000f70 tx=0x7fe8e4001380 comp rx=0 tx=0).stop 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 msgr2=0x55e29f971ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001b170 tx=0x7fe8e00180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 shutdown_connections 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e29f97ac10 0x55e29f97e560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e29f976b80 0x55e29f978f70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe7d8034300 0x7fe7d80367c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 --2- 172.21.15.138:0/4242823159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e29f880670 0x55e29f971ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:50.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 >> 172.21.15.138:0/4242823159 conn(0x55e29f878500 msgr2=0x55e29f87db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:50.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 shutdown_connections 2024-02-16T10:30:50.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.916+0000 7fe8f28f0980 1 -- 172.21.15.138:0/4242823159 wait complete. 2024-02-16T10:30:50.933 INFO:teuthology.orchestra.run.smithi138.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-02-16T10:30:50.902890Z","last_stats_update":"2024-02-16T10:30:50.900939Z"} 2024-02-16T10:30:50.933 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-02-16T10:30:50.902890Z', 'last_stats_update': '2024-02-16T10:30:50.900939Z'} 2024-02-16T10:30:50.939 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:50.939 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T10:30:50.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-02-16T10:30:50.940 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-02-16T10:30:51.002 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.002 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5dedb980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f4f12c75f0 0x55f4f12c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5dedb980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f4f1213b60 con 0x55f4f12c7f10 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5dedb980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f4f11dad30 con 0x55f4f12c75f0 2024-02-16T10:30:51.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5b9f6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f4f12c75f0 0x55f4f12c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5b1f5640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f4f12c7f10 0x55f4f12c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52210/0 (socket says 172.21.15.138:52210) 2024-02-16T10:30:51.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3618114856 learned_addr learned my addr 172.21.15.138:0/3618114856 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:51.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3618114856 >> v1:172.21.15.107:6789/0 conn(0x55f4f12c7f10 legacy=0x55f4f12c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:50.996+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3618114856 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f12c9100 con 0x55f4f12c75f0 2024-02-16T10:30:51.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3618114856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f12c79d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00a420 tx=0x7fea4c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49363075e477b5ce server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5a9f4640 1 -- 172.21.15.138:0/3618114856 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aa530 con 0x55f4f12c75f0 2024-02-16T10:30:51.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5a9f4640 1 -- 172.21.15.138:0/3618114856 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0a6050 con 0x55f4f12c75f0 2024-02-16T10:30:51.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5a9f4640 1 -- 172.21.15.138:0/3618114856 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aa800 con 0x55f4f12c75f0 2024-02-16T10:30:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 -- 172.21.15.138:0/3618114856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 msgr2=0x55f4f12c79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3618114856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f12c79d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00a420 tx=0x7fea4c01afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 -- 172.21.15.138:0/3618114856 shutdown_connections 2024-02-16T10:30:51.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3618114856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f12c79d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 -- 172.21.15.138:0/3618114856 >> 172.21.15.138:0/3618114856 conn(0x55f4f12c2ec0 msgr2=0x55f4f12c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 -- 172.21.15.138:0/3618114856 shutdown_connections 2024-02-16T10:30:51.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.000+0000 7fea5dedb980 1 -- 172.21.15.138:0/3618114856 wait complete. 2024-02-16T10:30:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5dedb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5dedb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f11d7fc0 con 0x55f4f12c75f0 2024-02-16T10:30:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5b9f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5b9f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46000/0 (socket says 172.21.15.138:46000) 2024-02-16T10:30:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5b9f6640 1 -- 172.21.15.138:0/418453745 learned_addr learned my addr 172.21.15.138:0/418453745 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5b9f6640 1 -- 172.21.15.138:0/418453745 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c00a100 con 0x55f4f12c75f0 2024-02-16T10:30:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/418453745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0ad040 tx=0x7fea4c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a883b8459d618ea2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fe949e0b640 1 -- 172.21.15.138:0/418453745 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aa630 con 0x55f4f12c75f0 2024-02-16T10:30:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fe949e0b640 1 -- 172.21.15.138:0/418453745 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0aa790 con 0x55f4f12c75f0 2024-02-16T10:30:51.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.012+0000 7fe949e0b640 1 -- 172.21.15.138:0/418453745 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aaa30 con 0x55f4f12c75f0 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/418453745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 msgr2=0x55f4f123d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 --2- 172.21.15.138:0/418453745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0ad040 tx=0x7fea4c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/418453745 shutdown_connections 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 --2- 172.21.15.138:0/418453745 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f123d5a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/418453745 >> 172.21.15.138:0/418453745 conn(0x55f4f12c2ec0 msgr2=0x55f4f13ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/418453745 shutdown_connections 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/418453745 wait complete. 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f11d37a0 con 0x55f4f12c75f0 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5b9f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5b9f6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46002/0 (socket says 172.21.15.138:46002) 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3227205637 learned_addr learned my addr 172.21.15.138:0/3227205637 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f12c9100 con 0x55f4f12c75f0 2024-02-16T10:30:51.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01b870 tx=0x7fea4c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fe943fff640 1 -- 172.21.15.138:0/3227205637 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0b6890 con 0x55f4f12c75f0 2024-02-16T10:30:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fe943fff640 1 -- 172.21.15.138:0/3227205637 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0b69f0 con 0x55f4f12c75f0 2024-02-16T10:30:51.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f4f13bb0b0 con 0x55f4f12c75f0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fe943fff640 1 -- 172.21.15.138:0/3227205637 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0b6c90 con 0x55f4f12c75f0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4f13bb560 con 0x55f4f12c75f0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.016+0000 7fe943fff640 1 -- 172.21.15.138:0/3227205637 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea4c0c0450 con 0x55f4f12c75f0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fe943fff640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 0x7fe9440367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fe943fff640 1 -- 172.21.15.138:0/3227205637 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fea4c0e4010 con 0x55f4f12c75f0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 0x7fe9440367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 0x55f4f13c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13c1da0 con 0x55f4f12c7f10 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 0x55f4f13c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 0x7fe9440367c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea50000f70 tx=0x7fea500012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 0x55f4f13c1860 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3227205637 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea540083f0 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13bef40 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3227205637 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fea540083f0 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13c3760 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3227205637 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fea540083f0 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13c25e0 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3227205637 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fea540083f0 con 0x55f4f12c7f10 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 0x55f4f13c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13c7500 con 0x55f4f13c4bd0 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 0x55f4f13c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 0x55f4f13c6fc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3227205637 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fea4c0b1040 con 0x55f4f13c4bd0 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5dedb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f116bf20 con 0x55f4f13d5340 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46006/0 (socket says 172.21.15.138:46006) 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.020+0000 7fea5c1f7640 1 -- 172.21.15.138:0/241787678 learned_addr learned my addr 172.21.15.138:0/241787678 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5c1f7640 1 -- 172.21.15.138:0/241787678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f13d5ca0 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55f4f13bbdc0 tx=0x7fea5400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 -- 172.21.15.138:0/241787678 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5400f040 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 -- 172.21.15.138:0/241787678 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5401a560 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f4f13d5ef0 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 -- 172.21.15.138:0/241787678 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5401a820 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4f13d6a40 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 -- 172.21.15.138:0/241787678 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea5401aa10 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 0x7fe934036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fe9417fa640 1 -- 172.21.15.138:0/241787678 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fea5404bcf0 con 0x55f4f13d5340 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 0x7fe934036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 0x7fe934036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55f4f13c3190 tx=0x7fea4c0e23b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5dedb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f115f790 con 0x55f4f13e22a0 2024-02-16T10:30:51.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46016/0 (socket says 172.21.15.138:46016) 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.024+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3253673436 learned_addr learned my addr 172.21.15.138:0/3253673436 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3253673436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f13e2c90 con 0x55f4f13e22a0 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3253673436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea5404a020 tx=0x7fea5404a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c07468d53363266 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe93affd640 1 -- 172.21.15.138:0/3253673436 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5401add0 con 0x55f4f13e22a0 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe93affd640 1 -- 172.21.15.138:0/3253673436 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54024410 con 0x55f4f13e22a0 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe93affd640 1 -- 172.21.15.138:0/3253673436 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea540183c0 con 0x55f4f13e22a0 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3253673436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 msgr2=0x55f4f13e26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3253673436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea5404a020 tx=0x7fea5404a2f0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3253673436 shutdown_connections 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3253673436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e26c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3253673436 >> 172.21.15.138:0/3253673436 conn(0x55f4f13dce20 msgr2=0x55f4f13ddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3253673436 shutdown_connections 2024-02-16T10:30:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3253673436 wait complete. 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 Processor -- start 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- start start 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f13e9500 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46024/0 (socket says 172.21.15.138:46024) 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 learned_addr learned my addr 172.21.15.138:0/3741940774 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f13d6a40 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e8fc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea54018be0 tx=0x7fea5403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe9397fa640 1 -- 172.21.15.138:0/3741940774 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea54035040 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe9397fa640 1 -- 172.21.15.138:0/3741940774 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5401add0 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f4f13e9700 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fe9397fa640 1 -- 172.21.15.138:0/3741940774 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea54024580 con 0x55f4f13e22a0 2024-02-16T10:30:51.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.028+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4f13e9ad0 con 0x55f4f13e22a0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fe9397fa640 1 -- 172.21.15.138:0/3741940774 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea540233c0 con 0x55f4f13e22a0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fe9397fa640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe924034300 0x7fe9240367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fe9397fa640 1 -- 172.21.15.138:0/3741940774 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fea54055c60 con 0x55f4f13e22a0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe924034300 0x7fe9240367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f13f4710 0x55f4f13f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f7320 con 0x55f4f13f4710 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f13f4710 0x55f4f13f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe924034300 0x7fe9240367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005ea0 tx=0x7fea4c0e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f13f4710 0x55f4f13f6bd0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 realm 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f3b70 con 0x55f4f13f4710 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f7da0 con 0x55f4f13f4710 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f8620 con 0x55f4f13f4710 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f8980 con 0x55f4f13f4710 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 20 searching for the correct realm 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f4f13faa50 0x55f4f13fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x55f4f13faa50 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f4f13faa50 0x55f4f13fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f4f13faa50 0x55f4f13fcf10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5c1f7640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fea540122c0 0x7fea5403a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x7fea540122c0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.032+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fea540122c0 0x7fea5403a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fea540122c0 0x7fea5403a650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fea4c0c9030 0x7fea4c0a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x7fea4c0c9030 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fea4c0c9030 0x7fea4c0a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fea4c0c9030 0x7fea4c0a9630 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x55f4f13f4710 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x55f4f13f4710 2024-02-16T10:30:51.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x7fea4c0c9030 2024-02-16T10:30:51.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fd5e0 con 0x7fea4c0c9030 2024-02-16T10:30:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea540122c0 2024-02-16T10:30:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.036+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea540122c0 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.040+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea540122c0 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea540122c0 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13faa50 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea4c0c9030 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x55f4f13f4710 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fea5002b040 con 0x7fea540122c0 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.044+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fa000 con 0x55f4f13f4710 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13f9820 con 0x55f4f13f4710 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fda20 con 0x7fea540122c0 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 zone default found 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 4 Realm: () 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 zonegroup default 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13fdd80 con 0x7fea4c0c9030 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13ffb40 con 0x55f4f13faa50 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13ffed0 con 0x55f4f13faa50 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 started sync module instance, tier type = 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f13ff420 con 0x7fea540122c0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510507880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1400790 con 0x7fea540122c0 2024-02-16T10:30:51.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.048+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1400f90 con 0x55f4f13f4710 2024-02-16T10:30:51.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510507880320] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510507885296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1400f90 con 0x55f4f13f4710 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14019e0 con 0x55f4f13faa50 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510507885296] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510507889856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1400f90 con 0x55f4f13faa50 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.052+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14023a0 con 0x7fea540122c0 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510507892480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1402c20 con 0x7fea540122c0 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14035f0 con 0x55f4f13f4710 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510507889856] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510507892480] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510507897072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1402780 con 0x55f4f13f4710 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.056+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1403e40 con 0x7fea4c0c9030 2024-02-16T10:30:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510507897072] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510507887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1402780 con 0x7fea4c0c9030 2024-02-16T10:30:51.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1404330 con 0x7fea4c0c9030 2024-02-16T10:30:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510507887344] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510507900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14042f0 con 0x7fea4c0c9030 2024-02-16T10:30:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.060+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1404c60 con 0x7fea4c0c9030 2024-02-16T10:30:51.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510507900464] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510507898784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1404c60 con 0x7fea4c0c9030 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=0 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=1 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=2 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=3 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=4 2024-02-16T10:30:51.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=5 2024-02-16T10:30:51.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=6 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510507898784] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 20 add_watcher() i=7 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1408020 con 0x55f4f13f4710 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.064+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510507903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1405560 con 0x55f4f13f4710 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510507903376] v31'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fe911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 5 note: GC not initialized 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fe910fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:51.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 Filter name: none 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fe88a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1429f50 con 0x55f4f13f4710 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f142b950 con 0x7fea540122c0 2024-02-16T10:30:51.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f142d070 con 0x55f4f13f4710 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:51.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:51.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:51.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1430560 con 0x7fea540122c0 2024-02-16T10:30:51.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv19 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.068+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f142f570 con 0x7fea540122c0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1434200 con 0x7fea540122c0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'20 uv20 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94510508096864 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1430f00 con 0x7fea4c0c9030 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== watch-notify(notify (1) cookie 94510507900464 notify 133143986186 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7fea50035040 con 0x7fea4c0c9030 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(68 notify.6 [notify cookie 94510508096864 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fe93affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94510507900464 notifier 4479 bl.length()=338 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fe93affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fe93affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.072+0000 7fe93affd640 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fe920003ea0 con 0x7fea4c0c9030 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== watch-notify(notify_complete (2) cookie 94510508096864 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f4f1213b60 con 0x7fea4c0c9030 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fe911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510507903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1433d60 con 0x55f4f13f4710 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94510507903376] v31'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510507880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1433d60 con 0x7fea540122c0 2024-02-16T10:30:51.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94510507880320] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5dedb980 20 remove_watcher() i=0 2024-02-16T10:30:51.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5dedb980 2 removed watcher, disabling cache 2024-02-16T10:30:51.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.076+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510507885296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f1433d60 con 0x55f4f13f4710 2024-02-16T10:30:51.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94510507885296] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 20 remove_watcher() i=1 2024-02-16T10:30:51.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510507889856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14002f0 con 0x55f4f13faa50 2024-02-16T10:30:51.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5c1f7640 1 -- 172.21.15.138:0/3741940774 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94510507889856] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea54051070 con 0x55f4f13faa50 2024-02-16T10:30:51.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 20 remove_watcher() i=2 2024-02-16T10:30:51.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510507892480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14014c0 con 0x7fea540122c0 2024-02-16T10:30:51.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5b9f6640 1 -- 172.21.15.138:0/3741940774 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94510507892480] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea4c0b1040 con 0x7fea540122c0 2024-02-16T10:30:51.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 20 remove_watcher() i=3 2024-02-16T10:30:51.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.080+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510507897072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14002f0 con 0x55f4f13f4710 2024-02-16T10:30:51.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94510507897072] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x55f4f13f4710 2024-02-16T10:30:51.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5dedb980 20 remove_watcher() i=4 2024-02-16T10:30:51.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510507887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14014c0 con 0x7fea4c0c9030 2024-02-16T10:30:51.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94510507887344] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5dedb980 20 remove_watcher() i=5 2024-02-16T10:30:51.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.084+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510507900464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14030f0 con 0x7fea4c0c9030 2024-02-16T10:30:51.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94510507900464] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 20 remove_watcher() i=6 2024-02-16T10:30:51.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510507898784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f4f14002f0 con 0x7fea4c0c9030 2024-02-16T10:30:51.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94510507898784] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fea5000e5a0 con 0x7fea4c0c9030 2024-02-16T10:30:51.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 20 remove_watcher() i=7 2024-02-16T10:30:51.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fea4c0c9030 msgr2=0x7fea4c0a9630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fea4c0c9030 0x7fea4c0a9630 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f13f4710 msgr2=0x55f4f13f6bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f13f4710 0x55f4f13f6bd0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fea540122c0 msgr2=0x7fea5403a650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fea540122c0 0x7fea5403a650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f4f13faa50 msgr2=0x55f4f13fcf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f4f13faa50 0x55f4f13fcf10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe924034300 msgr2=0x7fe9240367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.088+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe924034300 0x7fe9240367c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea4c005ea0 tx=0x7fea4c0e0000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 msgr2=0x55f4f13e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3741940774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13e22a0 0x55f4f13e8fc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea54018be0 tx=0x7fea5403d040 comp rx=0 tx=0).stop 2024-02-16T10:30:51.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5b1f5640 1 -- 172.21.15.138:0/3741940774 reap_dead start 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 shutdown_connections 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 >> 172.21.15.138:0/3741940774 conn(0x55f4f13dce20 msgr2=0x55f4f13ddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 shutdown_connections 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3741940774 wait complete. 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 msgr2=0x7fe934036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 0x7fe934036770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55f4f13c3190 tx=0x7fea4c0e23b0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 msgr2=0x55f4f13d5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55f4f13bbdc0 tx=0x7fea5400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 shutdown_connections 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9340342b0 0x7fe934036770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/241787678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f13d5340 0x55f4f13d5760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 >> 172.21.15.138:0/241787678 conn(0x55f4f13ca150 msgr2=0x55f4f13cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 shutdown_connections 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/241787678 wait complete. 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 msgr2=0x55f4f13c1860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 0x55f4f13c1860 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 msgr2=0x55f4f13c6fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 0x55f4f13c6fc0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 msgr2=0x7fe9440367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 0x7fe9440367c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fea50000f70 tx=0x7fea500012c0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 msgr2=0x55f4f13bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01b870 tx=0x7fea4c019810 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 shutdown_connections 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f4f13c4bd0 0x55f4f13c6fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f4f12c7f10 0x55f4f13c1860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe944034300 0x7fe9440367c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 --2- 172.21.15.138:0/3227205637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4f12c75f0 0x55f4f13bab70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 >> 172.21.15.138:0/3227205637 conn(0x55f4f12c2ec0 msgr2=0x55f4f13ac2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 shutdown_connections 2024-02-16T10:30:51.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.092+0000 7fea5dedb980 1 -- 172.21.15.138:0/3227205637 wait complete. 2024-02-16T10:30:51.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:30:51.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:30:51.108 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T10:30:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42aea82980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55da711a54e0 0x55da711a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42aea82980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55da710f2af0 con 0x55da711a5e00 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42aea82980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55da710b9d30 con 0x55da711a54e0 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55da711a54e0 0x55da711a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55da711a54e0 0x55da711a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46038/0 (socket says 172.21.15.138:46038) 2024-02-16T10:30:51.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 -- 172.21.15.138:0/2147713252 learned_addr learned my addr 172.21.15.138:0/2147713252 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 -- 172.21.15.138:0/2147713252 >> v1:172.21.15.107:6789/0 conn(0x55da711a5e00 legacy=0x55da711a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 -- 172.21.15.138:0/2147713252 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da711a7040 con 0x55da711a54e0 2024-02-16T10:30:51.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ac59d640 1 --2- 172.21.15.138:0/2147713252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da711a58c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f429c00a5c0 tx=0x7f429c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbefa7b8962ffee server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ab59b640 1 -- 172.21.15.138:0/2147713252 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0aa470 con 0x55da711a54e0 2024-02-16T10:30:51.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ab59b640 1 -- 172.21.15.138:0/2147713252 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c0aa5d0 con 0x55da711a54e0 2024-02-16T10:30:51.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.180+0000 7f42ab59b640 1 -- 172.21.15.138:0/2147713252 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0aa890 con 0x55da711a54e0 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 -- 172.21.15.138:0/2147713252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 msgr2=0x55da711a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 --2- 172.21.15.138:0/2147713252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da711a58c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f429c00a5c0 tx=0x7f429c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 -- 172.21.15.138:0/2147713252 shutdown_connections 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 --2- 172.21.15.138:0/2147713252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da711a58c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 -- 172.21.15.138:0/2147713252 >> 172.21.15.138:0/2147713252 conn(0x55da711a0db0 msgr2=0x55da711a31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 -- 172.21.15.138:0/2147713252 shutdown_connections 2024-02-16T10:30:51.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.184+0000 7f42aea82980 1 -- 172.21.15.138:0/2147713252 wait complete. 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da710b6fc0 con 0x55da711a54e0 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42ac59d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42ac59d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46040/0 (socket says 172.21.15.138:46040) 2024-02-16T10:30:51.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42ac59d640 1 -- 172.21.15.138:0/3110295170 learned_addr learned my addr 172.21.15.138:0/3110295170 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42ac59d640 1 -- 172.21.15.138:0/3110295170 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c005df0 con 0x55da711a54e0 2024-02-16T10:30:51.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3110295170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f429c017f50 tx=0x7f429c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c24f4f04c1a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f419a60c640 1 -- 172.21.15.138:0/3110295170 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0aa9c0 con 0x55da711a54e0 2024-02-16T10:30:51.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f419a60c640 1 -- 172.21.15.138:0/3110295170 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c0aab40 con 0x55da711a54e0 2024-02-16T10:30:51.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f419a60c640 1 -- 172.21.15.138:0/3110295170 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0aae20 con 0x55da711a54e0 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- 172.21.15.138:0/3110295170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 msgr2=0x55da7128fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 --2- 172.21.15.138:0/3110295170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f429c017f50 tx=0x7f429c003030 comp rx=0 tx=0).stop 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- 172.21.15.138:0/3110295170 shutdown_connections 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 --2- 172.21.15.138:0/3110295170 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da7128fc40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- 172.21.15.138:0/3110295170 >> 172.21.15.138:0/3110295170 conn(0x55da711a0db0 msgr2=0x55da7128b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- 172.21.15.138:0/3110295170 shutdown_connections 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- 172.21.15.138:0/3110295170 wait complete. 2024-02-16T10:30:51.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.196+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da710b27a0 con 0x55da711a54e0 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42ac59d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42ac59d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46044/0 (socket says 172.21.15.138:46044) 2024-02-16T10:30:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42ac59d640 1 -- 172.21.15.138:0/3683848893 learned_addr learned my addr 172.21.15.138:0/3683848893 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42ac59d640 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da711a7040 con 0x55da711a54e0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c10 tx=0x7f429c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 -- 172.21.15.138:0/3683848893 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0be660 con 0x55da711a54e0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 -- 172.21.15.138:0/3683848893 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c0be7c0 con 0x55da711a54e0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 -- 172.21.15.138:0/3683848893 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f429c0bea60 con 0x55da711a54e0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da71298190 con 0x55da711a54e0 2024-02-16T10:30:51.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da712985e0 con 0x55da711a54e0 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 -- 172.21.15.138:0/3683848893 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f429c0bebc0 con 0x55da711a54e0 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 0x7f41940367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f4198e09640 1 -- 172.21.15.138:0/3683848893 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f429c0c5070 con 0x55da711a54e0 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 0x7f41940367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 0x55da7129e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da7129ee80 con 0x55da711a5e00 2024-02-16T10:30:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.200+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 0x55da7129e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 0x7f41940367c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42a0001e20 tx=0x7f42a00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 0x55da7129e940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/3683848893 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da711a5e00 2024-02-16T10:30:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da7129f240 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/3683848893 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712a0af0 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/3683848893 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da7129fcf0 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/3683848893 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da711a5e00 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 0x55da712a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712a44c0 con 0x55da712a0610 2024-02-16T10:30:51.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 0x55da712a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 0x55da712a3e70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42ac59d640 1 -- 172.21.15.138:0/3683848893 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f429c0cf070 con 0x55da712a0610 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42aea82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7104af20 con 0x55da7128e680 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46048/0 (socket says 172.21.15.138:46048) 2024-02-16T10:30:51.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/2961383498 learned_addr learned my addr 172.21.15.138:0/2961383498 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 -- 172.21.15.138:0/2961383498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da7128d060 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.204+0000 7f42acd9e640 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55da71298790 tx=0x7f42a4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 -- 172.21.15.138:0/2961383498 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a401d070 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 -- 172.21.15.138:0/2961383498 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4014450 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da7128d2b0 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 -- 172.21.15.138:0/2961383498 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a40146f0 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da7128d740 con 0x55da7128e680 2024-02-16T10:30:51.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 -- 172.21.15.138:0/2961383498 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f42a4020020 con 0x55da7128e680 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 0x7f4184036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f4191ffb640 1 -- 172.21.15.138:0/2961383498 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42a404b320 con 0x55da7128e680 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42ac59d640 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 0x7f4184036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42ac59d640 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 0x7f4184036810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55da7129f730 tx=0x7f429c0065b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42aea82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7103e790 con 0x55da712c16f0 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46060/0 (socket says 172.21.15.138:46060) 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42acd9e640 1 -- 172.21.15.138:0/1895215675 learned_addr learned my addr 172.21.15.138:0/1895215675 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42acd9e640 1 -- 172.21.15.138:0/1895215675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da712c20a0 con 0x55da712c16f0 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f42acd9e640 1 --2- 172.21.15.138:0/1895215675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f42a4018430 tx=0x7f42a402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3503f425d914beaa server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f418b7fe640 1 -- 172.21.15.138:0/1895215675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a403f030 con 0x55da712c16f0 2024-02-16T10:30:51.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f418b7fe640 1 -- 172.21.15.138:0/1895215675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4014850 con 0x55da712c16f0 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.208+0000 7f418b7fe640 1 -- 172.21.15.138:0/1895215675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a4016570 con 0x55da712c16f0 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/1895215675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 msgr2=0x55da712c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 --2- 172.21.15.138:0/1895215675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f42a4018430 tx=0x7f42a402bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/1895215675 shutdown_connections 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 --2- 172.21.15.138:0/1895215675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c1ad0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/1895215675 >> 172.21.15.138:0/1895215675 conn(0x55da712bc2c0 msgr2=0x55da712bd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/1895215675 shutdown_connections 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/1895215675 wait complete. 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 Processor -- start 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- start start 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da712c8990 con 0x55da712c16f0 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42acd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46070/0 (socket says 172.21.15.138:46070) 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 learned_addr learned my addr 172.21.15.138:0/3158167653 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da7128d740 con 0x55da712c16f0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c8450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f42a4040040 tx=0x7f42a40495e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 -- 172.21.15.138:0/3158167653 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a4016440 con 0x55da712c16f0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da712c8b90 con 0x55da712c16f0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 -- 172.21.15.138:0/3158167653 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a40165a0 con 0x55da712c16f0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 -- 172.21.15.138:0/3158167653 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42a40124d0 con 0x55da712c16f0 2024-02-16T10:30:51.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da712c8fc0 con 0x55da712c16f0 2024-02-16T10:30:51.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 -- 172.21.15.138:0/3158167653 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f42a4042070 con 0x55da712c16f0 2024-02-16T10:30:51.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f417c0342b0 0x7f417c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f4189ffb640 1 -- 172.21.15.138:0/3158167653 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f42a4040070 con 0x55da712c16f0 2024-02-16T10:30:51.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f417c0342b0 0x7f417c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da712d3bc0 0x55da712d6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d67d0 con 0x55da712d3bc0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.212+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da712d3bc0 0x55da712d6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f417c0342b0 0x7f417c036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55da712a4880 tx=0x7f429c0db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da712d3bc0 0x55da712d6080 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 realm 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d30a0 con 0x55da712d3bc0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d7250 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d7ad0 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d7e30 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 20 searching for the correct realm 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55da712d9f00 0x55da712dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712dca90 con 0x55da712d9f00 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55da712d9f00 0x55da712dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55da712d9f00 0x55da712dc3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da712d9f00 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42acd9e640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f42a4014070 0x7f42a4022a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f42a4014070 0x7f42a4022a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f42a4014070 0x7f42a4022a50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f429c0d2070 0x7f429c006810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.216+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f429c0d2070 0x7f429c006810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f429c0d2070 0x7f429c006810 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da712d9f00 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.220+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a400a4d0 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.224+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d9f00 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f429c0d2070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x55da712d3bc0 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f42a4053040 con 0x7f42a4014070 2024-02-16T10:30:51.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d8360 con 0x55da712d3bc0 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d8710 con 0x55da712d3bc0 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712d8b70 con 0x7f42a4014070 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 zone default found 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 4 Realm: () 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 zonegroup default 2024-02-16T10:30:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.228+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712dced0 con 0x7f429c0d2070 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712dec90 con 0x55da712d9f00 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712df020 con 0x55da712d9f00 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 started sync module instance, tier type = 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:51.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712de120 con 0x7f42a4014070 2024-02-16T10:30:51.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396690062464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712de920 con 0x7f42a4014070 2024-02-16T10:30:51.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712dfac0 con 0x55da712d3bc0 2024-02-16T10:30:51.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396690062464] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396690068928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712dfe70 con 0x55da712d3bc0 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.232+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e0820 con 0x55da712d9f00 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396690068928] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396690064512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e07e0 con 0x55da712d9f00 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e11e0 con 0x7f42a4014070 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396690074944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e1a30 con 0x7f42a4014070 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e2450 con 0x55da712d3bc0 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.236+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396690064512] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396690074944] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396690079536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e1590 con 0x55da712d3bc0 2024-02-16T10:30:51.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e2ca0 con 0x7f429c0d2070 2024-02-16T10:30:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396690079536] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396690072384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e1590 con 0x7f429c0d2070 2024-02-16T10:30:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.240+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e31f0 con 0x7f429c0d2070 2024-02-16T10:30:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396690072384] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396690083024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e31b0 con 0x7f429c0d2070 2024-02-16T10:30:51.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e3b20 con 0x7f429c0d2070 2024-02-16T10:30:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396690085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e3f40 con 0x7f429c0d2070 2024-02-16T10:30:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=0 2024-02-16T10:30:51.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=1 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=2 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=3 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=4 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=5 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396690083024] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.244+0000 7f42aea82980 20 add_watcher() i=6 2024-02-16T10:30:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396690085504] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 add_watcher() i=7 2024-02-16T10:30:51.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e2690 con 0x55da712d3bc0 2024-02-16T10:30:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396690086560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da712e2690 con 0x55da712d3bc0 2024-02-16T10:30:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396690086560] v31'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f41627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:51.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 5 note: GC not initialized 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f41617e2640 20 reqs_thread_entry: start 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 Filter name: none 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f40d2ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71308ec0 con 0x7f429c0d2070 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:30:51.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.248+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71308ec0 con 0x7f429c0d2070 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:30:51.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307bc0 con 0x7f429c0d2070 2024-02-16T10:30:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:30:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:51.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94396690235264 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307bc0 con 0x7f429c0d2070 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== watch-notify(notify (1) cookie 94396690072384 notify 133143986187 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f42a0037040 con 0x7f429c0d2070 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f418b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94396690072384 notifier 4486 bl.length()=523 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(65 notify.5 [notify cookie 94396690235264 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f418b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f418b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:51.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f418b7fe640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4170003ea0 con 0x7f429c0d2070 2024-02-16T10:30:51.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== watch-notify(notify_complete (2) cookie 94396690235264 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f42a0009050 con 0x7f429c0d2070 2024-02-16T10:30:51.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.252+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307b70 con 0x7f429c0d2070 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42aea82980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42aea82980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42aea82980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94396690233040 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307af0 con 0x55da712d9f00 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== watch-notify(notify (1) cookie 94396690064512 notify 133143986178 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55da712c8fc0 con 0x55da712d9f00 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f418b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94396690064512 notifier 4486 bl.length()=177 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f418b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f418b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [notify cookie 94396690233040 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f418b7fe640 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f4170003ea0 con 0x55da712d9f00 2024-02-16T10:30:51.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== watch-notify(notify_complete (2) cookie 94396690233040 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55da712c8b90 con 0x55da712d9f00 2024-02-16T10:30:51.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.266 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:51.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f41627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.256+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396690086560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x55da712d3bc0 2024-02-16T10:30:51.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94396690086560] v31'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396690062464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x7f42a4014070 2024-02-16T10:30:51.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94396690062464] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 20 remove_watcher() i=0 2024-02-16T10:30:51.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 2 removed watcher, disabling cache 2024-02-16T10:30:51.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396690068928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x55da712d3bc0 2024-02-16T10:30:51.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94396690068928] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 20 remove_watcher() i=1 2024-02-16T10:30:51.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.260+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396690064512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x55da712d9f00 2024-02-16T10:30:51.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42acd9e640 1 -- 172.21.15.138:0/3158167653 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94396690064512] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a405f040 con 0x55da712d9f00 2024-02-16T10:30:51.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42aea82980 20 remove_watcher() i=2 2024-02-16T10:30:51.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396690074944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x7f42a4014070 2024-02-16T10:30:51.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42ac59d640 1 -- 172.21.15.138:0/3158167653 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94396690074944] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f429c0cf070 con 0x7f42a4014070 2024-02-16T10:30:51.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42aea82980 20 remove_watcher() i=3 2024-02-16T10:30:51.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.264+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396690079536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x55da712d3bc0 2024-02-16T10:30:51.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94396690079536] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x55da712d3bc0 2024-02-16T10:30:51.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42aea82980 20 remove_watcher() i=4 2024-02-16T10:30:51.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396690072384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x7f429c0d2070 2024-02-16T10:30:51.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94396690072384] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42aea82980 20 remove_watcher() i=5 2024-02-16T10:30:51.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.268+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396690083024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x7f429c0d2070 2024-02-16T10:30:51.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94396690083024] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 20 remove_watcher() i=6 2024-02-16T10:30:51.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396690085504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55da71307ae0 con 0x7f429c0d2070 2024-02-16T10:30:51.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94396690085504] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42a00105b0 con 0x7f429c0d2070 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 20 remove_watcher() i=7 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f429c0d2070 msgr2=0x7f429c006810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f429c0d2070 0x7f429c006810 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da712d3bc0 msgr2=0x55da712d6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da712d3bc0 0x55da712d6080 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f42a4014070 msgr2=0x7f42a4022a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f42a4014070 0x7f42a4022a50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55da712d9f00 msgr2=0x55da712dc3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55da712d9f00 0x55da712dc3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f417c0342b0 msgr2=0x7f417c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f417c0342b0 0x7f417c036770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55da712a4880 tx=0x7f429c0db000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 msgr2=0x55da712c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3158167653 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da712c16f0 0x55da712c8450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f42a4040040 tx=0x7f42a40495e0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42abd9c640 1 -- 172.21.15.138:0/3158167653 reap_dead start 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 shutdown_connections 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 >> 172.21.15.138:0/3158167653 conn(0x55da712bc2c0 msgr2=0x55da712bd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 shutdown_connections 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3158167653 wait complete. 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 msgr2=0x7f4184036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 0x7f4184036810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55da7129f730 tx=0x7f429c0065b0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 msgr2=0x55da7128cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55da71298790 tx=0x7f42a4018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 shutdown_connections 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4184034350 0x7f4184036810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/2961383498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da7128e680 0x55da7128cb20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 >> 172.21.15.138:0/2961383498 conn(0x55da712a7270 msgr2=0x55da712a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 shutdown_connections 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/2961383498 wait complete. 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 msgr2=0x55da7129e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 0x55da7129e940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 msgr2=0x55da712a3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 0x55da712a3e70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 msgr2=0x7f41940367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 0x7f41940367c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42a0001e20 tx=0x7f42a00013a0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 msgr2=0x55da71297c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c10 tx=0x7f429c0180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 shutdown_connections 2024-02-16T10:30:51.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55da712a0610 0x55da712a3e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55da711a5e00 0x55da7129e940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4194034300 0x7f41940367c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 --2- 172.21.15.138:0/3683848893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55da711a54e0 0x55da71297c50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 >> 172.21.15.138:0/3683848893 conn(0x55da711a0db0 msgr2=0x55da7128eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 shutdown_connections 2024-02-16T10:30:51.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.272+0000 7f42aea82980 1 -- 172.21.15.138:0/3683848893 wait complete. 2024-02-16T10:30:51.291 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:51.297 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:30:51.303 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:51.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-02-16T10:30:51.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-02-16T10:30:51.304 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-02-16T10:30:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.362 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f156c0d4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56528b8e6a00 0x56528b8e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f156c0d4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56528b82fb50 con 0x56528b8e24a0 2024-02-16T10:30:51.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f156c0d4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x56528b7f6d30 con 0x56528b8e6a00 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f15693ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56528b8e6a00 0x56528b8e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f15693ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56528b8e6a00 0x56528b8e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46072/0 (socket says 172.21.15.138:46072) 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f1569bef640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56528b8e24a0 0x56528b8e2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52232/0 (socket says 172.21.15.138:52232) 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f1569bef640 1 -- 172.21.15.138:0/503399181 learned_addr learned my addr 172.21.15.138:0/503399181 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f15693ee640 1 -- 172.21.15.138:0/503399181 >> v1:172.21.15.107:6789/0 conn(0x56528b8e24a0 legacy=0x56528b8e2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.356+0000 7f15693ee640 1 -- 172.21.15.138:0/503399181 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528b8ea340 con 0x56528b8e6a00 2024-02-16T10:30:51.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f15693ee640 1 --2- 172.21.15.138:0/503399181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e6a00 0x56528b8e8df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f155400a480 tx=0x7f155401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a5d48febb9f14 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f1568bed640 1 -- 172.21.15.138:0/503399181 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15540ab540 con 0x56528b8e6a00 2024-02-16T10:30:51.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f1568bed640 1 -- 172.21.15.138:0/503399181 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540ab6a0 con 0x56528b8e6a00 2024-02-16T10:30:51.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f1568bed640 1 -- 172.21.15.138:0/503399181 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15540ab960 con 0x56528b8e6a00 2024-02-16T10:30:51.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 -- 172.21.15.138:0/503399181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e6a00 msgr2=0x56528b8e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 --2- 172.21.15.138:0/503399181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e6a00 0x56528b8e8df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f155400a480 tx=0x7f155401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:51.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 -- 172.21.15.138:0/503399181 shutdown_connections 2024-02-16T10:30:51.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 --2- 172.21.15.138:0/503399181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e6a00 0x56528b8e8df0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 -- 172.21.15.138:0/503399181 >> 172.21.15.138:0/503399181 conn(0x56528b8ddd70 msgr2=0x56528b8e0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 -- 172.21.15.138:0/503399181 shutdown_connections 2024-02-16T10:30:51.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.360+0000 7f156c0d4980 1 -- 172.21.15.138:0/503399181 wait complete. 2024-02-16T10:30:51.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f156c0d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f156c0d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528b7f3fc0 con 0x56528b8e24a0 2024-02-16T10:30:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f1569bef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f1569bef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46084/0 (socket says 172.21.15.138:46084) 2024-02-16T10:30:51.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f1569bef640 1 -- 172.21.15.138:0/1806055664 learned_addr learned my addr 172.21.15.138:0/1806055664 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f1569bef640 1 -- 172.21.15.138:0/1806055664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554005d30 con 0x56528b8e24a0 2024-02-16T10:30:51.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.372+0000 7f1569bef640 1 --2- 172.21.15.138:0/1806055664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1564006fb0 tx=0x7f1564001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b746d31e38873db server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1457e07640 1 -- 172.21.15.138:0/1806055664 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1564004530 con 0x56528b8e24a0 2024-02-16T10:30:51.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1457e07640 1 -- 172.21.15.138:0/1806055664 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564004690 con 0x56528b8e24a0 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1457e07640 1 -- 172.21.15.138:0/1806055664 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15640049b0 con 0x56528b8e24a0 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1806055664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 msgr2=0x56528b9cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1806055664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1564006fb0 tx=0x7f1564001940 comp rx=0 tx=0).stop 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1806055664 shutdown_connections 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1806055664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9cc5c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1806055664 >> 172.21.15.138:0/1806055664 conn(0x56528b8ddd70 msgr2=0x56528b9c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1806055664 shutdown_connections 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1806055664 wait complete. 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528b7ef7a0 con 0x56528b8e24a0 2024-02-16T10:30:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1569bef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1569bef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46100/0 (socket says 172.21.15.138:46100) 2024-02-16T10:30:51.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1569bef640 1 -- 172.21.15.138:0/1357357216 learned_addr learned my addr 172.21.15.138:0/1357357216 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1569bef640 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528b82fb50 con 0x56528b8e24a0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1569bef640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1564001980 tx=0x7f1564000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1456604640 1 -- 172.21.15.138:0/1357357216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1564013630 con 0x56528b8e24a0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1456604640 1 -- 172.21.15.138:0/1357357216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564013790 con 0x56528b8e24a0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56528b9d4bc0 con 0x56528b8e24a0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f1456604640 1 -- 172.21.15.138:0/1357357216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1564013a30 con 0x56528b8e24a0 2024-02-16T10:30:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.376+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56528b9d5070 con 0x56528b8e24a0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1456604640 1 -- 172.21.15.138:0/1357357216 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1564013b90 con 0x56528b8e24a0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1456604640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 0x7f14500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1456604640 1 -- 172.21.15.138:0/1357357216 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f15640494f0 con 0x56528b8e24a0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f15693ee640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 0x7f14500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 0x56528b9db320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528b9db860 con 0x56528b8e6a00 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 0x56528b9db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f15693ee640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 0x7f14500367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15540ad000 tx=0x7f15540a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 0x56528b9db320 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 -- 172.21.15.138:0/1357357216 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f155c0083f0 con 0x56528b8e6a00 2024-02-16T10:30:51.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528b9d8a40 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 -- 172.21.15.138:0/1357357216 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f155c0083f0 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528b9dd590 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 -- 172.21.15.138:0/1357357216 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f155c0083f0 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528b9dc790 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 -- 172.21.15.138:0/1357357216 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f155c0083f0 con 0x56528b8e6a00 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 0x56528b9e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528b9e0ee0 con 0x56528b9dd0b0 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1569bef640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 0x56528b9e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1569bef640 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 0x56528b9e0910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f1569bef640 1 -- 172.21.15.138:0/1357357216 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1564024020 con 0x56528b9dd0b0 2024-02-16T10:30:51.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156c0d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528b787f20 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.380+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46108/0 (socket says 172.21.15.138:46108) 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 -- 172.21.15.138:0/4285950836 learned_addr learned my addr 172.21.15.138:0/4285950836 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 -- 172.21.15.138:0/4285950836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528b9ef7a0 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x56528b9d5a60 tx=0x7f155c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 -- 172.21.15.138:0/4285950836 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c00f040 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56528b9ef9f0 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 -- 172.21.15.138:0/4285950836 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c01a560 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 -- 172.21.15.138:0/4285950836 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c01a800 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56528b9f0540 con 0x56528b9eee40 2024-02-16T10:30:51.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 -- 172.21.15.138:0/4285950836 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f155c01a9b0 con 0x56528b9eee40 2024-02-16T10:30:51.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 0x7f1444036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f144f7fe640 1 -- 172.21.15.138:0/4285950836 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f155c04bce0 con 0x56528b9eee40 2024-02-16T10:30:51.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f1569bef640 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 0x7f1444036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f1569bef640 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 0x7f1444036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56528b9dc230 tx=0x7f1564013e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156c0d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528b77b790 con 0x56528b9ca7e0 2024-02-16T10:30:51.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46112/0 (socket says 172.21.15.138:46112) 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.384+0000 7f156a3f0640 1 -- 172.21.15.138:0/554409111 learned_addr learned my addr 172.21.15.138:0/554409111 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 -- 172.21.15.138:0/554409111 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528b9cb1d0 con 0x56528b9ca7e0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 --2- 172.21.15.138:0/554409111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f155c0056e0 tx=0x7f155c018b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9017da3ddc7615 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f144d7fa640 1 -- 172.21.15.138:0/554409111 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c024930 con 0x56528b9ca7e0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f144d7fa640 1 -- 172.21.15.138:0/554409111 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c024a90 con 0x56528b9ca7e0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f144d7fa640 1 -- 172.21.15.138:0/554409111 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c024540 con 0x56528b9ca7e0 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/554409111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 msgr2=0x56528b9cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 --2- 172.21.15.138:0/554409111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f155c0056e0 tx=0x7f155c018b10 comp rx=0 tx=0).stop 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/554409111 shutdown_connections 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 --2- 172.21.15.138:0/554409111 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528b9cac00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/554409111 >> 172.21.15.138:0/554409111 conn(0x56528b9f69a0 msgr2=0x56528b9f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/554409111 shutdown_connections 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/554409111 wait complete. 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 Processor -- start 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- start start 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528ba04d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528ba052b0 con 0x56528b9ca7e0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528ba04d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528ba04d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46114/0 (socket says 172.21.15.138:46114) 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 learned_addr learned my addr 172.21.15.138:0/4146446136 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528b9f0540 con 0x56528b9ca7e0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156a3f0640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528ba04d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f155c03d010 tx=0x7f155c008ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f143b7fe640 1 -- 172.21.15.138:0/4146446136 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c035040 con 0x56528b9ca7e0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56528ba054b0 con 0x56528b9ca7e0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f143b7fe640 1 -- 172.21.15.138:0/4146446136 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0073e0 con 0x56528b9ca7e0 2024-02-16T10:30:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56528ba058e0 con 0x56528b9ca7e0 2024-02-16T10:30:51.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.388+0000 7f143b7fe640 1 -- 172.21.15.138:0/4146446136 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f155c024930 con 0x56528b9ca7e0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f143b7fe640 1 -- 172.21.15.138:0/4146446136 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f155c043310 con 0x56528b9ca7e0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f143b7fe640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14340342b0 0x7f1434036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f143b7fe640 1 -- 172.21.15.138:0/4146446136 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f155c056ca0 con 0x56528b9ca7e0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14340342b0 0x7f1434036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528ba104a0 0x56528ba12940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba13090 con 0x56528ba104a0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528ba104a0 0x56528ba12940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14340342b0 0x7f1434036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f15640127b0 tx=0x7f1564035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528ba104a0 0x56528ba12940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 realm 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba13480 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba13cd0 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba14030 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba13970 con 0x56528ba104a0 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 20 searching for the correct realm 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56528ba16280 0x56528ba186d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156a3f0640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56528ba16280 0x56528ba186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156a3f0640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56528ba16280 0x56528ba186d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156a3f0640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f155c02e480 0x7f155c01c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f155c02e480 2024-02-16T10:30:51.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f155c02e480 0x7f155c01c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f155c02e480 0x7f155c01c5e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1564024020 con 0x7f155c02e480 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1564028460 0x7f1564012820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.392+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1564028460 0x7f1564012820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1564028460 0x7f1564012820 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f155c02e480 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.396+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f155c02e480 2024-02-16T10:30:51.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.400+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f155c02e480 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f155c02e480 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba16280 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f155c012070 con 0x56528ba16280 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x7f1564028460 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba18da0 con 0x56528ba104a0 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f15540da080 con 0x7f155c02e480 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.404+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba14e90 con 0x56528ba104a0 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba14b10 con 0x56528ba104a0 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba15760 con 0x7f155c02e480 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 zone default found 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 4 Realm: () 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 zonegroup default 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba19230 con 0x7f1564028460 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1b0b0 con 0x56528ba16280 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f155c06b040 con 0x56528ba16280 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1b410 con 0x56528ba16280 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f155c06b040 con 0x56528ba16280 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 started sync module instance, tier type = 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:51.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a680 con 0x7f155c02e480 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94912529932768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1b770 con 0x7f155c02e480 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.408+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1c1e0 con 0x56528ba104a0 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94912529932768] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94912529939648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1c590 con 0x56528ba104a0 2024-02-16T10:30:51.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1cf40 con 0x56528ba16280 2024-02-16T10:30:51.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94912529939648] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f155c06b040 con 0x56528ba16280 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94912529935024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1d2f0 con 0x56528ba16280 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.412+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1dc60 con 0x7f155c02e480 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94912529946560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1e4b0 con 0x7f155c02e480 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1ee80 con 0x56528ba104a0 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94912529935024] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f155c06b040 con 0x56528ba16280 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94912529946560] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94912529948688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1ca60 con 0x56528ba104a0 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1f6d0 con 0x7f1564028460 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.416+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94912529948688] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94912529951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1f630 con 0x7f1564028460 2024-02-16T10:30:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1ffa0 con 0x7f1564028460 2024-02-16T10:30:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94912529951104] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94912529953168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba20180 con 0x7f1564028460 2024-02-16T10:30:51.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba20980 con 0x7f1564028460 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.420+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94912529953168] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94912529956544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba20880 con 0x7f1564028460 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=0 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=1 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=2 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=3 2024-02-16T10:30:51.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=4 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=5 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=6 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94912529956544] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 add_watcher() i=7 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:51.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba23db0 con 0x56528ba104a0 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94912529957664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba21260 con 0x56528ba104a0 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94912529957664] v31'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f141b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.424+0000 7f156c0d4980 5 note: GC not initialized 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f141a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 20 Filter name: none 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f138bfff640 20 reqs_thread_entry: start 2024-02-16T10:30:51.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba455b0 con 0x7f155c02e480 2024-02-16T10:30:51.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:51.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f141b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94912529957664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba0a3c0 con 0x56528ba104a0 2024-02-16T10:30:51.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94912529957664] v31'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94912529932768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba202e0 con 0x7f155c02e480 2024-02-16T10:30:51.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94912529932768] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 20 remove_watcher() i=0 2024-02-16T10:30:51.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 2 removed watcher, disabling cache 2024-02-16T10:30:51.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.428+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94912529939648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a1e0 con 0x56528ba104a0 2024-02-16T10:30:51.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94912529939648] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f156c0d4980 20 remove_watcher() i=1 2024-02-16T10:30:51.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94912529935024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a1e0 con 0x56528ba16280 2024-02-16T10:30:51.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f156a3f0640 1 -- 172.21.15.138:0/4146446136 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94912529935024] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f155c06b040 con 0x56528ba16280 2024-02-16T10:30:51.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f156c0d4980 20 remove_watcher() i=2 2024-02-16T10:30:51.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.432+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94912529946560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a1e0 con 0x7f155c02e480 2024-02-16T10:30:51.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f1569bef640 1 -- 172.21.15.138:0/4146446136 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94912529946560] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f156405e040 con 0x7f155c02e480 2024-02-16T10:30:51.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f156c0d4980 20 remove_watcher() i=3 2024-02-16T10:30:51.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94912529948688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1d7c0 con 0x56528ba104a0 2024-02-16T10:30:51.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94912529948688] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x56528ba104a0 2024-02-16T10:30:51.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f156c0d4980 20 remove_watcher() i=4 2024-02-16T10:30:51.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.436+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94912529951104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a1e0 con 0x7f1564028460 2024-02-16T10:30:51.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94912529951104] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f156c0d4980 20 remove_watcher() i=5 2024-02-16T10:30:51.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94912529953168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1d7c0 con 0x7f1564028460 2024-02-16T10:30:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94912529953168] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f156c0d4980 20 remove_watcher() i=6 2024-02-16T10:30:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94912529956544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56528ba1a1e0 con 0x7f1564028460 2024-02-16T10:30:51.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94912529956544] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15540ab810 con 0x7f1564028460 2024-02-16T10:30:51.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.440+0000 7f156c0d4980 20 remove_watcher() i=7 2024-02-16T10:30:51.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1564028460 msgr2=0x7f1564012820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1564028460 0x7f1564012820 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528ba104a0 msgr2=0x56528ba12940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528ba104a0 0x56528ba12940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f155c02e480 msgr2=0x7f155c01c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f155c02e480 0x7f155c01c5e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56528ba16280 msgr2=0x56528ba186d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56528ba16280 0x56528ba186d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14340342b0 msgr2=0x7f1434036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14340342b0 0x7f1434036770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f15640127b0 tx=0x7f1564035000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 msgr2=0x56528ba04d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4146446136 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9ca7e0 0x56528ba04d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f155c03d010 tx=0x7f155c008ad0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 reap_dead start 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f15693ee640 1 -- 172.21.15.138:0/4146446136 reap_dead start 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 shutdown_connections 2024-02-16T10:30:51.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 >> 172.21.15.138:0/4146446136 conn(0x56528b9f69a0 msgr2=0x56528b9f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 shutdown_connections 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4146446136 wait complete. 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 msgr2=0x7f1444036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 0x7f1444036770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56528b9dc230 tx=0x7f1564013e40 comp rx=0 tx=0).stop 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 msgr2=0x56528b9ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x56528b9d5a60 tx=0x7f155c00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 shutdown_connections 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14440342b0 0x7f1444036770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/4285950836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b9eee40 0x56528b9ef260 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 >> 172.21.15.138:0/4285950836 conn(0x56528b9e3c50 msgr2=0x56528b9e4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 shutdown_connections 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/4285950836 wait complete. 2024-02-16T10:30:51.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 msgr2=0x56528b9db320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 0x56528b9db320 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 msgr2=0x56528b9e0910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 0x56528b9e0910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 msgr2=0x7f14500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 0x7f14500367c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15540ad000 tx=0x7f15540a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 msgr2=0x56528b9d4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1564001980 tx=0x7f1564000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 shutdown_connections 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56528b9dd0b0 0x56528b9e0910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56528b8e6a00 0x56528b9db320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1450034300 0x7f14500367c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 --2- 172.21.15.138:0/1357357216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56528b8e24a0 0x56528b9d4680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 >> 172.21.15.138:0/1357357216 conn(0x56528b8ddd70 msgr2=0x56528b9cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 shutdown_connections 2024-02-16T10:30:51.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.444+0000 7f156c0d4980 1 -- 172.21.15.138:0/1357357216 wait complete. 2024-02-16T10:30:51.460 INFO:teuthology.orchestra.run.smithi138.stdout:{"key":"bucket:myfoo","ver":{"tag":"_eaJC6Ea5Fg6HGYYa7hfjyyw","ver":2},"mtime":"2024-02-16T10:30:51.076591Z","data":{"bucket":{"name":"myfoo","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","bucket_id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-02-16T10:30:49.675956Z","linked":false,"has_bucket_info":false}} 2024-02-16T10:30:51.460 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_eaJC6Ea5Fg6HGYYa7hfjyyw', 'ver': 2}, 'mtime': '2024-02-16T10:30:51.076591Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'bucket_id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-02-16T10:30:49.675956Z', 'linked': False, 'has_bucket_info': False}} 2024-02-16T10:30:51.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1'] 2024-02-16T10:30:51.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1'] 2024-02-16T10:30:51.461 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:51.540 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.540 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.532+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.532+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.532+0000 7f25cacf1980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56099e289950 0x56099e28bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.532+0000 7f25cacf1980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56099e1d1af0 con 0x56099e1f96b0 2024-02-16T10:30:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.532+0000 7f25cacf1980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x56099e198d30 con 0x56099e289950 2024-02-16T10:30:51.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56099e289950 0x56099e28bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56099e289950 0x56099e28bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46118/0 (socket says 172.21.15.138:46118) 2024-02-16T10:30:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c880c640 1 --1- 172.21.15.138:0/4188901085 >> v1:172.21.15.107:6789/0 conn(0x56099e1f96b0 0x56099e288230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52236/0 (socket says 172.21.15.138:52236) 2024-02-16T10:30:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 -- 172.21.15.138:0/4188901085 learned_addr learned my addr 172.21.15.138:0/4188901085 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 -- 172.21.15.138:0/4188901085 >> v1:172.21.15.107:6789/0 conn(0x56099e1f96b0 legacy=0x56099e288230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 -- 172.21.15.138:0/4188901085 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099e28d320 con 0x56099e289950 2024-02-16T10:30:51.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c800b640 1 --2- 172.21.15.138:0/4188901085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e289950 0x56099e28bd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00a5c0 tx=0x7f25bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909de9521c0cc796 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c780a640 1 -- 172.21.15.138:0/4188901085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25bc0aa470 con 0x56099e289950 2024-02-16T10:30:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c780a640 1 -- 172.21.15.138:0/4188901085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0aa5d0 con 0x56099e289950 2024-02-16T10:30:51.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25c780a640 1 -- 172.21.15.138:0/4188901085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25bc0aa890 con 0x56099e289950 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 -- 172.21.15.138:0/4188901085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e289950 msgr2=0x56099e28bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 --2- 172.21.15.138:0/4188901085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e289950 0x56099e28bd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00a5c0 tx=0x7f25bc01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 -- 172.21.15.138:0/4188901085 shutdown_connections 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 --2- 172.21.15.138:0/4188901085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e289950 0x56099e28bd40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 -- 172.21.15.138:0/4188901085 >> 172.21.15.138:0/4188901085 conn(0x56099e27fd10 msgr2=0x56099e282130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 -- 172.21.15.138:0/4188901085 shutdown_connections 2024-02-16T10:30:51.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.536+0000 7f25cacf1980 1 -- 172.21.15.138:0/4188901085 wait complete. 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099e195fc0 con 0x56099e1f96b0 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25c880c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25c880c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46126/0 (socket says 172.21.15.138:46126) 2024-02-16T10:30:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25c880c640 1 -- 172.21.15.138:0/977279852 learned_addr learned my addr 172.21.15.138:0/977279852 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25c880c640 1 -- 172.21.15.138:0/977279852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc005df0 con 0x56099e1f96b0 2024-02-16T10:30:51.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25c880c640 1 --2- 172.21.15.138:0/977279852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25c0006fb0 tx=0x7f25c0001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889043094c3e91 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f24b6e0d640 1 -- 172.21.15.138:0/977279852 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c0013420 con 0x56099e1f96b0 2024-02-16T10:30:51.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f24b6e0d640 1 -- 172.21.15.138:0/977279852 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0013580 con 0x56099e1f96b0 2024-02-16T10:30:51.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f24b6e0d640 1 -- 172.21.15.138:0/977279852 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c0013860 con 0x56099e1f96b0 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- 172.21.15.138:0/977279852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 msgr2=0x56099e36f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 --2- 172.21.15.138:0/977279852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f25c0006fb0 tx=0x7f25c0001940 comp rx=0 tx=0).stop 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- 172.21.15.138:0/977279852 shutdown_connections 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 --2- 172.21.15.138:0/977279852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e36f6e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- 172.21.15.138:0/977279852 >> 172.21.15.138:0/977279852 conn(0x56099e27fd10 msgr2=0x56099e36b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- 172.21.15.138:0/977279852 shutdown_connections 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.552+0000 7f25cacf1980 1 -- 172.21.15.138:0/977279852 wait complete. 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099e1917a0 con 0x56099e1f96b0 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c880c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c880c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46142/0 (socket says 172.21.15.138:46142) 2024-02-16T10:30:51.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c880c640 1 -- 172.21.15.138:0/3719463534 learned_addr learned my addr 172.21.15.138:0/3719463534 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c880c640 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099e1d1af0 con 0x56099e1f96b0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c880c640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x56099e370570 tx=0x7f25c0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 -- 172.21.15.138:0/3719463534 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c0003670 con 0x56099e1f96b0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 -- 172.21.15.138:0/3719463534 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0003810 con 0x56099e1f96b0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56099e376bf0 con 0x56099e1f96b0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 -- 172.21.15.138:0/3719463534 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25c0003af0 con 0x56099e1f96b0 2024-02-16T10:30:51.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56099e3770a0 con 0x56099e1f96b0 2024-02-16T10:30:51.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 -- 172.21.15.138:0/3719463534 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f25c0003ce0 con 0x56099e1f96b0 2024-02-16T10:30:51.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 0x7f24b0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f24b560a640 1 -- 172.21.15.138:0/3719463534 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f25c00494c0 con 0x56099e1f96b0 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c800b640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 0x7f24b0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 0x56099e37d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e37d8e0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.556+0000 7f25c900d640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 0x56099e37d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c800b640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 0x7f24b0036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ae000 tx=0x7f25bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 0x56099e37d3a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/3719463534 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b80083f0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e37aac0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/3719463534 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25b80083f0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e37f610 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/3719463534 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f25b80083f0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e37e720 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/3719463534 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25b80083f0 con 0x56099e289950 2024-02-16T10:30:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 0x56099e382990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e382f10 con 0x56099e37f040 2024-02-16T10:30:51.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c880c640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 0x56099e382990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c880c640 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 0x56099e382990 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c880c640 1 -- 172.21.15.138:0/3719463534 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f25c0024020 con 0x56099e37f040 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25cacf1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099e129f20 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46150/0 (socket says 172.21.15.138:46150) 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/2052788960 learned_addr learned my addr 172.21.15.138:0/2052788960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 -- 172.21.15.138:0/2052788960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099e391810 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.560+0000 7f25c900d640 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x56099e377790 tx=0x7f25b800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 -- 172.21.15.138:0/2052788960 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b800f040 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 -- 172.21.15.138:0/2052788960 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b801a560 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56099e391a60 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 -- 172.21.15.138:0/2052788960 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b801a820 con 0x56099e390eb0 2024-02-16T10:30:51.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56099e3925b0 con 0x56099e390eb0 2024-02-16T10:30:51.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 -- 172.21.15.138:0/2052788960 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f25b801aa10 con 0x56099e390eb0 2024-02-16T10:30:51.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 0x7f24a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f24ae7fc640 1 -- 172.21.15.138:0/2052788960 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f25b804bcf0 con 0x56099e390eb0 2024-02-16T10:30:51.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c880c640 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 0x7f24a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c880c640 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 0x7f24a0036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56099e37e1c0 tx=0x7f25c0006450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099e11d790 con 0x56099e39ddc0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46166/0 (socket says 172.21.15.138:46166) 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c900d640 1 -- 172.21.15.138:0/3680791690 learned_addr learned my addr 172.21.15.138:0/3680791690 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c900d640 1 -- 172.21.15.138:0/3680791690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099e39e7b0 con 0x56099e39ddc0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25c900d640 1 --2- 172.21.15.138:0/3680791690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25b804a020 tx=0x7f25b804a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab592bfba94b2626 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f249ffff640 1 -- 172.21.15.138:0/3680791690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b801add0 con 0x56099e39ddc0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f249ffff640 1 -- 172.21.15.138:0/3680791690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8024410 con 0x56099e39ddc0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f249ffff640 1 -- 172.21.15.138:0/3680791690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b80183c0 con 0x56099e39ddc0 2024-02-16T10:30:51.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- 172.21.15.138:0/3680791690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 msgr2=0x56099e39e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3680791690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25b804a020 tx=0x7f25b804a2f0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- 172.21.15.138:0/3680791690 shutdown_connections 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3680791690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e39e1e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.564+0000 7f25cacf1980 1 -- 172.21.15.138:0/3680791690 >> 172.21.15.138:0/3680791690 conn(0x56099e398990 msgr2=0x56099e399870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- 172.21.15.138:0/3680791690 shutdown_connections 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- 172.21.15.138:0/3680791690 wait complete. 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 Processor -- start 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- start start 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099e3a5090 con 0x56099e39ddc0 2024-02-16T10:30:51.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c900d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46174/0 (socket says 172.21.15.138:46174) 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 learned_addr learned my addr 172.21.15.138:0/3411137977 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099e3925b0 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c900d640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f25b8018be0 tx=0x7f25b803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 -- 172.21.15.138:0/3411137977 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b8035040 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56099e3a5290 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 -- 172.21.15.138:0/3411137977 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b801add0 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56099e3a5660 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 -- 172.21.15.138:0/3411137977 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b8024580 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 -- 172.21.15.138:0/3411137977 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f25b80233c0 con 0x56099e39ddc0 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24940342b0 0x7f2494036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f249e7fc640 1 -- 172.21.15.138:0/3411137977 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f25b8055c60 con 0x56099e39ddc0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c880c640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24940342b0 0x7f2494036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e3b0260 0x56099e3b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b2e70 con 0x56099e3b0260 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c800b640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e3b0260 0x56099e3b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.568+0000 7f25c880c640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24940342b0 0x7f2494036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007550 tx=0x7f25c003c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e3b0260 0x56099e3b2720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 realm 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b3260 con 0x56099e3b0260 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b3ab0 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b3e10 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4610 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 20 searching for the correct realm 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56099e3b64c0 0x56099e3b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c900d640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56099e3b64c0 0x56099e3b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c900d640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56099e3b64c0 0x56099e3b8980 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c900d640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f25b801c0d0 0x7f25b801c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c880c640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f25b801c0d0 0x7f25b801c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c880c640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f25b801c0d0 0x7f25b801c830 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25c0024020 con 0x7f25b801c0d0 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c880c640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f25c0057040 0x7f25c004a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f25c0057040 0x7f25c004a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.572+0000 7f25c800b640 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f25c0057040 0x7f25c004a870 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.576+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.580+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b64c0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25c0057040 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x56099e3b0260 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9000 con 0x7f25b801c0d0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:51.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x56099e3b0260 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b5760 con 0x56099e3b0260 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b5760 con 0x7f25b801c0d0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 zone default found 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 4 Realm: () 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 zonegroup default 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.584+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b9440 con 0x7f25c0057040 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bb200 con 0x56099e3b64c0 2024-02-16T10:30:51.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bb5b0 con 0x56099e3b64c0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 started sync module instance, tier type = 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:51.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3baae0 con 0x7f25b801c0d0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599309403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bae90 con 0x7f25b801c0d0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bc370 con 0x56099e3b0260 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599309403712] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599309408720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bc720 con 0x56099e3b0260 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.588+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bd0f0 con 0x56099e3b64c0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599309413360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bd940 con 0x56099e3b64c0 2024-02-16T10:30:51.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3be320 con 0x7f25b801c0d0 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599309408720] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599309409776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3be680 con 0x7f25b801c0d0 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bf080 con 0x56099e3b0260 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.592+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599309409776] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599309413360] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599309415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bde40 con 0x56099e3b0260 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bf8d0 con 0x7f25c0057040 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599309423504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bfc50 con 0x7f25c0057040 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c0680 con 0x7f25c0057040 2024-02-16T10:30:51.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.596+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599309415584] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599309423504] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599309427072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3bf7b0 con 0x7f25c0057040 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c0c30 con 0x7f25c0057040 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599309427072] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599309421440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c0c30 con 0x7f25c0057040 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=0 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=1 2024-02-16T10:30:51.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=2 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=3 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=4 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=5 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.600+0000 7f25cacf1980 20 add_watcher() i=6 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599309421440] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 add_watcher() i=7 2024-02-16T10:30:51.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:51.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c3e50 con 0x56099e3b0260 2024-02-16T10:30:51.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599309441072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c0c30 con 0x56099e3b0260 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599309441072] v31'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f247efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 5 note: GC not initialized 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f247dfe3640 20 reqs_thread_entry: start 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 Filter name: none 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f23ef7fe640 20 reqs_thread_entry: start 2024-02-16T10:30:51.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:51.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3e5da0 con 0x7f25c0057040 2024-02-16T10:30:51.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.604+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3e77a0 con 0x7f25b801c0d0 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3e8ef0 con 0x56099e3b0260 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:51.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3ed1b0 con 0x7f25b801c0d0 2024-02-16T10:30:51.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 foo.buckets [call] v31'21 uv19 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3f3190 con 0x56099e3b0260 2024-02-16T10:30:51.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(66 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:51.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94599309595552 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3ed5a0 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.608+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== watch-notify(notify (1) cookie 94599309415584 notify 133143986188 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f25bc0e1040 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f249ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94599309415584 notifier 4500 bl.length()=725 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f249ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f249ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f249ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 notify.4 [notify cookie 94599309595552 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f249ffff640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f248c003ea0 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94599309595552 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f25bc0b9070 con 0x56099e3b0260 2024-02-16T10:30:51.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3f1960 con 0x7f25c0057040 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.612+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3f2970 con 0x7f25b801c0d0 2024-02-16T10:30:51.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'22 uv22 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25cacf1980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:51.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25cacf1980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25cacf1980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:51.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94599309595520 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3f1e00 con 0x7f25c0057040 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== watch-notify(notify (1) cookie 94599309427072 notify 133143986188 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f25bc0b9070 con 0x7f25c0057040 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(71 notify.6 [notify cookie 94599309595520 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f249ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94599309427072 notifier 4500 bl.length()=314 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f249ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f249ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:51.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f249ffff640 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f248c004200 con 0x7f25c0057040 2024-02-16T10:30:51.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== watch-notify(notify_complete (2) cookie 94599309595520 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56099e28d320 con 0x7f25c0057040 2024-02-16T10:30:51.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f247efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.616+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599309441072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3f1960 con 0x56099e3b0260 2024-02-16T10:30:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94599309441072] v31'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599309403712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3c3830 con 0x7f25b801c0d0 2024-02-16T10:30:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94599309403712] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 20 remove_watcher() i=0 2024-02-16T10:30:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 2 removed watcher, disabling cache 2024-02-16T10:30:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599309408720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x56099e3b0260 2024-02-16T10:30:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94599309408720] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 20 remove_watcher() i=1 2024-02-16T10:30:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.620+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599309413360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x56099e3b64c0 2024-02-16T10:30:51.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25c900d640 1 -- 172.21.15.138:0/3411137977 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94599309413360] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b8051070 con 0x56099e3b64c0 2024-02-16T10:30:51.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25cacf1980 20 remove_watcher() i=2 2024-02-16T10:30:51.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599309409776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x7f25b801c0d0 2024-02-16T10:30:51.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25c880c640 1 -- 172.21.15.138:0/3411137977 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94599309409776] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25c004adb0 con 0x7f25b801c0d0 2024-02-16T10:30:51.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25cacf1980 20 remove_watcher() i=3 2024-02-16T10:30:51.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.624+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599309415584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x56099e3b0260 2024-02-16T10:30:51.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94599309415584] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x56099e3b0260 2024-02-16T10:30:51.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25cacf1980 20 remove_watcher() i=4 2024-02-16T10:30:51.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599309423504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x7f25c0057040 2024-02-16T10:30:51.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94599309423504] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25cacf1980 20 remove_watcher() i=5 2024-02-16T10:30:51.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.628+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599309427072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x7f25c0057040 2024-02-16T10:30:51.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94599309427072] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 20 remove_watcher() i=6 2024-02-16T10:30:51.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599309421440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56099e3b4f10 con 0x7f25c0057040 2024-02-16T10:30:51.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94599309421440] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25bc0b0020 con 0x7f25c0057040 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 20 remove_watcher() i=7 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f25c0057040 msgr2=0x7f25c004a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f25c0057040 0x7f25c004a870 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e3b0260 msgr2=0x56099e3b2720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e3b0260 0x56099e3b2720 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f25b801c0d0 msgr2=0x7f25b801c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f25b801c0d0 0x7f25b801c830 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56099e3b64c0 msgr2=0x56099e3b8980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56099e3b64c0 0x56099e3b8980 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24940342b0 msgr2=0x7f2494036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24940342b0 0x7f2494036770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007550 tx=0x7f25c003c000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25c800b640 1 -- 172.21.15.138:0/3411137977 reap_dead start 2024-02-16T10:30:51.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 msgr2=0x56099e3a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f25b8018be0 tx=0x7f25b803d040 comp rx=0 tx=0).stop 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 shutdown_connections 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3411137977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e39ddc0 0x56099e3a4b50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 >> 172.21.15.138:0/3411137977 conn(0x56099e398990 msgr2=0x56099e399870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 shutdown_connections 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3411137977 wait complete. 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 msgr2=0x7f24a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 0x7f24a0036770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56099e37e1c0 tx=0x7f25c0006450 comp rx=0 tx=0).stop 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 msgr2=0x56099e3912d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x56099e377790 tx=0x7f25b800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 shutdown_connections 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24a00342b0 0x7f24a0036770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/2052788960 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e390eb0 0x56099e3912d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 >> 172.21.15.138:0/2052788960 conn(0x56099e385cc0 msgr2=0x56099e3867d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 shutdown_connections 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/2052788960 wait complete. 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 msgr2=0x56099e37d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 0x56099e37d3a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 msgr2=0x56099e382990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 0x56099e382990 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 msgr2=0x7f24b0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 0x7f24b0036770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ae000 tx=0x7f25bc0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 msgr2=0x56099e3766b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x56099e370570 tx=0x7f25c0000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 shutdown_connections 2024-02-16T10:30:51.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56099e37f040 0x56099e382990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56099e289950 0x56099e37d3a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f24b00342b0 0x7f24b0036770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 --2- 172.21.15.138:0/3719463534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56099e1f96b0 0x56099e3766b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 >> 172.21.15.138:0/3719463534 conn(0x56099e27fd10 msgr2=0x56099e369d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 shutdown_connections 2024-02-16T10:30:51.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.632+0000 7f25cacf1980 1 -- 172.21.15.138:0/3719463534 wait complete. 2024-02-16T10:30:51.650 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:51.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:51.651 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:30:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.727 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c85850980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5638e3bdedb0 0x5638e3be11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c85850980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5638e3b24b50 con 0x5638e3b4c710 2024-02-16T10:30:51.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c85850980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638e3aebd30 con 0x5638e3bdedb0 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c82b6a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5638e3bdedb0 0x5638e3be11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c82b6a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5638e3bdedb0 0x5638e3be11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46186/0 (socket says 172.21.15.138:46186) 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c82b6a640 1 -- 172.21.15.138:0/369589243 learned_addr learned my addr 172.21.15.138:0/369589243 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c8336b640 1 --1- 172.21.15.138:0/369589243 >> v1:172.21.15.107:6789/0 conn(0x5638e3b4c710 0x5638e3bdd690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52244/0 (socket says 172.21.15.138:52244) 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c82b6a640 1 -- 172.21.15.138:0/369589243 >> v1:172.21.15.107:6789/0 conn(0x5638e3b4c710 legacy=0x5638e3bdd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.720+0000 7f6c82b6a640 1 -- 172.21.15.138:0/369589243 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e3be26f0 con 0x5638e3bdedb0 2024-02-16T10:30:51.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/369589243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3be11a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800a5c0 tx=0x7f6c7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19286fe7f6f46c85 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c82369640 1 -- 172.21.15.138:0/369589243 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c780aa470 con 0x5638e3bdedb0 2024-02-16T10:30:51.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c82369640 1 -- 172.21.15.138:0/369589243 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c780aa5d0 con 0x5638e3bdedb0 2024-02-16T10:30:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c82369640 1 -- 172.21.15.138:0/369589243 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c780aa890 con 0x5638e3bdedb0 2024-02-16T10:30:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 -- 172.21.15.138:0/369589243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 msgr2=0x5638e3be11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 --2- 172.21.15.138:0/369589243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3be11a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800a5c0 tx=0x7f6c7801b340 comp rx=0 tx=0).stop 2024-02-16T10:30:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 -- 172.21.15.138:0/369589243 shutdown_connections 2024-02-16T10:30:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 --2- 172.21.15.138:0/369589243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3be11a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 -- 172.21.15.138:0/369589243 >> 172.21.15.138:0/369589243 conn(0x5638e3bd2d70 msgr2=0x5638e3bd5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 -- 172.21.15.138:0/369589243 shutdown_connections 2024-02-16T10:30:51.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.724+0000 7f6c85850980 1 -- 172.21.15.138:0/369589243 wait complete. 2024-02-16T10:30:51.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c85850980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c85850980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e3ae8fc0 con 0x5638e3b4c710 2024-02-16T10:30:51.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c8336b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c8336b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46202/0 (socket says 172.21.15.138:46202) 2024-02-16T10:30:51.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.736+0000 7f6c8336b640 1 -- 172.21.15.138:0/2751416413 learned_addr learned my addr 172.21.15.138:0/2751416413 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 -- 172.21.15.138:0/2751416413 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78005df0 con 0x5638e3b4c710 2024-02-16T10:30:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 --2- 172.21.15.138:0/2751416413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c74001d40 tx=0x7f6c7400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493b8a68230a8bc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b7160a640 1 -- 172.21.15.138:0/2751416413 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c74014070 con 0x5638e3b4c710 2024-02-16T10:30:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b7160a640 1 -- 172.21.15.138:0/2751416413 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7400f590 con 0x5638e3b4c710 2024-02-16T10:30:51.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b7160a640 1 -- 172.21.15.138:0/2751416413 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c74007040 con 0x5638e3b4c710 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/2751416413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 msgr2=0x5638e3cc4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 --2- 172.21.15.138:0/2751416413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c74001d40 tx=0x7f6c7400b610 comp rx=0 tx=0).stop 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/2751416413 shutdown_connections 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 --2- 172.21.15.138:0/2751416413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3b4c710 0x5638e3cc4980 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/2751416413 >> 172.21.15.138:0/2751416413 conn(0x5638e3bd2d70 msgr2=0x5638e3cc0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/2751416413 shutdown_connections 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/2751416413 wait complete. 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e3ae47a0 con 0x5638e3bdedb0 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46206/0 (socket says 172.21.15.138:46206) 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 -- 172.21.15.138:0/1511690361 learned_addr learned my addr 172.21.15.138:0/1511690361 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e3b24b50 con 0x5638e3bdedb0 2024-02-16T10:30:51.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b650 tx=0x7f6c74000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b6fe07640 1 -- 172.21.15.138:0/1511690361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c74014030 con 0x5638e3bdedb0 2024-02-16T10:30:51.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b6fe07640 1 -- 172.21.15.138:0/1511690361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74001530 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638e3ccc170 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6b6fe07640 1 -- 172.21.15.138:0/1511690361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7400e900 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.740+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638e3ccc620 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6b6fe07640 1 -- 172.21.15.138:0/1511690361 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c7400eb10 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6b6fe07640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 0x7f6b68036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6b6fe07640 1 -- 172.21.15.138:0/1511690361 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6c74006070 con 0x5638e3bdedb0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 0x7f6b68036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 0x5638e3cd2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3cd31f0 con 0x5638e3cd08c0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 0x5638e3cd2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 0x7f6b68036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c780ae000 tx=0x7f6c780a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 0x5638e3cd2cb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1511690361 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3cd08c0 2024-02-16T10:30:51.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3ccfff0 con 0x5638e3cd08c0 2024-02-16T10:30:51.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1511690361 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3cd08c0 2024-02-16T10:30:51.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3cd4f20 con 0x5638e3cd08c0 2024-02-16T10:30:51.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1511690361 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3cd08c0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3cd4030 con 0x5638e3cd08c0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1511690361 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3cd08c0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 0x5638e3cd82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3cd8820 con 0x5638e3cd4950 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 0x5638e3cd82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.744+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 0x5638e3cd82a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c8336b640 1 -- 172.21.15.138:0/1511690361 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6c74016070 con 0x5638e3cd4950 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e3a7cf20 con 0x5638e3ce67c0 2024-02-16T10:30:51.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46212/0 (socket says 172.21.15.138:46212) 2024-02-16T10:30:51.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1560099354 learned_addr learned my addr 172.21.15.138:0/1560099354 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1560099354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e3ce7120 con 0x5638e3ce67c0 2024-02-16T10:30:51.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5638e3ccce30 tx=0x7f6c7c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 -- 172.21.15.138:0/1560099354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c01d070 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638e3ce7370 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 -- 172.21.15.138:0/1560099354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c014580 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 -- 172.21.15.138:0/1560099354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c014860 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638e3ce7ec0 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 -- 172.21.15.138:0/1560099354 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c7c020020 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 0x7f6b5c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6b6d602640 1 -- 172.21.15.138:0/1560099354 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6c7c04b2a0 con 0x5638e3ce67c0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 0x7f6b5c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.748+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 0x7f6b5c036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5638e3cd3ad0 tx=0x7f6c7401cf10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e3a70790 con 0x5638e3cf3760 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46220/0 (socket says 172.21.15.138:46220) 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 -- 172.21.15.138:0/2414168266 learned_addr learned my addr 172.21.15.138:0/2414168266 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 -- 172.21.15.138:0/2414168266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e3cf4150 con 0x5638e3cf3760 2024-02-16T10:30:51.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/2414168266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0495d0 tx=0x7f6c7c02bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3a8e60b5cbea58 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6b66ffd640 1 -- 172.21.15.138:0/2414168266 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c016570 con 0x5638e3cf3760 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6b66ffd640 1 -- 172.21.15.138:0/2414168266 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0149c0 con 0x5638e3cf3760 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6b66ffd640 1 -- 172.21.15.138:0/2414168266 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c012ca0 con 0x5638e3cf3760 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- 172.21.15.138:0/2414168266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 msgr2=0x5638e3cf3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 --2- 172.21.15.138:0/2414168266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0495d0 tx=0x7f6c7c02bf20 comp rx=0 tx=0).stop 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- 172.21.15.138:0/2414168266 shutdown_connections 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 --2- 172.21.15.138:0/2414168266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cf3b80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- 172.21.15.138:0/2414168266 >> 172.21.15.138:0/2414168266 conn(0x5638e3cee2e0 msgr2=0x5638e3cef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- 172.21.15.138:0/2414168266 shutdown_connections 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- 172.21.15.138:0/2414168266 wait complete. 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 Processor -- start 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- start start 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c85850980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e3cfaa40 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46222/0 (socket says 172.21.15.138:46222) 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 learned_addr learned my addr 172.21.15.138:0/1575046841 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e3ce7ec0 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.752+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c046040 tx=0x7f6c7c049560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 -- 172.21.15.138:0/1575046841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c012eb0 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638e3cfac40 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 -- 172.21.15.138:0/1575046841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c014b30 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 -- 172.21.15.138:0/1575046841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c7c0134e0 con 0x5638e3cf3760 2024-02-16T10:30:51.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638e3cfb070 con 0x5638e3cf3760 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 -- 172.21.15.138:0/1575046841 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6c7c013640 con 0x5638e3cf3760 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b4c0342b0 0x7f6b4c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6b657fa640 1 -- 172.21.15.138:0/1575046841 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f6c7c037ca0 con 0x5638e3cf3760 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b4c0342b0 0x7f6b4c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3d05c30 0x5638e3d080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d08820 con 0x5638e3d05c30 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3d05c30 0x5638e3d080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b4c0342b0 0x7f6b4c036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c74017fd0 tx=0x7f6c7403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3d05c30 0x5638e3d080d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 realm 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d08c10 con 0x5638e3d05c30 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d09460 con 0x5638e3d05c30 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d097c0 con 0x5638e3d05c30 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d09fc0 con 0x5638e3d05c30 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 20 searching for the correct realm 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5638e3d0be70 0x5638e3d0e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d0e9b0 con 0x5638e3d0be70 2024-02-16T10:30:51.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.756+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5638e3d0be70 0x5638e3d0e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5638e3d0be70 0x5638e3d0e330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c83b6c640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6c7c014070 0x7f6c7c002cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6c7c014070 0x7f6c7c002cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6c7c014070 0x7f6c7c002cd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c8336b640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6c74056040 0x7f6c7401a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6c74056040 0x7f6c7401a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6c74056040 0x7f6c7401a3d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.760+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.764+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.768+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d0be70 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c74056040 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x5638e3d05c30 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6c7c056040 con 0x7f6c7c014070 2024-02-16T10:30:51.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d0a7c0 con 0x5638e3d05c30 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d0ab70 con 0x5638e3d05c30 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d0af50 con 0x7f6c7c014070 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 zone default found 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 4 Realm: () 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 zonegroup default 2024-02-16T10:30:51.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d0b460 con 0x7f6c74056040 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d10d10 con 0x5638e3d0be70 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.772+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d11070 con 0x5638e3d0be70 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 20 started sync module instance, tier type = 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:51.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d10150 con 0x7f6c7c014070 2024-02-16T10:30:51.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94802340281520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d11420 con 0x7f6c7c014070 2024-02-16T10:30:51.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d11c20 con 0x5638e3d05c30 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94802340281520] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94802340283696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d11c80 con 0x5638e3d05c30 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.776+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d12750 con 0x5638e3d0be70 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94802340283696] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94802340288384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d12710 con 0x5638e3d0be70 2024-02-16T10:30:51.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d13110 con 0x7f6c7c014070 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94802340293744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d13960 con 0x7f6c7c014070 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d14380 con 0x5638e3d05c30 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94802340288384] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.780+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94802340293744] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94802340295872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d12230 con 0x5638e3d05c30 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d14bd0 con 0x7f6c74056040 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94802340295872] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94802340298336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d14b30 con 0x7f6c74056040 2024-02-16T10:30:51.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.784+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d154a0 con 0x7f6c74056040 2024-02-16T10:30:51.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94802340302848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d158c0 con 0x7f6c74056040 2024-02-16T10:30:51.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d162a0 con 0x7f6c74056040 2024-02-16T10:30:51.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94802340298336] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94802340302848] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94802340300432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d15fa0 con 0x7f6c74056040 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=0 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=1 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=2 2024-02-16T10:30:51.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=3 2024-02-16T10:30:51.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=4 2024-02-16T10:30:51.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=5 2024-02-16T10:30:51.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.788+0000 7f6c85850980 20 add_watcher() i=6 2024-02-16T10:30:51.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94802340300432] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 20 add_watcher() i=7 2024-02-16T10:30:51.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:51.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d19360 con 0x5638e3d05c30 2024-02-16T10:30:51.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94802340306576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d16750 con 0x5638e3d05c30 2024-02-16T10:30:51.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94802340306576] v31'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:51.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:51.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.792+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d21790 con 0x5638e3d05c30 2024-02-16T10:30:51.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d21c30 con 0x7f6c74056040 2024-02-16T10:30:51.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d220d0 con 0x5638e3d0be70 2024-02-16T10:30:51.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.796+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d1f8a0 con 0x5638e3d05c30 2024-02-16T10:30:51.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d1f8a0 con 0x7f6c7c014070 2024-02-16T10:30:51.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d22e10 con 0x5638e3d0be70 2024-02-16T10:30:51.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.800+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23340 con 0x5638e3d05c30 2024-02-16T10:30:51.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.804+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.804+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d237e0 con 0x7f6c74056040 2024-02-16T10:30:51.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.804+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.804+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d22e10 con 0x7f6c7c014070 2024-02-16T10:30:51.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d239b0 con 0x5638e3d0be70 2024-02-16T10:30:51.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x7f6c7c014070 2024-02-16T10:30:51.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.808+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x7f6c74056040 2024-02-16T10:30:51.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.812+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.812+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x7f6c7c014070 2024-02-16T10:30:51.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.812+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.812+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x7f6c74056040 2024-02-16T10:30:51.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x5638e3d05c30 2024-02-16T10:30:51.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d23ee0 con 0x5638e3d0be70 2024-02-16T10:30:51.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.816+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d241b0 con 0x7f6c7c014070 2024-02-16T10:30:51.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d241b0 con 0x5638e3d0be70 2024-02-16T10:30:51.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d05c30 2024-02-16T10:30:51.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.820+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d05c30 2024-02-16T10:30:51.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.824+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.824+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.824+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.824+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x7f6c7c014070 2024-02-16T10:30:51.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.828+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x7f6c74056040 2024-02-16T10:30:51.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.832+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.836+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.836+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x7f6c74056040 2024-02-16T10:30:51.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.836+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.836+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x5638e3d0be70 2024-02-16T10:30:51.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.840+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.840+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x7f6c74056040 2024-02-16T10:30:51.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.840+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.840+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d24120 con 0x7f6c7c014070 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6b38fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 20 Filter name: none 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6ab27fc640 20 reqs_thread_entry: start 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 20 rados->read ofs=0 len=0 2024-02-16T10:30:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d1db30 con 0x7f6c74056040 2024-02-16T10:30:51.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d1db30 con 0x7f6c74056040 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.844+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.854 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:30:51.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:51.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94802340306576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d16fa0 con 0x5638e3d05c30 2024-02-16T10:30:51.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94802340306576] v31'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94802340281520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d15e90 con 0x7f6c7c014070 2024-02-16T10:30:51.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94802340281520] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c85850980 20 remove_watcher() i=0 2024-02-16T10:30:51.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c85850980 2 removed watcher, disabling cache 2024-02-16T10:30:51.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.848+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94802340283696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d15e90 con 0x5638e3d05c30 2024-02-16T10:30:51.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94802340283696] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c85850980 20 remove_watcher() i=1 2024-02-16T10:30:51.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94802340288384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d10530 con 0x5638e3d0be70 2024-02-16T10:30:51.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c83b6c640 1 -- 172.21.15.138:0/1575046841 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94802340288384] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c7c00a4d0 con 0x5638e3d0be70 2024-02-16T10:30:51.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c85850980 20 remove_watcher() i=2 2024-02-16T10:30:51.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.852+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94802340293744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d15e90 con 0x7f6c7c014070 2024-02-16T10:30:51.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c8336b640 1 -- 172.21.15.138:0/1575046841 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94802340293744] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c74016070 con 0x7f6c7c014070 2024-02-16T10:30:51.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c85850980 20 remove_watcher() i=3 2024-02-16T10:30:51.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94802340295872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d12c70 con 0x5638e3d05c30 2024-02-16T10:30:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94802340295872] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x5638e3d05c30 2024-02-16T10:30:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c85850980 20 remove_watcher() i=4 2024-02-16T10:30:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.856+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94802340298336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d15e90 con 0x7f6c74056040 2024-02-16T10:30:51.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94802340298336] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c85850980 20 remove_watcher() i=5 2024-02-16T10:30:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94802340302848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d134c0 con 0x7f6c74056040 2024-02-16T10:30:51.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94802340302848] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c85850980 20 remove_watcher() i=6 2024-02-16T10:30:51.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.860+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94802340300432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5638e3d12c70 con 0x7f6c74056040 2024-02-16T10:30:51.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94802340300432] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c780b0020 con 0x7f6c74056040 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 20 remove_watcher() i=7 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6c74056040 msgr2=0x7f6c7401a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6c74056040 0x7f6c7401a3d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3d05c30 msgr2=0x5638e3d080d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3d05c30 0x5638e3d080d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6c7c014070 msgr2=0x7f6c7c002cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6c7c014070 0x7f6c7c002cd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5638e3d0be70 msgr2=0x5638e3d0e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5638e3d0be70 0x5638e3d0e330 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b4c0342b0 msgr2=0x7f6b4c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b4c0342b0 0x7f6b4c036770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c74017fd0 tx=0x7f6c7403a000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 msgr2=0x5638e3cfa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c82b6a640 1 -- 172.21.15.138:0/1575046841 reap_dead start 2024-02-16T10:30:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c046040 tx=0x7f6c7c049560 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 shutdown_connections 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1575046841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3cf3760 0x5638e3cfa500 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 >> 172.21.15.138:0/1575046841 conn(0x5638e3cee2e0 msgr2=0x5638e3cef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 shutdown_connections 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1575046841 wait complete. 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 msgr2=0x7f6b5c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 0x7f6b5c036770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5638e3cd3ad0 tx=0x7f6c7401cf10 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 msgr2=0x5638e3ce6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5638e3ccce30 tx=0x7f6c7c0188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 shutdown_connections 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b5c0342b0 0x7f6b5c036770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1560099354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3ce67c0 0x5638e3ce6be0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 >> 172.21.15.138:0/1560099354 conn(0x5638e3cdb5d0 msgr2=0x5638e3cdc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 shutdown_connections 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1560099354 wait complete. 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 msgr2=0x5638e3cd2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 0x5638e3cd2cb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 msgr2=0x5638e3cd82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 0x5638e3cd82a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 msgr2=0x7f6b68036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 0x7f6b68036770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c780ae000 tx=0x7f6c780a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 msgr2=0x5638e3ccbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b650 tx=0x7f6c74000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 shutdown_connections 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5638e3cd4950 0x5638e3cd82a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5638e3cd08c0 0x5638e3cd2cb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6b680342b0 0x7f6b68036770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 --2- 172.21.15.138:0/1511690361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5638e3bdedb0 0x5638e3ccbc30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 >> 172.21.15.138:0/1511690361 conn(0x5638e3bd2d70 msgr2=0x5638e3cbef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 shutdown_connections 2024-02-16T10:30:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.864+0000 7f6c85850980 1 -- 172.21.15.138:0/1511690361 wait complete. 2024-02-16T10:30:51.882 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:30:51.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T10:30:51.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-02-16T10:30:51.882 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-02-16T10:30:51.961 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:51.961 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:51.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.952+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:51.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ad6f4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cbecd297f0 0x55cbecd27da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ad6f4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cbeccffb60 con 0x55cbecd282e0 2024-02-16T10:30:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ad6f4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cbeccc6d30 con 0x55cbecd297f0 2024-02-16T10:30:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ab20f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cbecd297f0 0x55cbecd27da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7aaa0e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55cbecd282e0 0x55cbecdbb5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52246/0 (socket says 172.21.15.138:52246) 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3873117787 learned_addr learned my addr 172.21.15.138:0/3873117787 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7aa20d640 1 -- 172.21.15.138:0/3873117787 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190995128 0 0) 0x55cbeccffb60 con 0x55cbecd282e0 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7aa20d640 1 -- 172.21.15.138:0/3873117787 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd798001e20 con 0x55cbecd282e0 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3873117787 >> v1:172.21.15.107:6789/0 conn(0x55cbecd282e0 legacy=0x55cbecdbb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3873117787 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbecd286f0 con 0x55cbecd297f0 2024-02-16T10:30:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.956+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3873117787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd297f0 0x55cbecd27da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a420 tx=0x7fd79c01af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484bd043317dcd1f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7aa20d640 1 -- 172.21.15.138:0/3873117787 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0a3d60 con 0x55cbecd297f0 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7aa20d640 1 -- 172.21.15.138:0/3873117787 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0ab440 con 0x55cbecd297f0 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7aa20d640 1 -- 172.21.15.138:0/3873117787 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0ab720 con 0x55cbecd297f0 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3873117787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd297f0 msgr2=0x55cbecd27da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3873117787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd297f0 0x55cbecd27da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a420 tx=0x7fd79c01af70 comp rx=0 tx=0).stop 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3873117787 shutdown_connections 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3873117787 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd297f0 0x55cbecd27da0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3873117787 >> 172.21.15.138:0/3873117787 conn(0x55cbecdaeec0 msgr2=0x55cbecdb12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3873117787 shutdown_connections 2024-02-16T10:30:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.960+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3873117787 wait complete. 2024-02-16T10:30:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ad6f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ad6f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbeccc3fc0 con 0x55cbecd282e0 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ab20f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ab20f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46242/0 (socket says 172.21.15.138:46242) 2024-02-16T10:30:51.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ab20f640 1 -- 172.21.15.138:0/72564614 learned_addr learned my addr 172.21.15.138:0/72564614 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ab20f640 1 -- 172.21.15.138:0/72564614 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c00a100 con 0x55cbecd282e0 2024-02-16T10:30:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/72564614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0ae040 tx=0x7fd79c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807ec96605bb0e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd69960a640 1 -- 172.21.15.138:0/72564614 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0a4e70 con 0x55cbecd282e0 2024-02-16T10:30:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd69960a640 1 -- 172.21.15.138:0/72564614 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0ab5b0 con 0x55cbecd282e0 2024-02-16T10:30:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.972+0000 7fd69960a640 1 -- 172.21.15.138:0/72564614 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0ab850 con 0x55cbecd282e0 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/72564614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 msgr2=0x55cbece9fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/72564614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0ae040 tx=0x7fd79c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/72564614 shutdown_connections 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/72564614 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbece9fbe0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/72564614 >> 172.21.15.138:0/72564614 conn(0x55cbecdaeec0 msgr2=0x55cbece9b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/72564614 shutdown_connections 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/72564614 wait complete. 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbeccbf7a0 con 0x55cbecd282e0 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ab20f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ab20f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46250/0 (socket says 172.21.15.138:46250) 2024-02-16T10:30:51.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3010542697 learned_addr learned my addr 172.21.15.138:0/3010542697 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbecd286f0 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f90 tx=0x7fd79c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd697e07640 1 -- 172.21.15.138:0/3010542697 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0b4750 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cbecea6ed0 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd697e07640 1 -- 172.21.15.138:0/3010542697 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0b48b0 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd697e07640 1 -- 172.21.15.138:0/3010542697 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd79c0b4b90 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.976+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbecea73e0 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd697e07640 1 -- 172.21.15.138:0/3010542697 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd79c0b2040 con 0x55cbecd282e0 2024-02-16T10:30:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd697e07640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 0x7fd6900367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd697e07640 1 -- 172.21.15.138:0/3010542697 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd79c0e3500 con 0x55cbecd282e0 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 0x7fd6900367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 0x55cbecead680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceadbc0 con 0x55cbecd297f0 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 0x55cbecead680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 0x7fd6900367c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd794001dc0 tx=0x7fd794001360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 0x55cbecead680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 -- 172.21.15.138:0/3010542697 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd7a40083f0 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceadfa0 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 -- 172.21.15.138:0/3010542697 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd7a40083f0 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceaf850 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 -- 172.21.15.138:0/3010542697 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fd7a40083f0 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceaea50 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7aba10640 1 -- 172.21.15.138:0/3010542697 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd7a40083f0 con 0x55cbecd297f0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 0x55cbeceb2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceb3220 con 0x55cbeceaf370 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 0x55cbeceb2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 0x55cbeceb2bd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3010542697 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fd79c0b39b0 con 0x55cbeceaf370 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.980+0000 7fd7ad6f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbecc57f20 con 0x55cbecec11c0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46266/0 (socket says 172.21.15.138:46266) 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 -- 172.21.15.138:0/985489131 learned_addr learned my addr 172.21.15.138:0/985489131 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 -- 172.21.15.138:0/985489131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbecec1b20 con 0x55cbecec11c0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55cbecea7be0 tx=0x7fd7a400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 -- 172.21.15.138:0/985489131 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a400f040 con 0x55cbecec11c0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 -- 172.21.15.138:0/985489131 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4019550 con 0x55cbecec11c0 2024-02-16T10:30:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 -- 172.21.15.138:0/985489131 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a40197f0 con 0x55cbecec11c0 2024-02-16T10:30:51.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cbecec1d70 con 0x55cbecec11c0 2024-02-16T10:30:51.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbecec28c0 con 0x55cbecec11c0 2024-02-16T10:30:51.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 -- 172.21.15.138:0/985489131 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd7a40199a0 con 0x55cbecec11c0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 0x7fd684036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd695602640 1 -- 172.21.15.138:0/985489131 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd7a404b480 con 0x55cbecec11c0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 0x7fd684036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 0x7fd684036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55cbeceae490 tx=0x7fd79c0e3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7ad6f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbecc4b790 con 0x55cbecece1c0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46278/0 (socket says 172.21.15.138:46278) 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.984+0000 7fd7aba10640 1 -- 172.21.15.138:0/3946533057 learned_addr learned my addr 172.21.15.138:0/3946533057 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 -- 172.21.15.138:0/3946533057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbececebb0 con 0x55cbecece1c0 2024-02-16T10:30:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3946533057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40498a0 tx=0x7fd7a402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862af35a42f3bb2e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68effd640 1 -- 172.21.15.138:0/3946533057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4048070 con 0x55cbecece1c0 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68effd640 1 -- 172.21.15.138:0/3946533057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a40153a0 con 0x55cbecece1c0 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68effd640 1 -- 172.21.15.138:0/3946533057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4015cc0 con 0x55cbecece1c0 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3946533057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 msgr2=0x55cbecece5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3946533057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40498a0 tx=0x7fd7a402a410 comp rx=0 tx=0).stop 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3946533057 shutdown_connections 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3946533057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbecece5e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3946533057 >> 172.21.15.138:0/3946533057 conn(0x55cbecec8d40 msgr2=0x55cbecec9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3946533057 shutdown_connections 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3946533057 wait complete. 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 Processor -- start 2024-02-16T10:30:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- start start 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbeced5410 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46280/0 (socket says 172.21.15.138:46280) 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 learned_addr learned my addr 172.21.15.138:0/3910607383 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbecec28c0 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd7a403e040 tx=0x7fd7a4049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68d7fa640 1 -- 172.21.15.138:0/3910607383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4018530 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68d7fa640 1 -- 172.21.15.138:0/3910607383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4015510 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cbeced5610 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd68d7fa640 1 -- 172.21.15.138:0/3910607383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7a4048070 con 0x55cbecece1c0 2024-02-16T10:30:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.988+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbeced5a40 con 0x55cbecece1c0 2024-02-16T10:30:52.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd68d7fa640 1 -- 172.21.15.138:0/3910607383 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd7a4032020 con 0x55cbecece1c0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd68d7fa640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6740342b0 0x7fd674036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd68d7fa640 1 -- 172.21.15.138:0/3910607383 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fd7a4037c90 con 0x55cbecece1c0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6740342b0 0x7fd674036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecee0660 0x55cbecee2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee3270 con 0x55cbecee0660 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecee0660 0x55cbecee2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6740342b0 0x7fd674036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0cdfb0 tx=0x7fd79c0dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecee0660 0x55cbecee2b20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 realm 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecedfac0 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee3cb0 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee3940 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee4a70 con 0x55cbecee0660 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 20 searching for the correct realm 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cbecee6970 0x55cbecee8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cbecee6970 0x55cbecee8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cbecee6970 0x55cbecee8e30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aba10640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd7a4022070 0x7fd7a401d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd7a4022070 0x7fd7a401d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.992+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd7a4022070 0x7fd7a401d070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7ab20f640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd79c0f1040 0x7fd79c0e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd79c0f1040 0x7fd79c0e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd79c0f1040 0x7fd79c0e0100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:51.996+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.000+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee6970 2024-02-16T10:30:52.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd79c0f1040 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x55cbecee0660 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.004+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9500 con 0x7fd7a4022070 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee5f40 con 0x55cbecee0660 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee5760 con 0x55cbecee0660 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9940 con 0x7fd7a4022070 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 zone default found 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 4 Realm: () 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 zonegroup default 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecee9ca0 con 0x7fd79c0f1040 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceebed0 con 0x55cbecee6970 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceec230 con 0x55cbecee6970 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 started sync module instance, tier type = 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceeb4a0 con 0x7fd7a4022070 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334341787648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceec230 con 0x7fd7a4022070 2024-02-16T10:30:52.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.008+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceecba0 con 0x55cbecee0660 2024-02-16T10:30:52.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334341787648] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334341793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceecb20 con 0x55cbecee0660 2024-02-16T10:30:52.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceed940 con 0x55cbecee6970 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334341796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceed900 con 0x55cbecee6970 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.012+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceee820 con 0x7fd7a4022070 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334341793536] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334341800800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceeebd0 con 0x7fd7a4022070 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceef540 con 0x55cbecee0660 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334341796896] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334341800800] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334341799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceed090 con 0x55cbecee0660 2024-02-16T10:30:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.016+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceefdc0 con 0x7fd79c0f1040 2024-02-16T10:30:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334341799152] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334341804192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceefcd0 con 0x7fd79c0f1040 2024-02-16T10:30:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef0640 con 0x7fd79c0f1040 2024-02-16T10:30:52.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334341804192] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334341806400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef0640 con 0x7fd79c0f1040 2024-02-16T10:30:52.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.020+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef0fb0 con 0x7fd79c0f1040 2024-02-16T10:30:52.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334341806400] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334341808816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef0fb0 con 0x7fd79c0f1040 2024-02-16T10:30:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=0 2024-02-16T10:30:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=1 2024-02-16T10:30:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=2 2024-02-16T10:30:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=3 2024-02-16T10:30:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=4 2024-02-16T10:30:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=5 2024-02-16T10:30:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=6 2024-02-16T10:30:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334341808816] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 20 add_watcher() i=7 2024-02-16T10:30:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef42e0 con 0x55cbecee0660 2024-02-16T10:30:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.024+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334341823776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecef1120 con 0x55cbecee0660 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334341823776] v31'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 5 note: GC not initialized 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd660fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 Filter name: none 2024-02-16T10:30:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd5da7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:52.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:52.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf16230 con 0x7fd79c0f1040 2024-02-16T10:30:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf17c30 con 0x7fd7a4022070 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf192d0 con 0x55cbecee0660 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.028+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1c7c0 con 0x7fd79c0f1040 2024-02-16T10:30:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-02-16T10:30:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1b7d0 con 0x7fd7a4022070 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.032+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf20380 con 0x7fd7a4022070 2024-02-16T10:30:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'23 uv23 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ad6f4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:30:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ad6f4980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ad6f4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94334342004256 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1d160 con 0x7fd79c0f1040 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== watch-notify(notify (1) cookie 94334341806400 notify 133143986189 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7fd794038040 con 0x7fd79c0f1040 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd68effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94334341806400 notifier 4514 bl.length()=338 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd68effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd68effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(68 notify.6 [notify cookie 94334342004256 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd68effd640 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd670003ea0 con 0x7fd79c0f1040 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== watch-notify(notify_complete (2) cookie 94334342004256 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd798001e20 con 0x7fd79c0f1040 2024-02-16T10:30:52.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.036+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334341823776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1fe20 con 0x55cbecee0660 2024-02-16T10:30:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94334341823776] v31'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334341787648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1fe20 con 0x7fd7a4022070 2024-02-16T10:30:52.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94334341787648] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 20 remove_watcher() i=0 2024-02-16T10:30:52.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 2 removed watcher, disabling cache 2024-02-16T10:30:52.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334341793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1fe20 con 0x55cbecee0660 2024-02-16T10:30:52.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94334341793536] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 20 remove_watcher() i=1 2024-02-16T10:30:52.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.040+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334341796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceec700 con 0x55cbecee6970 2024-02-16T10:30:52.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7aba10640 1 -- 172.21.15.138:0/3910607383 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94334341796896] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd7a4012070 con 0x55cbecee6970 2024-02-16T10:30:52.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7ad6f4980 20 remove_watcher() i=2 2024-02-16T10:30:52.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334341800800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1fe20 con 0x7fd7a4022070 2024-02-16T10:30:52.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7ab20f640 1 -- 172.21.15.138:0/3910607383 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94334341800800] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79c0b39b0 con 0x7fd7a4022070 2024-02-16T10:30:52.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7ad6f4980 20 remove_watcher() i=3 2024-02-16T10:30:52.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.044+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334341799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceec700 con 0x55cbecee0660 2024-02-16T10:30:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94334341799152] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x55cbecee0660 2024-02-16T10:30:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7ad6f4980 20 remove_watcher() i=4 2024-02-16T10:30:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334341804192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbecf1fe20 con 0x7fd79c0f1040 2024-02-16T10:30:52.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94334341804192] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7ad6f4980 20 remove_watcher() i=5 2024-02-16T10:30:52.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.048+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334341806400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceedcf0 con 0x7fd79c0f1040 2024-02-16T10:30:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94334341806400] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 20 remove_watcher() i=6 2024-02-16T10:30:52.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334341808816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cbeceec700 con 0x7fd79c0f1040 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94334341808816] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd79400e660 con 0x7fd79c0f1040 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 20 remove_watcher() i=7 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd79c0f1040 msgr2=0x7fd79c0e0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fd79c0f1040 0x7fd79c0e0100 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecee0660 msgr2=0x55cbecee2b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecee0660 0x55cbecee2b20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd7a4022070 msgr2=0x7fd7a401d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fd7a4022070 0x7fd7a401d070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cbecee6970 msgr2=0x55cbecee8e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cbecee6970 0x55cbecee8e30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6740342b0 msgr2=0x7fd674036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6740342b0 0x7fd674036770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0cdfb0 tx=0x7fd79c0dc000 comp rx=0 tx=0).stop 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 msgr2=0x55cbeced4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7aaa0e640 1 -- 172.21.15.138:0/3910607383 reap_dead start 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd7a403e040 tx=0x7fd7a4049800 comp rx=0 tx=0).stop 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 shutdown_connections 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3910607383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecece1c0 0x55cbeced4ed0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 >> 172.21.15.138:0/3910607383 conn(0x55cbecec8d40 msgr2=0x55cbecec9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 shutdown_connections 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3910607383 wait complete. 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 msgr2=0x7fd684036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 0x7fd684036770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55cbeceae490 tx=0x7fd79c0e3040 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 msgr2=0x55cbecec15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55cbecea7be0 tx=0x7fd7a400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 shutdown_connections 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd6840342b0 0x7fd684036770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/985489131 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecec11c0 0x55cbecec15e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 >> 172.21.15.138:0/985489131 conn(0x55cbeceb5fd0 msgr2=0x55cbeceb6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 shutdown_connections 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/985489131 wait complete. 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 msgr2=0x55cbecead680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 0x55cbecead680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 msgr2=0x55cbeceb2bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 0x55cbeceb2bd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 msgr2=0x7fd6900367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 0x7fd6900367c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd794001dc0 tx=0x7fd794001360 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 msgr2=0x55cbecea6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f90 tx=0x7fd79c019810 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 shutdown_connections 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cbeceaf370 0x55cbeceb2bd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cbecd297f0 0x55cbecead680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd690034300 0x7fd6900367c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 --2- 172.21.15.138:0/3010542697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cbecd282e0 0x55cbecea6990 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 >> 172.21.15.138:0/3010542697 conn(0x55cbecdaeec0 msgr2=0x55cbece9a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 shutdown_connections 2024-02-16T10:30:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.052+0000 7fd7ad6f4980 1 -- 172.21.15.138:0/3010542697 wait complete. 2024-02-16T10:30:52.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1'] 2024-02-16T10:30:52.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1'] 2024-02-16T10:30:52.072 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:52.145 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:52.145 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.136+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.136+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.136+0000 7f05ec2f3980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563e20dba580 0x563e20dba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.136+0000 7f05ec2f3980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563e20d06af0 con 0x563e20dbaea0 2024-02-16T10:30:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.136+0000 7f05ec2f3980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563e20ccdd30 con 0x563e20dba580 2024-02-16T10:30:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e9e0e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563e20dba580 0x563e20dba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e960d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563e20dbaea0 0x563e20dbb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52250/0 (socket says 172.21.15.138:52250) 2024-02-16T10:30:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e960d640 1 -- 172.21.15.138:0/1909335886 learned_addr learned my addr 172.21.15.138:0/1909335886 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e8e0c640 1 -- 172.21.15.138:0/1909335886 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213687950 0 0) 0x563e20d06af0 con 0x563e20dbaea0 2024-02-16T10:30:52.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e8e0c640 1 -- 172.21.15.138:0/1909335886 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d8001e20 con 0x563e20dbaea0 2024-02-16T10:30:52.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1909335886 >> v1:172.21.15.107:6789/0 conn(0x563e20dbaea0 legacy=0x563e20dbb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1909335886 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e20dbc090 con 0x563e20dba580 2024-02-16T10:30:52.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1909335886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20dba960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00a420 tx=0x7f05dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b46ff4677591c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e8e0c640 1 -- 172.21.15.138:0/1909335886 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0aa530 con 0x563e20dba580 2024-02-16T10:30:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e8e0c640 1 -- 172.21.15.138:0/1909335886 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0a6050 con 0x563e20dba580 2024-02-16T10:30:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.140+0000 7f05e8e0c640 1 -- 172.21.15.138:0/1909335886 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0aa800 con 0x563e20dba580 2024-02-16T10:30:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1909335886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 msgr2=0x563e20dba960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1909335886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20dba960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00a420 tx=0x7f05dc01afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1909335886 shutdown_connections 2024-02-16T10:30:52.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1909335886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20dba960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1909335886 >> 172.21.15.138:0/1909335886 conn(0x563e20db5e50 msgr2=0x563e20db8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1909335886 shutdown_connections 2024-02-16T10:30:52.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.144+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1909335886 wait complete. 2024-02-16T10:30:52.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e20ccafc0 con 0x563e20dba580 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05e9e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05e9e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46286/0 (socket says 172.21.15.138:46286) 2024-02-16T10:30:52.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1639638151 learned_addr learned my addr 172.21.15.138:0/1639638151 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1639638151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc00a100 con 0x563e20dba580 2024-02-16T10:30:52.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1639638151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ad040 tx=0x7f05dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530177fa3ed339a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f04d7e07640 1 -- 172.21.15.138:0/1639638151 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0aa630 con 0x563e20dba580 2024-02-16T10:30:52.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f04d7e07640 1 -- 172.21.15.138:0/1639638151 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0aa790 con 0x563e20dba580 2024-02-16T10:30:52.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f04d7e07640 1 -- 172.21.15.138:0/1639638151 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0aaa30 con 0x563e20dba580 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1639638151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 msgr2=0x563e20ea4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1639638151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ad040 tx=0x7f05dc0033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1639638151 shutdown_connections 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1639638151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20ea4ad0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1639638151 >> 172.21.15.138:0/1639638151 conn(0x563e20db5e50 msgr2=0x563e20ea0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1639638151 shutdown_connections 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.156+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1639638151 wait complete. 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e20cc67a0 con 0x563e20dba580 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e9e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e9e0e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46302/0 (socket says 172.21.15.138:46302) 2024-02-16T10:30:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e9e0e640 1 -- 172.21.15.138:0/3942761971 learned_addr learned my addr 172.21.15.138:0/3942761971 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e9e0e640 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e20dbc090 con 0x563e20dba580 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b6040 tx=0x7f05dc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 -- 172.21.15.138:0/3942761971 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0bd870 con 0x563e20dba580 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e20eabea0 con 0x563e20dba580 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 -- 172.21.15.138:0/3942761971 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0bd9d0 con 0x563e20dba580 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 -- 172.21.15.138:0/3942761971 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05dc0bdc90 con 0x563e20dba580 2024-02-16T10:30:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e20eac290 con 0x563e20dba580 2024-02-16T10:30:52.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 -- 172.21.15.138:0/3942761971 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05dc0d0450 con 0x563e20dba580 2024-02-16T10:30:52.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 0x7f04d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f04d6604640 1 -- 172.21.15.138:0/3942761971 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f05dc0e3ee0 con 0x563e20dba580 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05e960d640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 0x7f04d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 0x563e20eb2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eb2b40 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.160+0000 7f05ea60f640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 0x563e20eb2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05e960d640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 0x7f04d0036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05d4000f70 tx=0x7f05d40010b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 0x563e20eb2600 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/3942761971 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e40083f0 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eb2f00 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/3942761971 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05e40083f0 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eb47b0 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/3942761971 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f05e40083f0 con 0x563e20dbaea0 2024-02-16T10:30:52.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eb39b0 con 0x563e20dbaea0 2024-02-16T10:30:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/3942761971 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05e40083f0 con 0x563e20dbaea0 2024-02-16T10:30:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 0x563e20eb7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eb8140 con 0x563e20eb42d0 2024-02-16T10:30:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 0x563e20eb7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 0x563e20eb7b30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05e9e0e640 1 -- 172.21.15.138:0/3942761971 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f05dc0cd070 con 0x563e20eb42d0 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ec2f3980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e20c5ef20 con 0x563e20ec6090 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46308/0 (socket says 172.21.15.138:46308) 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/154448529 learned_addr learned my addr 172.21.15.138:0/154448529 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 -- 172.21.15.138:0/154448529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e20ec69f0 con 0x563e20ec6090 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.164+0000 7f05ea60f640 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x563e20eac9f0 tx=0x7f05e400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 -- 172.21.15.138:0/154448529 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e400f040 con 0x563e20ec6090 2024-02-16T10:30:52.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e20ec6c40 con 0x563e20ec6090 2024-02-16T10:30:52.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 -- 172.21.15.138:0/154448529 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e4019550 con 0x563e20ec6090 2024-02-16T10:30:52.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 -- 172.21.15.138:0/154448529 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e4019810 con 0x563e20ec6090 2024-02-16T10:30:52.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e20ec7790 con 0x563e20ec6090 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 -- 172.21.15.138:0/154448529 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05e4019a00 con 0x563e20ec6090 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 0x7f04c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cf7fe640 1 -- 172.21.15.138:0/154448529 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f05e404b4b0 con 0x563e20ec6090 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 0x7f04c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 0x7f04c4036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563e20eb33f0 tx=0x7f05dc0bde80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ec2f3980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e20c52790 con 0x563e20d300a0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46312/0 (socket says 172.21.15.138:46312) 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ea60f640 1 -- 172.21.15.138:0/2016743609 learned_addr learned my addr 172.21.15.138:0/2016743609 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ea60f640 1 -- 172.21.15.138:0/2016743609 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e20d30a70 con 0x563e20d300a0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f05ea60f640 1 --2- 172.21.15.138:0/2016743609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f05e4018fd0 tx=0x7f05e402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6911b1646da3b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cd7fa640 1 -- 172.21.15.138:0/2016743609 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e4048070 con 0x563e20d300a0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cd7fa640 1 -- 172.21.15.138:0/2016743609 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e404b110 con 0x563e20d300a0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.168+0000 7f04cd7fa640 1 -- 172.21.15.138:0/2016743609 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e40153a0 con 0x563e20d300a0 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/2016743609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 msgr2=0x563e20d304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/2016743609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f05e4018fd0 tx=0x7f05e402af40 comp rx=0 tx=0).stop 2024-02-16T10:30:52.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/2016743609 shutdown_connections 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/2016743609 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20d304a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/2016743609 >> 172.21.15.138:0/2016743609 conn(0x563e20ecdb50 msgr2=0x563e20ecea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/2016743609 shutdown_connections 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/2016743609 wait complete. 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 Processor -- start 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- start start 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20edbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e20edc460 con 0x563e20d300a0 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20edbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ea60f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20edbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46328/0 (socket says 172.21.15.138:46328) 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 learned_addr learned my addr 172.21.15.138:0/1630177081 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e20ec7790 con 0x563e20d300a0 2024-02-16T10:30:52.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ea60f640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20edbf20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05e403e040 tx=0x7f05e4049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 -- 172.21.15.138:0/1630177081 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e4018530 con 0x563e20d300a0 2024-02-16T10:30:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e20edc660 con 0x563e20d300a0 2024-02-16T10:30:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 -- 172.21.15.138:0/1630177081 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e404b280 con 0x563e20d300a0 2024-02-16T10:30:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e20edcaf0 con 0x563e20d300a0 2024-02-16T10:30:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 -- 172.21.15.138:0/1630177081 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e4049d20 con 0x563e20d300a0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 -- 172.21.15.138:0/1630177081 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05e4032020 con 0x563e20d300a0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b40342b0 0x7f04b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f04bb7fe640 1 -- 172.21.15.138:0/1630177081 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f05e4044070 con 0x563e20d300a0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b40342b0 0x7f04b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20ee7610 0x563e20ee9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eea220 con 0x563e20ee7610 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05e960d640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20ee7610 0x563e20ee9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.172+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b40342b0 0x7f04b4036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0bbb50 tx=0x7f05dc0dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20ee7610 0x563e20ee9ad0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 realm 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ee6af0 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eeaca0 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eeb520 con 0x563e20ee7610 2024-02-16T10:30:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eeb880 con 0x563e20ee7610 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 20 searching for the correct realm 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563e20eed940 0x563e20eefe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ea60f640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563e20eed940 0x563e20eefe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ea60f640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563e20eed940 0x563e20eefe00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ea60f640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e4022070 0x7f05e403d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e4022070 0x7f05e403d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e4022070 0x7f05e403d0c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e9e0e640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05dc0d0070 0x7f05dc0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05dc0d0070 0x7f05dc0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.176+0000 7f05e960d640 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05dc0d0070 0x7f05dc0d0700 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.180+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.184+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20eed940 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05dc0d0070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x563e20ee7610 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef0480 con 0x7f05e4022070 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x563e20ee7610 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec610 con 0x563e20ee7610 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec610 con 0x7f05e4022070 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 zone default found 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 4 Realm: () 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 zonegroup default 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.188+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef08c0 con 0x7f05dc0d0070 2024-02-16T10:30:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef2670 con 0x563e20eed940 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef2b00 con 0x563e20eed940 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 started sync module instance, tier type = 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef1f50 con 0x7f05e4022070 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94824840501936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef2300 con 0x7f05e4022070 2024-02-16T10:30:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef38a0 con 0x563e20ee7610 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.192+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94824840501936] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94824840507168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef3c50 con 0x563e20ee7610 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef45c0 con 0x563e20eed940 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94824840511776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef4a60 con 0x563e20eed940 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef5510 con 0x7f05e4022070 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.196+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94824840507168] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94824840515600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef58f0 con 0x7f05e4022070 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef6260 con 0x563e20ee7610 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94824840511776] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94824840515600] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94824840512832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef3450 con 0x563e20ee7610 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef6ab0 con 0x7f05dc0d0070 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.200+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94824840512832] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94824840519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef69d0 con 0x7f05dc0d0070 2024-02-16T10:30:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef7340 con 0x7f05dc0d0070 2024-02-16T10:30:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94824840523424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef7760 con 0x7f05dc0d0070 2024-02-16T10:30:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94824840519104] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.204+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef6550 con 0x7f05dc0d0070 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94824840523424] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94824840524480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef76e0 con 0x7f05dc0d0070 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=0 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=1 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=2 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=3 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=4 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=5 2024-02-16T10:30:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=6 2024-02-16T10:30:52.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94824840524480] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 20 add_watcher() i=7 2024-02-16T10:30:52.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:52.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20efb100 con 0x563e20ee7610 2024-02-16T10:30:52.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.208+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94824840526896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef8590 con 0x563e20ee7610 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94824840526896] v31'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f049b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 5 note: GC not initialized 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f049a7fc640 20 reqs_thread_entry: start 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 Filter name: none 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f040bfff640 20 reqs_thread_entry: start 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f1cf80 con 0x563e20ee7610 2024-02-16T10:30:52.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f1e980 con 0x7f05e4022070 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f20430 con 0x563e20ee7610 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.212+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f24790 con 0x7f05dc0d0070 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f2a770 con 0x563e20ee7610 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94824840693984 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f24b80 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94824840512832 notify 133143986189 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f05d4038040 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f04cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94824840512832 notifier 4521 bl.length()=725 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f04cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f04cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f04cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(67 notify.4 [notify cookie 94824840693984 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f04cd7fa640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f04ac003ea0 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94824840693984 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f05d8001e20 con 0x563e20ee7610 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.216+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f28f40 con 0x7f05e4022070 2024-02-16T10:30:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(69 foo.buckets [call] v31'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f29f50 con 0x7f05e4022070 2024-02-16T10:30:52.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'25 uv25 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05ec2f3980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:52.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05ec2f3980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05ec2f3980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:52.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94824840693952 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f293e0 con 0x7f05dc0d0070 2024-02-16T10:30:52.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== watch-notify(notify (1) cookie 94824840523424 notify 133143986190 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f05d8001e20 con 0x7f05dc0d0070 2024-02-16T10:30:52.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f04cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94824840523424 notifier 4521 bl.length()=314 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f04cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f04cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.6 [notify cookie 94824840693952 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.220+0000 7f04cd7fa640 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f04ac004200 con 0x7f05dc0d0070 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== watch-notify(notify_complete (2) cookie 94824840693952 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f05d4020980 con 0x7f05dc0d0070 2024-02-16T10:30:52.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f049b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94824840526896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20f21460 con 0x563e20ee7610 2024-02-16T10:30:52.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94824840526896] v31'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94824840501936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20ef7c30 con 0x7f05e4022070 2024-02-16T10:30:52.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94824840501936] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05ec2f3980 20 remove_watcher() i=0 2024-02-16T10:30:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05ec2f3980 2 removed watcher, disabling cache 2024-02-16T10:30:52.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.224+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94824840507168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x563e20ee7610 2024-02-16T10:30:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94824840507168] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05ec2f3980 20 remove_watcher() i=1 2024-02-16T10:30:52.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94824840511776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x563e20eed940 2024-02-16T10:30:52.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05ea60f640 1 -- 172.21.15.138:0/1630177081 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94824840511776] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e4042040 con 0x563e20eed940 2024-02-16T10:30:52.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05ec2f3980 20 remove_watcher() i=2 2024-02-16T10:30:52.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.228+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94824840515600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x7f05e4022070 2024-02-16T10:30:52.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05e9e0e640 1 -- 172.21.15.138:0/1630177081 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94824840515600] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05dc0cd070 con 0x7f05e4022070 2024-02-16T10:30:52.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05ec2f3980 20 remove_watcher() i=3 2024-02-16T10:30:52.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94824840512832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x563e20ee7610 2024-02-16T10:30:52.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94824840512832] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x563e20ee7610 2024-02-16T10:30:52.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05ec2f3980 20 remove_watcher() i=4 2024-02-16T10:30:52.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.232+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94824840519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x7f05dc0d0070 2024-02-16T10:30:52.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94824840519104] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05ec2f3980 20 remove_watcher() i=5 2024-02-16T10:30:52.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94824840523424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x7f05dc0d0070 2024-02-16T10:30:52.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94824840523424] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05ec2f3980 20 remove_watcher() i=6 2024-02-16T10:30:52.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.236+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94824840524480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563e20eec260 con 0x7f05dc0d0070 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94824840524480] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05d400e640 con 0x7f05dc0d0070 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 20 remove_watcher() i=7 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05dc0d0070 msgr2=0x7f05dc0d0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05dc0d0070 0x7f05dc0d0700 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20ee7610 msgr2=0x563e20ee9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20ee7610 0x563e20ee9ad0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e4022070 msgr2=0x7f05e403d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e4022070 0x7f05e403d0c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563e20eed940 msgr2=0x563e20eefe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563e20eed940 0x563e20eefe00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b40342b0 msgr2=0x7f04b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b40342b0 0x7f04b4036770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0bbb50 tx=0x7f05dc0dd000 comp rx=0 tx=0).stop 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 msgr2=0x563e20edbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/1630177081 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20d300a0 0x563e20edbf20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05e403e040 tx=0x7f05e4049830 comp rx=0 tx=0).stop 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05e960d640 1 -- 172.21.15.138:0/1630177081 reap_dead start 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 shutdown_connections 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 >> 172.21.15.138:0/1630177081 conn(0x563e20ecdb50 msgr2=0x563e20ecea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 shutdown_connections 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/1630177081 wait complete. 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 msgr2=0x7f04c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 0x7f04c4036770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563e20eb33f0 tx=0x7f05dc0bde80 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 msgr2=0x563e20ec64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x563e20eac9f0 tx=0x7f05e400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 shutdown_connections 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c40342b0 0x7f04c4036770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/154448529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20ec6090 0x563e20ec64b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 >> 172.21.15.138:0/154448529 conn(0x563e20ebaea0 msgr2=0x563e20ebb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 shutdown_connections 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/154448529 wait complete. 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 msgr2=0x563e20eb2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 0x563e20eb2600 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 msgr2=0x563e20eb7b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 0x563e20eb7b30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 msgr2=0x7f04d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 0x7f04d0036770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05d4000f70 tx=0x7f05d40010b0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 msgr2=0x563e20eab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b6040 tx=0x7f05dc017d70 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 shutdown_connections 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563e20eb42d0 0x563e20eb7b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563e20dbaea0 0x563e20eb2600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d00342b0 0x7f04d0036770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 --2- 172.21.15.138:0/3942761971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563e20dba580 0x563e20eab960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 >> 172.21.15.138:0/3942761971 conn(0x563e20db5e50 msgr2=0x563e20e9f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 shutdown_connections 2024-02-16T10:30:52.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.240+0000 7f05ec2f3980 1 -- 172.21.15.138:0/3942761971 wait complete. 2024-02-16T10:30:52.257 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:52.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-02-16T10:30:52.257 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-02-16T10:30:52.327 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:52.327 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:52.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d2310d980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555c33be9ae0 0x555c33bebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d2310d980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555c33b31b50 con 0x555c33be5620 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d2310d980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x555c33af8d30 con 0x555c33be9ae0 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d20427640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x555c33be9ae0 0x555c33bebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d20c28640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x555c33be5620 0x555c33be5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52260/0 (socket says 172.21.15.138:52260) 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d20c28640 1 -- 172.21.15.138:0/681917814 learned_addr learned my addr 172.21.15.138:0/681917814 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d20427640 1 -- 172.21.15.138:0/681917814 >> v1:172.21.15.107:6789/0 conn(0x555c33be5620 legacy=0x555c33be5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.320+0000 7f3d20427640 1 -- 172.21.15.138:0/681917814 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c33bed420 con 0x555c33be9ae0 2024-02-16T10:30:52.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d20427640 1 --2- 172.21.15.138:0/681917814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be9ae0 0x555c33bebed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400a480 tx=0x7f3d1401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64facde887df2e88 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d1fc26640 1 -- 172.21.15.138:0/681917814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d140ab540 con 0x555c33be9ae0 2024-02-16T10:30:52.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d1fc26640 1 -- 172.21.15.138:0/681917814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d140ab6a0 con 0x555c33be9ae0 2024-02-16T10:30:52.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d1fc26640 1 -- 172.21.15.138:0/681917814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d140ab960 con 0x555c33be9ae0 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 -- 172.21.15.138:0/681917814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be9ae0 msgr2=0x555c33bebed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 --2- 172.21.15.138:0/681917814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be9ae0 0x555c33bebed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400a480 tx=0x7f3d1401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 -- 172.21.15.138:0/681917814 shutdown_connections 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 --2- 172.21.15.138:0/681917814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be9ae0 0x555c33bebed0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 -- 172.21.15.138:0/681917814 >> 172.21.15.138:0/681917814 conn(0x555c33be0ef0 msgr2=0x555c33be3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 -- 172.21.15.138:0/681917814 shutdown_connections 2024-02-16T10:30:52.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.324+0000 7f3d2310d980 1 -- 172.21.15.138:0/681917814 wait complete. 2024-02-16T10:30:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d2310d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d2310d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33af5fc0 con 0x555c33be5620 2024-02-16T10:30:52.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d20c28640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d20c28640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46342/0 (socket says 172.21.15.138:46342) 2024-02-16T10:30:52.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.336+0000 7f3d20c28640 1 -- 172.21.15.138:0/577169484 learned_addr learned my addr 172.21.15.138:0/577169484 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 -- 172.21.15.138:0/577169484 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14005d30 con 0x555c33be5620 2024-02-16T10:30:52.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 --2- 172.21.15.138:0/577169484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d10001c00 tx=0x7f3d1000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f609df482c476d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0ee0d640 1 -- 172.21.15.138:0/577169484 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1000e690 con 0x555c33be5620 2024-02-16T10:30:52.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0ee0d640 1 -- 172.21.15.138:0/577169484 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000e810 con 0x555c33be5620 2024-02-16T10:30:52.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0ee0d640 1 -- 172.21.15.138:0/577169484 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1000eb30 con 0x555c33be5620 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/577169484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 msgr2=0x555c33ccf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 --2- 172.21.15.138:0/577169484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d10001c00 tx=0x7f3d1000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/577169484 shutdown_connections 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 --2- 172.21.15.138:0/577169484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33ccf620 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/577169484 >> 172.21.15.138:0/577169484 conn(0x555c33be0ef0 msgr2=0x555c33ccb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/577169484 shutdown_connections 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/577169484 wait complete. 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33af17a0 con 0x555c33be5620 2024-02-16T10:30:52.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46354/0 (socket says 172.21.15.138:46354) 2024-02-16T10:30:52.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 -- 172.21.15.138:0/2498287463 learned_addr learned my addr 172.21.15.138:0/2498287463 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c33b31b50 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d20c28640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000b710 tx=0x7f3d10000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0d60a640 1 -- 172.21.15.138:0/2498287463 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1001f070 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c33cd6b10 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c33cd6fc0 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0d60a640 1 -- 172.21.15.138:0/2498287463 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1001a910 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.340+0000 7f3c0d60a640 1 -- 172.21.15.138:0/2498287463 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1001abf0 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3c0d60a640 1 -- 172.21.15.138:0/2498287463 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d1000a040 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3c0d60a640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 0x7f3c080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3c0d60a640 1 -- 172.21.15.138:0/2498287463 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d10049fa0 con 0x555c33be5620 2024-02-16T10:30:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 0x555c33cdd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33cdd800 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d20427640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 0x7f3c080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 0x555c33cdd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 0x555c33cdd2c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d20427640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 0x7f3c080367c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d140ad000 tx=0x7f3d140a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 -- 172.21.15.138:0/2498287463 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33cda9f0 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 -- 172.21.15.138:0/2498287463 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33cdf500 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 -- 172.21.15.138:0/2498287463 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33cde700 con 0x555c33be9ae0 2024-02-16T10:30:52.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d21429640 1 -- 172.21.15.138:0/2498287463 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33be9ae0 2024-02-16T10:30:52.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 0x555c33ce2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33ce2f20 con 0x555c33cdf020 2024-02-16T10:30:52.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d20c28640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 0x555c33ce2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d20c28640 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 0x555c33ce2880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d20c28640 1 -- 172.21.15.138:0/2498287463 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3d1002e910 con 0x555c33cdf020 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.344+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33a89f20 con 0x555c33b5c220 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46368/0 (socket says 172.21.15.138:46368) 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 -- 172.21.15.138:0/2944381713 learned_addr learned my addr 172.21.15.138:0/2944381713 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 -- 172.21.15.138:0/2944381713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c33b5ac00 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x555c33cd7170 tx=0x7f3d18018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 -- 172.21.15.138:0/2944381713 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1801d070 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c33b5ae50 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 -- 172.21.15.138:0/2944381713 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d18014450 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 -- 172.21.15.138:0/2944381713 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d180146f0 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c33b5b2e0 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 -- 172.21.15.138:0/2944381713 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d18020020 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 0x7f3bf8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3c067fc640 1 -- 172.21.15.138:0/2944381713 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d1804b260 con 0x555c33b5c220 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d20c28640 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 0x7f3bf8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d20c28640 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 0x7f3bf8036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x555c33cde140 tx=0x7f3d10026ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d2310d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33a7d790 con 0x555c33d04be0 2024-02-16T10:30:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46384/0 (socket says 172.21.15.138:46384) 2024-02-16T10:30:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.348+0000 7f3d21429640 1 -- 172.21.15.138:0/774115527 learned_addr learned my addr 172.21.15.138:0/774115527 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 -- 172.21.15.138:0/774115527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c33cf4b40 con 0x555c33d04be0 2024-02-16T10:30:52.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 --2- 172.21.15.138:0/774115527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3d18018430 tx=0x7f3d1802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80cdaa1a79a90c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf7fff640 1 -- 172.21.15.138:0/774115527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1803f030 con 0x555c33d04be0 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf7fff640 1 -- 172.21.15.138:0/774115527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d18014850 con 0x555c33d04be0 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf7fff640 1 -- 172.21.15.138:0/774115527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d18016570 con 0x555c33d04be0 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/774115527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 msgr2=0x555c33d06fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 --2- 172.21.15.138:0/774115527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3d18018430 tx=0x7f3d1802bf40 comp rx=0 tx=0).stop 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/774115527 shutdown_connections 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 --2- 172.21.15.138:0/774115527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d06fd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/774115527 >> 172.21.15.138:0/774115527 conn(0x555c33cf12b0 msgr2=0x555c33cf21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/774115527 shutdown_connections 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/774115527 wait complete. 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 Processor -- start 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- start start 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c33d0b7b0 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46400/0 (socket says 172.21.15.138:46400) 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 learned_addr learned my addr 172.21.15.138:0/4140771491 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c33b5b2e0 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d21429640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d18018430 tx=0x7f3d180495e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf67fc640 1 -- 172.21.15.138:0/4140771491 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d1804b070 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf67fc640 1 -- 172.21.15.138:0/4140771491 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1802b940 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3bf67fc640 1 -- 172.21.15.138:0/4140771491 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d180123a0 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c33d0b9b0 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.352+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c33d0bde0 con 0x555c33d04be0 2024-02-16T10:30:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3bf67fc640 1 -- 172.21.15.138:0/4140771491 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3d18042070 con 0x555c33d04be0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3bf67fc640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bec034300 0x7f3bec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3bf67fc640 1 -- 172.21.15.138:0/4140771491 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3d18040070 con 0x555c33d04be0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20c28640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bec034300 0x7f3bec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33d169b0 0x555c33d18e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d195a0 con 0x555c33d169b0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33d169b0 0x555c33d18e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20c28640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bec034300 0x7f3bec0367c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000efb0 tx=0x7f3d1003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33d169b0 0x555c33d18e50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 realm 2024-02-16T10:30:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d19990 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1a1e0 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1a540 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1ad40 con 0x555c33d169b0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 20 searching for the correct realm 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x555c33d1cbf0 0x555c33d1f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d21429640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x555c33d1cbf0 0x555c33d1f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d21429640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x555c33d1cbf0 0x555c33d1f0b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d21429640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d18014070 0x7f3d18002cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d18014070 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20c28640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d18014070 0x7f3d18002cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20c28640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d18014070 0x7f3d18002cd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.356+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20c28640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d1000aea0 0x7f3d10041150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d1000aea0 0x7f3d10041150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d1000aea0 0x7f3d10041150 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d18014070 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.360+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d18014070 2024-02-16T10:30:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.364+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d18014070 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d18014070 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d1cbf0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x7f3d1000aea0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1f730 con 0x555c33d169b0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.368+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3d140da080 con 0x7f3d18014070 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1b670 con 0x555c33d169b0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1bec0 con 0x555c33d169b0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1bec0 con 0x7f3d18014070 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 zone default found 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 4 Realm: () 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 zonegroup default 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d1fb70 con 0x7f3d1000aea0 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d21930 con 0x555c33d1cbf0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d21cc0 con 0x555c33d1cbf0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 started sync module instance, tier type = 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d20dc0 con 0x7f3d18014070 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854494755104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d215c0 con 0x7f3d18014070 2024-02-16T10:30:52.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.372+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22770 con 0x555c33d169b0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854494755104] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854494761552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22b20 con 0x555c33d169b0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d234d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854494765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d23410 con 0x555c33d1cbf0 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d243b0 con 0x7f3d18014070 2024-02-16T10:30:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.376+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854494761552] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854494768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d24710 con 0x7f3d18014070 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d250e0 con 0x555c33d169b0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854494765040] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854494768784] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854494757152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d23880 con 0x555c33d169b0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.380+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d25930 con 0x7f3d1000aea0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854494757152] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854494772192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d258a0 con 0x7f3d1000aea0 2024-02-16T10:30:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26210 con 0x7f3d1000aea0 2024-02-16T10:30:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854494776688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26630 con 0x7f3d1000aea0 2024-02-16T10:30:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26fe0 con 0x7f3d1000aea0 2024-02-16T10:30:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.384+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854494772192] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854494776688] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854494774272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26190 con 0x7f3d1000aea0 2024-02-16T10:30:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=0 2024-02-16T10:30:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=1 2024-02-16T10:30:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=2 2024-02-16T10:30:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=3 2024-02-16T10:30:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=4 2024-02-16T10:30:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=5 2024-02-16T10:30:52.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=6 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854494774272] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 20 add_watcher() i=7 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2a0e0 con 0x555c33d169b0 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.388+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854494780160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d27550 con 0x555c33d169b0 2024-02-16T10:30:52.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854494780160] v31'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d2310d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d2310d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d32470 con 0x555c33d169b0 2024-02-16T10:30:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.392+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d32520 con 0x7f3d1000aea0 2024-02-16T10:30:52.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d33020 con 0x555c33d1cbf0 2024-02-16T10:30:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d33550 con 0x555c33d169b0 2024-02-16T10:30:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d339f0 con 0x7f3d18014070 2024-02-16T10:30:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.396+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d33f20 con 0x555c33d1cbf0 2024-02-16T10:30:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.400+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.400+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34450 con 0x555c33d169b0 2024-02-16T10:30:52.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.400+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.400+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34450 con 0x7f3d1000aea0 2024-02-16T10:30:52.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.404+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.404+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34450 con 0x7f3d18014070 2024-02-16T10:30:52.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.404+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.404+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34980 con 0x555c33d1cbf0 2024-02-16T10:30:52.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34eb0 con 0x7f3d18014070 2024-02-16T10:30:52.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d353e0 con 0x7f3d1000aea0 2024-02-16T10:30:52.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.408+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d353e0 con 0x7f3d18014070 2024-02-16T10:30:52.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d35880 con 0x7f3d1000aea0 2024-02-16T10:30:52.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34eb0 con 0x555c33d169b0 2024-02-16T10:30:52.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.412+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34eb0 con 0x555c33d1cbf0 2024-02-16T10:30:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.416+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.416+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d35470 con 0x7f3d18014070 2024-02-16T10:30:52.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.416+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.416+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d35470 con 0x555c33d1cbf0 2024-02-16T10:30:52.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.416+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.420+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d35500 con 0x555c33d169b0 2024-02-16T10:30:52.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.420+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.420+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34d40 con 0x555c33d169b0 2024-02-16T10:30:52.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.420+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.420+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34d40 con 0x555c33d1cbf0 2024-02-16T10:30:52.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d34d40 con 0x7f3d18014070 2024-02-16T10:30:52.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.424+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.428+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x7f3d1000aea0 2024-02-16T10:30:52.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x7f3d1000aea0 2024-02-16T10:30:52.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.432+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x555c33d1cbf0 2024-02-16T10:30:52.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.436+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.436+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x7f3d1000aea0 2024-02-16T10:30:52.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.436+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.436+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d359c0 con 0x7f3d18014070 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3bd67e4640 20 reqs_thread_entry: start 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 20 Filter name: none 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3bcf7fe640 20 reqs_thread_entry: start 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2f980 con 0x7f3d1000aea0 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:30:52.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.440+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2f940 con 0x7f3d1000aea0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 93854494815344 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d51ea0 con 0x555c33d1cbf0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== watch-notify(notify (1) cookie 93854494765040 notify 133143986179 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x555c33d0bde0 con 0x555c33d1cbf0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3bf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 93854494765040 notifier 4528 bl.length()=170 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(96 notify.2 [notify cookie 93854494815344 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3bf7fff640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3be4003d60 con 0x555c33d1cbf0 2024-02-16T10:30:52.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== watch-notify(notify_complete (2) cookie 93854494815344 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555c33d0b9b0 con 0x555c33d1cbf0 2024-02-16T10:30:52.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2e900 con 0x7f3d1000aea0 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 10 removing email index: 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 10 removing user buckets index 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.444+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93854494815344 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d51ea0 con 0x7f3d1000aea0 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== watch-notify(notify (1) cookie 93854494776688 notify 133143986191 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x555c33bed420 con 0x7f3d1000aea0 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3bf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93854494776688 notifier 4528 bl.length()=160 2024-02-16T10:30:52.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(99 notify.6 [notify cookie 93854494815344 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3bf7fff640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3be4003d60 con 0x7f3d1000aea0 2024-02-16T10:30:52.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== watch-notify(notify_complete (2) cookie 93854494815344 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3d140d0850 con 0x7f3d1000aea0 2024-02-16T10:30:52.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2e900 con 0x7f3d1000aea0 2024-02-16T10:30:52.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(101 fud.buckets [delete] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d2310d980 10 removing user index: fud 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d2310d980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d2310d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.448+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 93854494811232 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d50e90 con 0x7f3d1000aea0 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== watch-notify(notify (1) cookie 93854494772192 notify 133143986192 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f3d140d0850 con 0x7f3d1000aea0 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3bf77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 93854494772192 notifier 4528 bl.length()=152 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(102 notify.5 [notify cookie 93854494811232 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3bf77fe640 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3b480032c0 con 0x7f3d1000aea0 2024-02-16T10:30:52.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== watch-notify(notify_complete (2) cookie 93854494811232 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3d140d0cb0 con 0x7f3d1000aea0 2024-02-16T10:30:52.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.452+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2f470 con 0x7f3d1000aea0 2024-02-16T10:30:52.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(104 fud [call,call,delete] v31'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854494780160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d2ffe0 con 0x555c33d169b0 2024-02-16T10:30:52.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93854494780160] v31'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854494755104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26b00 con 0x7f3d18014070 2024-02-16T10:30:52.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93854494755104] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d2310d980 20 remove_watcher() i=0 2024-02-16T10:30:52.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d2310d980 2 removed watcher, disabling cache 2024-02-16T10:30:52.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.456+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854494761552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26b00 con 0x555c33d169b0 2024-02-16T10:30:52.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93854494761552] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d2310d980 20 remove_watcher() i=1 2024-02-16T10:30:52.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854494765040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22250 con 0x555c33d1cbf0 2024-02-16T10:30:52.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d21429640 1 -- 172.21.15.138:0/4140771491 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93854494765040] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1800a4d0 con 0x555c33d1cbf0 2024-02-16T10:30:52.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d2310d980 20 remove_watcher() i=2 2024-02-16T10:30:52.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.460+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854494768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26b00 con 0x7f3d18014070 2024-02-16T10:30:52.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d20c28640 1 -- 172.21.15.138:0/4140771491 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93854494768784] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d1005a040 con 0x7f3d18014070 2024-02-16T10:30:52.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d2310d980 20 remove_watcher() i=3 2024-02-16T10:30:52.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854494757152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22ff0 con 0x555c33d169b0 2024-02-16T10:30:52.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93854494757152] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x555c33d169b0 2024-02-16T10:30:52.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d2310d980 20 remove_watcher() i=4 2024-02-16T10:30:52.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.464+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854494772192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22250 con 0x7f3d1000aea0 2024-02-16T10:30:52.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93854494772192] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d2310d980 20 remove_watcher() i=5 2024-02-16T10:30:52.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854494776688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d26b00 con 0x7f3d1000aea0 2024-02-16T10:30:52.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93854494776688] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d2310d980 20 remove_watcher() i=6 2024-02-16T10:30:52.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.468+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854494774272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555c33d22ff0 con 0x7f3d1000aea0 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93854494774272] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3d140ab810 con 0x7f3d1000aea0 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 20 remove_watcher() i=7 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d1000aea0 msgr2=0x7f3d10041150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3d1000aea0 0x7f3d10041150 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33d169b0 msgr2=0x555c33d18e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33d169b0 0x555c33d18e50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d18014070 msgr2=0x7f3d18002cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3d18014070 0x7f3d18002cd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x555c33d1cbf0 msgr2=0x555c33d1f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x555c33d1cbf0 0x555c33d1f0b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bec034300 msgr2=0x7f3bec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bec034300 0x7f3bec0367c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000efb0 tx=0x7f3d1003a000 comp rx=0 tx=0).stop 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d20427640 1 -- 172.21.15.138:0/4140771491 reap_dead start 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 msgr2=0x555c33d0b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d18018430 tx=0x7f3d180495e0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 shutdown_connections 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/4140771491 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33d04be0 0x555c33d0b270 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 >> 172.21.15.138:0/4140771491 conn(0x555c33cf12b0 msgr2=0x555c33cf21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 shutdown_connections 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/4140771491 wait complete. 2024-02-16T10:30:52.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 msgr2=0x7f3bf8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 0x7f3bf8036770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x555c33cde140 tx=0x7f3d10026ef0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 msgr2=0x555c33b5a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x555c33cd7170 tx=0x7f3d18018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 shutdown_connections 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3bf80342b0 0x7f3bf8036770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2944381713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33b5c220 0x555c33b5a6c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 >> 172.21.15.138:0/2944381713 conn(0x555c33ce5cb0 msgr2=0x555c33ce67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 shutdown_connections 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2944381713 wait complete. 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 msgr2=0x555c33cdd2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 0x555c33cdd2c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 msgr2=0x555c33ce2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 0x555c33ce2880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 msgr2=0x7f3c080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 0x7f3c080367c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d140ad000 tx=0x7f3d140a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 msgr2=0x555c33cd65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000b710 tx=0x7f3d10000bd0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 shutdown_connections 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x555c33cdf020 0x555c33ce2880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x555c33be9ae0 0x555c33cdd2c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3c08034300 0x7f3c080367c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 --2- 172.21.15.138:0/2498287463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555c33be5620 0x555c33cd65d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 >> 172.21.15.138:0/2498287463 conn(0x555c33be0ef0 msgr2=0x555c33cc9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 shutdown_connections 2024-02-16T10:30:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.472+0000 7f3d2310d980 1 -- 172.21.15.138:0/2498287463 wait complete. 2024-02-16T10:30:52.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:30:52.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-02-16T10:30:52.490 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-02-16T10:30:52.574 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:52.574 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82d344980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600a7f99a90 0x5600a7f9be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82d344980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600a7ee1af0 con 0x5600a7f95580 2024-02-16T10:30:52.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82d344980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5600a7ea8d30 con 0x5600a7f99a90 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82a65e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600a7f99a90 0x5600a7f9be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82ae5f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5600a7f95580 0x5600a7f95960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52268/0 (socket says 172.21.15.138:52268) 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1809493144 learned_addr learned my addr 172.21.15.138:0/1809493144 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1809493144 >> v2:172.21.15.107:3300/0 conn(0x5600a7f99a90 0x5600a7f9be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46406/0 (socket says 172.21.15.138:46406) 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82a65e640 1 -- 172.21.15.138:0/1809493144 >> v1:172.21.15.107:6789/0 conn(0x5600a7f95580 legacy=0x5600a7f95960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.568+0000 7ff82a65e640 1 -- 172.21.15.138:0/1809493144 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600a7f9d3d0 con 0x5600a7f99a90 2024-02-16T10:30:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1809493144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a7f9be80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff81400a480 tx=0x7ff81401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945928650173bfe8 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff829e5d640 1 -- 172.21.15.138:0/1809493144 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8140ab540 con 0x5600a7f99a90 2024-02-16T10:30:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff829e5d640 1 -- 172.21.15.138:0/1809493144 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140ab6a0 con 0x5600a7f99a90 2024-02-16T10:30:52.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff829e5d640 1 -- 172.21.15.138:0/1809493144 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8140ab960 con 0x5600a7f99a90 2024-02-16T10:30:52.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 -- 172.21.15.138:0/1809493144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 msgr2=0x5600a7f9be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 --2- 172.21.15.138:0/1809493144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a7f9be80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff81400a480 tx=0x7ff81401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:52.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 -- 172.21.15.138:0/1809493144 shutdown_connections 2024-02-16T10:30:52.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 --2- 172.21.15.138:0/1809493144 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a7f9be80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 -- 172.21.15.138:0/1809493144 >> 172.21.15.138:0/1809493144 conn(0x5600a7f90e50 msgr2=0x5600a7f93270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 -- 172.21.15.138:0/1809493144 shutdown_connections 2024-02-16T10:30:52.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.572+0000 7ff82d344980 1 -- 172.21.15.138:0/1809493144 wait complete. 2024-02-16T10:30:52.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82d344980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82d344980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600a7ea5fc0 con 0x5600a7f95580 2024-02-16T10:30:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82ae5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82ae5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46408/0 (socket says 172.21.15.138:46408) 2024-02-16T10:30:52.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1702066339 learned_addr learned my addr 172.21.15.138:0/1702066339 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1702066339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814005d30 con 0x5600a7f95580 2024-02-16T10:30:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1702066339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006fb0 tx=0x7ff81c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3053aadec8a03655 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff718e09640 1 -- 172.21.15.138:0/1702066339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff81c004530 con 0x5600a7f95580 2024-02-16T10:30:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff718e09640 1 -- 172.21.15.138:0/1702066339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c004690 con 0x5600a7f95580 2024-02-16T10:30:52.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.584+0000 7ff718e09640 1 -- 172.21.15.138:0/1702066339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff81c0049b0 con 0x5600a7f95580 2024-02-16T10:30:52.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/1702066339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 msgr2=0x5600a7f0b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 --2- 172.21.15.138:0/1702066339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006fb0 tx=0x7ff81c001940 comp rx=0 tx=0).stop 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/1702066339 shutdown_connections 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 --2- 172.21.15.138:0/1702066339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f95580 0x5600a7f0b530 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/1702066339 >> 172.21.15.138:0/1702066339 conn(0x5600a7f90e50 msgr2=0x5600a807b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/1702066339 shutdown_connections 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/1702066339 wait complete. 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600a7ea17a0 con 0x5600a7f99a90 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82ae5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82ae5f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46416/0 (socket says 172.21.15.138:46416) 2024-02-16T10:30:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82ae5f640 1 -- 172.21.15.138:0/2026760098 learned_addr learned my addr 172.21.15.138:0/2026760098 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82ae5f640 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600a7ee1af0 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00f000 tx=0x7ff81c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff717606640 1 -- 172.21.15.138:0/2026760098 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff81c013630 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600a8088fb0 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600a8089460 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff717606640 1 -- 172.21.15.138:0/2026760098 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c013790 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff717606640 1 -- 172.21.15.138:0/2026760098 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff81c013a70 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.588+0000 7ff717606640 1 -- 172.21.15.138:0/2026760098 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff81c013bd0 con 0x5600a7f99a90 2024-02-16T10:30:52.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff717606640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 0x7ff710036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff717606640 1 -- 172.21.15.138:0/2026760098 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff81c0493b0 con 0x5600a7f99a90 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82a65e640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 0x7ff710036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 0x5600a808fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a8090080 con 0x5600a808d750 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 0x5600a808fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82a65e640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 0x7ff710036770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ad000 tx=0x7ff8140a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 0x5600a808fb40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 -- 172.21.15.138:0/2026760098 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8240083f0 con 0x5600a808d750 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a8090440 con 0x5600a808d750 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 -- 172.21.15.138:0/2026760098 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff8240083f0 con 0x5600a808d750 2024-02-16T10:30:52.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a8091cf0 con 0x5600a808d750 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 -- 172.21.15.138:0/2026760098 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff8240083f0 con 0x5600a808d750 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a8090e30 con 0x5600a808d750 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 -- 172.21.15.138:0/2026760098 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff8240083f0 con 0x5600a808d750 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 0x5600a8095070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a8095680 con 0x5600a8091750 2024-02-16T10:30:52.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 0x5600a8095070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 0x5600a8095070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82ae5f640 1 -- 172.21.15.138:0/2026760098 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff81c024020 con 0x5600a8091750 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82d344980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600a7e39f20 con 0x5600a80a35b0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46420/0 (socket says 172.21.15.138:46420) 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.592+0000 7ff82b660640 1 -- 172.21.15.138:0/2899353058 learned_addr learned my addr 172.21.15.138:0/2899353058 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 -- 172.21.15.138:0/2899353058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600a80a3f10 con 0x5600a80a35b0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5600a8089b50 tx=0x7ff82400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 -- 172.21.15.138:0/2899353058 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82400f040 con 0x5600a80a35b0 2024-02-16T10:30:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600a80a4160 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 -- 172.21.15.138:0/2899353058 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824019550 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600a80a4cb0 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 -- 172.21.15.138:0/2899353058 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8240197f0 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 -- 172.21.15.138:0/2899353058 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff824019950 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 0x7ff704036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff714e01640 1 -- 172.21.15.138:0/2899353058 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff82404b450 con 0x5600a80a35b0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 0x7ff704036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 0x7ff704036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5600a8090870 tx=0x7ff81c047730 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82d344980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600a7e2d790 con 0x5600a80b0480 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46436/0 (socket says 172.21.15.138:46436) 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 -- 172.21.15.138:0/1078900699 learned_addr learned my addr 172.21.15.138:0/1078900699 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 -- 172.21.15.138:0/1078900699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600a80b0de0 con 0x5600a80b0480 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff82b660640 1 --2- 172.21.15.138:0/1078900699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82400bfd0 tx=0x7ff824007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a942511edcb10ac5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff70e7fc640 1 -- 172.21.15.138:0/1078900699 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82403a070 con 0x5600a80b0480 2024-02-16T10:30:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff70e7fc640 1 -- 172.21.15.138:0/1078900699 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82403a1d0 con 0x5600a80b0480 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.596+0000 7ff70e7fc640 1 -- 172.21.15.138:0/1078900699 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff824022580 con 0x5600a80b0480 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1078900699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 msgr2=0x5600a80b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 --2- 172.21.15.138:0/1078900699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82400bfd0 tx=0x7ff824007840 comp rx=0 tx=0).stop 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1078900699 shutdown_connections 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 --2- 172.21.15.138:0/1078900699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b08a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1078900699 >> 172.21.15.138:0/1078900699 conn(0x5600a80ab0f0 msgr2=0x5600a80abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1078900699 shutdown_connections 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1078900699 wait complete. 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 Processor -- start 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- start start 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600a80b7790 con 0x5600a80b0480 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82b660640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46444/0 (socket says 172.21.15.138:46444) 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 learned_addr learned my addr 172.21.15.138:0/1515837953 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600a80a4cb0 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82b660640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff824022fd0 tx=0x7ff8240497d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 -- 172.21.15.138:0/1515837953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82403b580 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600a80b7990 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 -- 172.21.15.138:0/1515837953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824017950 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 -- 172.21.15.138:0/1515837953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff824007a40 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600a80b7e20 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 -- 172.21.15.138:0/1515837953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff824007ba0 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff6f40342b0 0x7ff6f4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff70cff9640 1 -- 172.21.15.138:0/1515837953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff82401a5c0 con 0x5600a80b0480 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff6f40342b0 0x7ff6f4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a80c2980 0x5600a80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c5570 con 0x5600a80c2980 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a80c2980 0x5600a80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff6f40342b0 0x7ff6f4036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5600a8095a20 tx=0x7ff81c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.600+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a80c2980 0x5600a80c4e20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 realm 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c59b0 con 0x5600a80c2980 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c6200 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c6560 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c6d60 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 20 searching for the correct realm 2024-02-16T10:30:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600a80c8c40 0x5600a80cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82b660640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600a80c8c40 0x5600a80cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82b660640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600a80c8c40 0x5600a80cb100 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82b660640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff824035070 0x7ff82401a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff824035070 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff824035070 0x7ff82401a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff824035070 0x7ff82401a8a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82ae5f640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff81c055040 0x7ff81c0113d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff81c055040 0x7ff81c0113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.604+0000 7ff82a65e640 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff81c055040 0x7ff81c0113d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff824035070 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff824035070 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.608+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff824035070 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.612+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff824035070 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c8c40 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x7ff81c055040 2024-02-16T10:30:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cb7d0 con 0x5600a80c2980 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff8140da080 con 0x7ff824035070 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c7560 con 0x5600a80c2980 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c7910 con 0x5600a80c2980 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80c7910 con 0x7ff824035070 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 zone default found 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 4 Realm: () 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 zonegroup default 2024-02-16T10:30:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cbc10 con 0x7ff81c055040 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.616+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cd9d0 con 0x5600a80c8c40 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cdda0 con 0x5600a80c8c40 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 started sync module instance, tier type = 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cd2b0 con 0x7ff824035070 2024-02-16T10:30:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94560819400208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cd660 con 0x7ff824035070 2024-02-16T10:30:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80ceb60 con 0x5600a80c2980 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94560819400208] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94560819405248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cef10 con 0x5600a80c2980 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.620+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cf880 con 0x5600a80c8c40 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94560819409888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cf800 con 0x5600a80c8c40 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d07c0 con 0x7ff824035070 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94560819405248] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94560819413664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d0b70 con 0x7ff824035070 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d14e0 con 0x5600a80c2980 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94560819409888] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.624+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94560819413664] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94560819412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d14e0 con 0x5600a80c2980 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d1d60 con 0x7ff81c055040 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94560819412016] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94560819417424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d1ab0 con 0x7ff81c055040 2024-02-16T10:30:52.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.628+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2580 con 0x7ff81c055040 2024-02-16T10:30:52.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94560819421280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d29e0 con 0x7ff81c055040 2024-02-16T10:30:52.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94560819417424] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d15b0 con 0x7ff81c055040 2024-02-16T10:30:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94560819421280] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94560819422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2960 con 0x7ff81c055040 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=0 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=1 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=2 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=3 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=4 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=5 2024-02-16T10:30:52.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.632+0000 7ff82d344980 20 add_watcher() i=6 2024-02-16T10:30:52.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94560819422528] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 add_watcher() i=7 2024-02-16T10:30:52.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:52.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d6380 con 0x5600a80c2980 2024-02-16T10:30:52.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94560819424944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d3840 con 0x5600a80c2980 2024-02-16T10:30:52.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94560819424944] v31'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff6e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 5 note: GC not initialized 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff65bfff640 20 reqs_thread_entry: start 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 Filter name: none 2024-02-16T10:30:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff659ffb640 20 reqs_thread_entry: start 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.636+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80f8370 con 0x7ff81c055040 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80f6a70 con 0x7ff81c055040 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:30:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:30:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:30:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.640+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~386 in=386b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80fa900 con 0x7ff81c055040 2024-02-16T10:30:52.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~386] v31'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82d344980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82d344980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82d344980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94560819581888 in=589b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80fb290 con 0x7ff824035070 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== watch-notify(notify (1) cookie 94560819413664 notify 133143986188 ret 0) v3 ==== 619+0+0 (crc 0 0 0) 0x5600a8089460 con 0x7ff824035070 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94560819413664 notifier 4535 bl.length()=577 2024-02-16T10:30:52.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-02-16T10:30:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:30:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.3 [notify cookie 94560819581888 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff70e7fc640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6f0003ea0 con 0x7ff824035070 2024-02-16T10:30:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== watch-notify(notify_complete (2) cookie 94560819581888 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff81c02d070 con 0x7ff824035070 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.644+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80f83b0 con 0x7ff81c055040 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94560819588368 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80f83b0 con 0x5600a80c8c40 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== watch-notify(notify (1) cookie 94560819409888 notify 133143986180 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x5600a80b7e20 con 0x5600a80c8c40 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff70e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94560819409888 notifier 4535 bl.length()=192 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff70e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff70e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [notify cookie 94560819588368 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff70e7fc640 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6f0003ea0 con 0x5600a80c8c40 2024-02-16T10:30:52.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== watch-notify(notify_complete (2) cookie 94560819588368 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff824050070 con 0x5600a80c8c40 2024-02-16T10:30:52.662 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff6e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94560819424944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d8ac0 con 0x5600a80c2980 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94560819424944] v31'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.648+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94560819400208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2eb0 con 0x7ff824035070 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94560819400208] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 20 remove_watcher() i=0 2024-02-16T10:30:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 2 removed watcher, disabling cache 2024-02-16T10:30:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94560819405248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2eb0 con 0x5600a80c2980 2024-02-16T10:30:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94560819405248] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 20 remove_watcher() i=1 2024-02-16T10:30:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94560819409888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2eb0 con 0x5600a80c8c40 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82b660640 1 -- 172.21.15.138:0/1515837953 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94560819409888] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff824012070 con 0x5600a80c8c40 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 20 remove_watcher() i=2 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.652+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94560819413664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cf3e0 con 0x7ff824035070 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82ae5f640 1 -- 172.21.15.138:0/1515837953 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94560819413664] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff81c024020 con 0x7ff824035070 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82d344980 20 remove_watcher() i=3 2024-02-16T10:30:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94560819412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2eb0 con 0x5600a80c2980 2024-02-16T10:30:52.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94560819412016] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x5600a80c2980 2024-02-16T10:30:52.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82d344980 20 remove_watcher() i=4 2024-02-16T10:30:52.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.656+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94560819417424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80cf3e0 con 0x7ff81c055040 2024-02-16T10:30:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94560819417424] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82d344980 20 remove_watcher() i=5 2024-02-16T10:30:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94560819421280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d2eb0 con 0x7ff81c055040 2024-02-16T10:30:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94560819421280] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82d344980 20 remove_watcher() i=6 2024-02-16T10:30:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.660+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94560819422528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5600a80d1150 con 0x7ff81c055040 2024-02-16T10:30:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94560819422528] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff8140ab810 con 0x7ff81c055040 2024-02-16T10:30:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 20 remove_watcher() i=7 2024-02-16T10:30:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff81c055040 msgr2=0x7ff81c0113d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff81c055040 0x7ff81c0113d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a80c2980 msgr2=0x5600a80c4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a80c2980 0x5600a80c4e20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff824035070 msgr2=0x7ff82401a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff824035070 0x7ff82401a8a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600a80c8c40 msgr2=0x5600a80cb100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600a80c8c40 0x5600a80cb100 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff6f40342b0 msgr2=0x7ff6f4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff6f40342b0 0x7ff6f4036770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5600a8095a20 tx=0x7ff81c032000 comp rx=0 tx=0).stop 2024-02-16T10:30:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 msgr2=0x5600a80b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff824022fd0 tx=0x7ff8240497d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82a65e640 1 -- 172.21.15.138:0/1515837953 reap_dead start 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 shutdown_connections 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/1515837953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80b0480 0x5600a80b7250 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 >> 172.21.15.138:0/1515837953 conn(0x5600a80ab0f0 msgr2=0x5600a80abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 shutdown_connections 2024-02-16T10:30:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/1515837953 wait complete. 2024-02-16T10:30:52.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 msgr2=0x7ff704036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 0x7ff704036770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x5600a8090870 tx=0x7ff81c047730 comp rx=0 tx=0).stop 2024-02-16T10:30:52.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 msgr2=0x5600a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5600a8089b50 tx=0x7ff82400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 shutdown_connections 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7040342b0 0x7ff704036770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2899353058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a80a35b0 0x5600a80a39d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 >> 172.21.15.138:0/2899353058 conn(0x5600a80983c0 msgr2=0x5600a8098ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 shutdown_connections 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2899353058 wait complete. 2024-02-16T10:30:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 msgr2=0x5600a808fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 0x5600a808fb40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 msgr2=0x5600a8095070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 0x5600a8095070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 msgr2=0x7ff710036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 0x7ff710036770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ad000 tx=0x7ff8140a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 msgr2=0x5600a8088a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00f000 tx=0x7ff81c000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 shutdown_connections 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600a8091750 0x5600a8095070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600a808d750 0x5600a808fb40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff7100342b0 0x7ff710036770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 --2- 172.21.15.138:0/2026760098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600a7f99a90 0x5600a8088a70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 >> 172.21.15.138:0/2026760098 conn(0x5600a7f90e50 msgr2=0x5600a7f09ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 shutdown_connections 2024-02-16T10:30:52.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.664+0000 7ff82d344980 1 -- 172.21.15.138:0/2026760098 wait complete. 2024-02-16T10:30:52.688 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:52.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:30:52.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:30:52.689 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-02-16T10:30:52.766 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:52.766 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3899f75980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3be11e6b0 0x55e3be1ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3899f75980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e3be0f6af0 con 0x55e3be1ad770 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3899f75980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e3be0bdd30 con 0x55e3be11e6b0 2024-02-16T10:30:52.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3897a90640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3be11e6b0 0x55e3be1ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f389728f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55e3be1ad770 0x55e3be1afb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52284/0 (socket says 172.21.15.138:52284) 2024-02-16T10:30:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3897a90640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e3be11e6b0 0x55e3be1ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46460/0 (socket says 172.21.15.138:46460) 2024-02-16T10:30:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f389728f640 1 -- 172.21.15.138:0/3292078973 learned_addr learned my addr 172.21.15.138:0/3292078973 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3897a90640 1 -- 172.21.15.138:0/3292078973 >> v1:172.21.15.107:6789/0 conn(0x55e3be1ad770 legacy=0x55e3be1afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.760+0000 7f3897a90640 1 -- 172.21.15.138:0/3292078973 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3be1b2320 con 0x55e3be11e6b0 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3897a90640 1 --2- 172.21.15.138:0/3292078973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be1ad230 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f389000a420 tx=0x7f389001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b4205fb2c8239 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3896a8e640 1 -- 172.21.15.138:0/3292078973 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900aa530 con 0x55e3be11e6b0 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3896a8e640 1 -- 172.21.15.138:0/3292078973 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900a6050 con 0x55e3be11e6b0 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3896a8e640 1 -- 172.21.15.138:0/3292078973 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900aa800 con 0x55e3be11e6b0 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 -- 172.21.15.138:0/3292078973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 msgr2=0x55e3be1ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 --2- 172.21.15.138:0/3292078973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be1ad230 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f389000a420 tx=0x7f389001afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 -- 172.21.15.138:0/3292078973 shutdown_connections 2024-02-16T10:30:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 --2- 172.21.15.138:0/3292078973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be1ad230 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 -- 172.21.15.138:0/3292078973 >> 172.21.15.138:0/3292078973 conn(0x55e3be1a4d10 msgr2=0x55e3be1a7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 -- 172.21.15.138:0/3292078973 shutdown_connections 2024-02-16T10:30:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.764+0000 7f3899f75980 1 -- 172.21.15.138:0/3292078973 wait complete. 2024-02-16T10:30:52.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3899f75980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3899f75980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3be0bafc0 con 0x55e3be11e6b0 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3897a90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3897a90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46476/0 (socket says 172.21.15.138:46476) 2024-02-16T10:30:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3897a90640 1 -- 172.21.15.138:0/3904862142 learned_addr learned my addr 172.21.15.138:0/3904862142 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3897a90640 1 -- 172.21.15.138:0/3904862142 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389000a100 con 0x55e3be11e6b0 2024-02-16T10:30:52.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3897a90640 1 --2- 172.21.15.138:0/3904862142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38900ad040 tx=0x7f38900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c37746fe8c819e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3785e0b640 1 -- 172.21.15.138:0/3904862142 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900aa630 con 0x55e3be11e6b0 2024-02-16T10:30:52.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3785e0b640 1 -- 172.21.15.138:0/3904862142 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900aa790 con 0x55e3be11e6b0 2024-02-16T10:30:52.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.776+0000 7f3785e0b640 1 -- 172.21.15.138:0/3904862142 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900aaa30 con 0x55e3be11e6b0 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/3904862142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 msgr2=0x55e3be294630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 --2- 172.21.15.138:0/3904862142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38900ad040 tx=0x7f38900033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/3904862142 shutdown_connections 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 --2- 172.21.15.138:0/3904862142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be294630 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/3904862142 >> 172.21.15.138:0/3904862142 conn(0x55e3be1a4d10 msgr2=0x55e3be2901c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/3904862142 shutdown_connections 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/3904862142 wait complete. 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3be0b67a0 con 0x55e3be11e6b0 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3897a90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3897a90640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46480/0 (socket says 172.21.15.138:46480) 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3897a90640 1 -- 172.21.15.138:0/1286380851 learned_addr learned my addr 172.21.15.138:0/1286380851 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3897a90640 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3be1b2320 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3897a90640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f389001b870 tx=0x7f3890019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f377ffff640 1 -- 172.21.15.138:0/1286380851 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900b6b60 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3be29b960 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3be29be70 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f377ffff640 1 -- 172.21.15.138:0/1286380851 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900b6cc0 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.780+0000 7f377ffff640 1 -- 172.21.15.138:0/1286380851 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900c0450 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f377ffff640 1 -- 172.21.15.138:0/1286380851 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f38900c05b0 con 0x55e3be11e6b0 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f377ffff640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 0x7f3780036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f377ffff640 1 -- 172.21.15.138:0/1286380851 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f38900e3f10 con 0x55e3be11e6b0 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f389728f640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 0x7f3780036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 0x55e3be2a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2a2650 con 0x55e3be1ad770 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 0x55e3be2a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f389728f640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 0x7f3780036770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f388c000f70 tx=0x7f388c0012c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 0x55e3be2a2110 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 -- 172.21.15.138:0/1286380851 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f38880083f0 con 0x55e3be1ad770 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be29f820 con 0x55e3be1ad770 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 -- 172.21.15.138:0/1286380851 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f38880083f0 con 0x55e3be1ad770 2024-02-16T10:30:52.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2a43d0 con 0x55e3be1ad770 2024-02-16T10:30:52.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 -- 172.21.15.138:0/1286380851 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f38880083f0 con 0x55e3be1ad770 2024-02-16T10:30:52.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2a35d0 con 0x55e3be1ad770 2024-02-16T10:30:52.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 -- 172.21.15.138:0/1286380851 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f38880083f0 con 0x55e3be1ad770 2024-02-16T10:30:52.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 0x55e3be2a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2a7da0 con 0x55e3be2a3ef0 2024-02-16T10:30:52.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3897a90640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 0x55e3be2a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3897a90640 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 0x55e3be2a7750 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3897a90640 1 -- 172.21.15.138:0/1286380851 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f38900b1040 con 0x55e3be2a3ef0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3899f75980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3be04ef20 con 0x55e3be2b5ca0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46492/0 (socket says 172.21.15.138:46492) 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.784+0000 7f3898291640 1 -- 172.21.15.138:0/549061581 learned_addr learned my addr 172.21.15.138:0/549061581 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3898291640 1 -- 172.21.15.138:0/549061581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3be2b6600 con 0x55e3be2b5ca0 2024-02-16T10:30:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3898291640 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55e3be29c670 tx=0x7f388800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 -- 172.21.15.138:0/549061581 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f388800f040 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 -- 172.21.15.138:0/549061581 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888019550 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3be2b6850 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 -- 172.21.15.138:0/549061581 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38880197f0 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3be2b73a0 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 -- 172.21.15.138:0/549061581 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3888019950 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 0x7f37700367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f377d7fa640 1 -- 172.21.15.138:0/549061581 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f388804b410 con 0x55e3be2b5ca0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3897a90640 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 0x7f37700367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3897a90640 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 0x7f37700367c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55e3be2a3010 tx=0x7f38900c7480 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3899f75980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3be042790 con 0x55e3be2c2c10 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46496/0 (socket says 172.21.15.138:46496) 2024-02-16T10:30:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.788+0000 7f3898291640 1 -- 172.21.15.138:0/2181782055 learned_addr learned my addr 172.21.15.138:0/2181782055 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 -- 172.21.15.138:0/2181782055 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3be2c3600 con 0x55e3be2c2c10 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 --2- 172.21.15.138:0/2181782055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3888049800 tx=0x7f388802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f44af822facf223 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3776ffd640 1 -- 172.21.15.138:0/2181782055 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f388803b540 con 0x55e3be2c2c10 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3776ffd640 1 -- 172.21.15.138:0/2181782055 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388804b0d0 con 0x55e3be2c2c10 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3776ffd640 1 -- 172.21.15.138:0/2181782055 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38880183b0 con 0x55e3be2c2c10 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2181782055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 msgr2=0x55e3be2c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 --2- 172.21.15.138:0/2181782055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3888049800 tx=0x7f388802af40 comp rx=0 tx=0).stop 2024-02-16T10:30:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2181782055 shutdown_connections 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 --2- 172.21.15.138:0/2181782055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c3030 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2181782055 >> 172.21.15.138:0/2181782055 conn(0x55e3be2bd7e0 msgr2=0x55e3be2be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2181782055 shutdown_connections 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2181782055 wait complete. 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 Processor -- start 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- start start 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3be2c9ea0 con 0x55e3be2c2c10 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46502/0 (socket says 172.21.15.138:46502) 2024-02-16T10:30:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 learned_addr learned my addr 172.21.15.138:0/2253015717 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3be2b73a0 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3898291640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f38880486d0 tx=0x7f3888049790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f37757fa640 1 -- 172.21.15.138:0/2253015717 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f388804b240 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3be2ca0a0 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f37757fa640 1 -- 172.21.15.138:0/2253015717 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888015cc0 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f37757fa640 1 -- 172.21.15.138:0/2253015717 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3888017a50 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.792+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3be2ca4d0 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f37757fa640 1 -- 172.21.15.138:0/2253015717 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3888017bb0 con 0x55e3be2c2c10 2024-02-16T10:30:52.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f37757fa640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37600342b0 0x7f3760036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f37757fa640 1 -- 172.21.15.138:0/2253015717 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f3888037cc0 con 0x55e3be2c2c10 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37600342b0 0x7f3760036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be2d50d0 0x55e3be2d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d7cc0 con 0x55e3be2d50d0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be2d50d0 0x55e3be2d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37600342b0 0x7f3760036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38900c7510 tx=0x7f38900de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be2d50d0 0x55e3be2d7570 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 realm 2024-02-16T10:30:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d45f0 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d8740 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d8fc0 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d9320 con 0x55e3be2d50d0 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 20 searching for the correct realm 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3be2db400 0x55e3be2dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x55e3be2db400 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3898291640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3be2db400 0x55e3be2dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3898291640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3be2db400 0x55e3be2dd8c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3898291640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3888022070 0x7f388802c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x7f3888022070 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3888022070 0x7f388802c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3888022070 0x7f388802c450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f38900f5040 0x7f38900c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.796+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x7f38900f5040 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f38900f5040 0x7f38900c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f38900f5040 0x7f38900c75f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x55e3be2d50d0 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x55e3be2d50d0 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x7f38900f5040 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2ddf40 con 0x7f38900f5040 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f3888022070 2024-02-16T10:30:52.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.800+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f3888022070 2024-02-16T10:30:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.804+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f3888022070 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f3888022070 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2db400 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f38900f5040 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x55e3be2d50d0 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.808+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f388c02b040 con 0x7f3888022070 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2d9d00 con 0x55e3be2d50d0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2da0b0 con 0x55e3be2d50d0 2024-02-16T10:30:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2da0b0 con 0x7f3888022070 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 zone default found 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 4 Realm: () 2024-02-16T10:30:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 zonegroup default 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2de380 con 0x7f38900f5040 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e0130 con 0x55e3be2db400 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e0540 con 0x55e3be2db400 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 started sync module instance, tier type = 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2df5c0 con 0x7f3888022070 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94436636619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2dfdc0 con 0x7f3888022070 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.812+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e0fb0 con 0x55e3be2d50d0 2024-02-16T10:30:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94436636619040] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94436636621088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e1390 con 0x55e3be2d50d0 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e1d00 con 0x55e3be2db400 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94436636621088] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94436636625616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e1d00 con 0x55e3be2db400 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.816+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e26c0 con 0x7f3888022070 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94436636631584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e2f10 con 0x7f3888022070 2024-02-16T10:30:52.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e3900 con 0x55e3be2d50d0 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94436636625616] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94436636631584] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94436636633712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e1860 con 0x55e3be2d50d0 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.820+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4150 con 0x7f38900f5040 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94436636633712] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94436636636128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4100 con 0x7f38900f5040 2024-02-16T10:30:52.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4b10 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94436636636128] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94436636638304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4b10 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.824+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e5310 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94436636642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e5790 con 0x7f38900f5040 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=0 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=1 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=2 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=3 2024-02-16T10:30:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=4 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=5 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94436636638304] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=6 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94436636642576] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 20 add_watcher() i=7 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4670 con 0x55e3be2d50d0 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.828+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94436636643792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be2e4670 con 0x55e3be2d50d0 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94436636643792] v31'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f374dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 5 note: GC not initialized 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f374cfe1640 20 reqs_thread_entry: start 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 Filter name: none 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f36c67fc640 20 reqs_thread_entry: start 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be30a840 con 0x7f38900f5040 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be30a2d0 con 0x7f3888022070 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv25 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be30d7a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(64 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.832+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be311a60 con 0x7f3888022070 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 foo.buckets [call] v31'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.a 8:502b17b3:root::.bucket.meta.testx%3amyfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3153d0 con 0x55e3be2d50d0 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [create,call,writefull 0~371,setxattr (203)] v31'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x7 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94436636831328 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314ab0 con 0x7f3888022070 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify (1) cookie 94436636631584 notify 133143986189 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x55e3be29be70 con 0x7f3888022070 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3776ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94436636631584 notifier 4542 bl.length()=806 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3776ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x7 2024-02-16T10:30:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3776ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3776ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(67 notify.3 [notify cookie 94436636831328 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3776ffd640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f375c003ea0 con 0x7f3888022070 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== watch-notify(notify_complete (2) cookie 94436636831328 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e3be29b960 con 0x7f3888022070 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 20 handle_bi_update(): bucket=testx:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 20 handle_bi_update(): bucket=testx:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 20 handle_bi_update(): bucket=testx:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 20 handle_bi_update(): bucket=testx:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.836+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314b50 con 0x55e3be2d50d0 2024-02-16T10:30:52.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314b50 con 0x55e3be2d50d0 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94436636837552 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314ad0 con 0x55e3be2d50d0 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== watch-notify(notify (1) cookie 94436636633712 notify 133143986190 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7f388c035040 con 0x55e3be2d50d0 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94436636633712 notifier 4542 bl.length()=348 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:30:52.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(71 notify.4 [notify cookie 94436636837552 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f375c003ea0 con 0x55e3be2d50d0 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94436636837552 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55e3be0f6af0 con 0x55e3be2d50d0 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94436636837552 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314ad0 con 0x7f38900f5040 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== watch-notify(notify (1) cookie 94436636638304 notify 133143986193 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55e3be0f6af0 con 0x7f38900f5040 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94436636638304 notifier 4542 bl.length()=149 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 notify.6 [notify cookie 94436636837552 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.840+0000 7f3776ffd640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f375c003ea0 con 0x7f38900f5040 2024-02-16T10:30:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== watch-notify(notify_complete (2) cookie 94436636837552 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f388c012bd0 con 0x7f38900f5040 2024-02-16T10:30:52.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314b50 con 0x7f3888022070 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(75 myfoo [call,delete] v31'27 uv27 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3899f75980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 from cache 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3899f75980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 7.d 7:b4812045:::notify.4:head [notify cookie 94436636810320 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be314b50 con 0x55e3be2d50d0 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== watch-notify(notify (1) cookie 94436636633712 notify 133143986191 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f388c012bd0 con 0x55e3be2d50d0 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f37767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94436636633712 notifier 4542 bl.length()=206 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(76 notify.4 [notify cookie 94436636810320 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f37767fc640 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f36cc0032c0 con 0x55e3be2d50d0 2024-02-16T10:30:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(77 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== watch-notify(notify_complete (2) cookie 94436636810320 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f388c03d430 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.844+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(78 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call,delete] v31'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f374dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94436636643792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94436636643792] v31'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94436636619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x7f3888022070 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94436636619040] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3899f75980 20 remove_watcher() i=0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3899f75980 2 removed watcher, disabling cache 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.848+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94436636621088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94436636621088] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f3899f75980 20 remove_watcher() i=1 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94436636625616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x55e3be2db400 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f3898291640 1 -- 172.21.15.138:0/2253015717 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94436636625616] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3888032020 con 0x55e3be2db400 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f3899f75980 20 remove_watcher() i=2 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.852+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94436636631584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x7f3888022070 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f3897a90640 1 -- 172.21.15.138:0/2253015717 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94436636631584] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f38900b1040 con 0x7f3888022070 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f3899f75980 20 remove_watcher() i=3 2024-02-16T10:30:52.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94436636633712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x55e3be2d50d0 2024-02-16T10:30:52.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94436636633712] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x55e3be2d50d0 2024-02-16T10:30:52.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f3899f75980 20 remove_watcher() i=4 2024-02-16T10:30:52.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.856+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94436636636128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x7f38900f5040 2024-02-16T10:30:52.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94436636636128] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f3899f75980 20 remove_watcher() i=5 2024-02-16T10:30:52.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94436636638304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x7f38900f5040 2024-02-16T10:30:52.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94436636638304] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f3899f75980 20 remove_watcher() i=6 2024-02-16T10:30:52.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.860+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94436636642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55e3be3146b0 con 0x7f38900f5040 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94436636642576] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f388c00e5a0 con 0x7f38900f5040 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 20 remove_watcher() i=7 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f38900f5040 msgr2=0x7f38900c75f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f38900f5040 0x7f38900c75f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be2d50d0 msgr2=0x55e3be2d7570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be2d50d0 0x55e3be2d7570 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3888022070 msgr2=0x7f388802c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f3888022070 0x7f388802c450 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3be2db400 msgr2=0x55e3be2dd8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e3be2db400 0x55e3be2dd8c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37600342b0 msgr2=0x7f3760036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37600342b0 0x7f3760036770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f38900c7510 tx=0x7f38900de000 comp rx=0 tx=0).stop 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 msgr2=0x55e3be2c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f38880486d0 tx=0x7f3888049790 comp rx=0 tx=0).stop 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f389728f640 1 -- 172.21.15.138:0/2253015717 reap_dead start 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 shutdown_connections 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/2253015717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2c2c10 0x55e3be2c9960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 >> 172.21.15.138:0/2253015717 conn(0x55e3be2bd7e0 msgr2=0x55e3be2be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 shutdown_connections 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/2253015717 wait complete. 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 msgr2=0x7f37700367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 0x7f37700367c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55e3be2a3010 tx=0x7f38900c7480 comp rx=0 tx=0).stop 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 msgr2=0x55e3be2b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55e3be29c670 tx=0x7f388800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 shutdown_connections 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3770034300 0x7f37700367c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/549061581 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be2b5ca0 0x55e3be2b60c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 >> 172.21.15.138:0/549061581 conn(0x55e3be2aaab0 msgr2=0x55e3be2ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 shutdown_connections 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/549061581 wait complete. 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 msgr2=0x55e3be2a2110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 0x55e3be2a2110 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 msgr2=0x55e3be2a7750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 0x55e3be2a7750 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 msgr2=0x7f3780036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 0x7f3780036770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f388c000f70 tx=0x7f388c0012c0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 msgr2=0x55e3be29b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f389001b870 tx=0x7f3890019810 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 shutdown_connections 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e3be2a3ef0 0x55e3be2a7750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e3be1ad770 0x55e3be2a2110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f37800342b0 0x7f3780036770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 --2- 172.21.15.138:0/1286380851 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e3be11e6b0 0x55e3be29b420 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 >> 172.21.15.138:0/1286380851 conn(0x55e3be1a4d10 msgr2=0x55e3be28ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 shutdown_connections 2024-02-16T10:30:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.864+0000 7f3899f75980 1 -- 172.21.15.138:0/1286380851 wait complete. 2024-02-16T10:30:52.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T10:30:52.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-02-16T10:30:52.882 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-02-16T10:30:52.954 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:52.954 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:52.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa19834e980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b6a3254ba0 0x55b6a3254f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa19834e980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b6a319eb50 con 0x55b6a3255a60 2024-02-16T10:30:52.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa19834e980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b6a3165d30 con 0x55b6a3254ba0 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195e69640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b6a3254ba0 0x55b6a3254f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195668640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55b6a3255a60 0x55b6a3255e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52288/0 (socket says 172.21.15.138:52288) 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195e69640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b6a3254ba0 0x55b6a3254f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46518/0 (socket says 172.21.15.138:46518) 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195668640 1 -- 172.21.15.138:0/760141309 learned_addr learned my addr 172.21.15.138:0/760141309 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195e69640 1 -- 172.21.15.138:0/760141309 >> v1:172.21.15.107:6789/0 conn(0x55b6a3255a60 legacy=0x55b6a3255e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.948+0000 7fa195e69640 1 -- 172.21.15.138:0/760141309 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a3255670 con 0x55b6a3254ba0 2024-02-16T10:30:52.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa195e69640 1 --2- 172.21.15.138:0/760141309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3254f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa19000a420 tx=0x7fa19001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279c5878747b3dc server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa194e67640 1 -- 172.21.15.138:0/760141309 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900aa530 con 0x55b6a3254ba0 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa194e67640 1 -- 172.21.15.138:0/760141309 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900a6050 con 0x55b6a3254ba0 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa194e67640 1 -- 172.21.15.138:0/760141309 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900aa800 con 0x55b6a3254ba0 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 -- 172.21.15.138:0/760141309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 msgr2=0x55b6a3254f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 --2- 172.21.15.138:0/760141309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3254f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa19000a420 tx=0x7fa19001afd0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 -- 172.21.15.138:0/760141309 shutdown_connections 2024-02-16T10:30:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 --2- 172.21.15.138:0/760141309 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3254f80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 -- 172.21.15.138:0/760141309 >> 172.21.15.138:0/760141309 conn(0x55b6a31c7f40 msgr2=0x55b6a31c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 -- 172.21.15.138:0/760141309 shutdown_connections 2024-02-16T10:30:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.952+0000 7fa19834e980 1 -- 172.21.15.138:0/760141309 wait complete. 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.964+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.964+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.964+0000 7fa19834e980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.964+0000 7fa19834e980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a3162fc0 con 0x55b6a3254ba0 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46522/0 (socket says 172.21.15.138:46522) 2024-02-16T10:30:52.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 -- 172.21.15.138:0/1056685409 learned_addr learned my addr 172.21.15.138:0/1056685409 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 -- 172.21.15.138:0/1056685409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19000a100 con 0x55b6a3254ba0 2024-02-16T10:30:52.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- 172.21.15.138:0/1056685409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ad040 tx=0x7fa1900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11a03ad616a500a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa083e07640 1 -- 172.21.15.138:0/1056685409 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900aa630 con 0x55b6a3254ba0 2024-02-16T10:30:52.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa083e07640 1 -- 172.21.15.138:0/1056685409 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900aa790 con 0x55b6a3254ba0 2024-02-16T10:30:52.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa083e07640 1 -- 172.21.15.138:0/1056685409 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900aaa30 con 0x55b6a3254ba0 2024-02-16T10:30:52.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- 172.21.15.138:0/1056685409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 msgr2=0x55b6a333ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 --2- 172.21.15.138:0/1056685409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ad040 tx=0x7fa1900033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- 172.21.15.138:0/1056685409 shutdown_connections 2024-02-16T10:30:52.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 --2- 172.21.15.138:0/1056685409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a333ece0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- 172.21.15.138:0/1056685409 >> 172.21.15.138:0/1056685409 conn(0x55b6a31c7f40 msgr2=0x55b6a333a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- 172.21.15.138:0/1056685409 shutdown_connections 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- 172.21.15.138:0/1056685409 wait complete. 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa19834e980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a315e7a0 con 0x55b6a3254ba0 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46528/0 (socket says 172.21.15.138:46528) 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 -- 172.21.15.138:0/746810974 learned_addr learned my addr 172.21.15.138:0/746810974 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a3255670 con 0x55b6a3254ba0 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.968+0000 7fa195e69640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa19001b870 tx=0x7fa190019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 -- 172.21.15.138:0/746810974 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900b6890 con 0x55b6a3254ba0 2024-02-16T10:30:52.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6a3345f90 con 0x55b6a3254ba0 2024-02-16T10:30:52.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6a3346440 con 0x55b6a3254ba0 2024-02-16T10:30:52.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 -- 172.21.15.138:0/746810974 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900b69f0 con 0x55b6a3254ba0 2024-02-16T10:30:52.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 -- 172.21.15.138:0/746810974 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1900b6c90 con 0x55b6a3254ba0 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 -- 172.21.15.138:0/746810974 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa1900c0450 con 0x55b6a3254ba0 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 0x7fa07c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa082604640 1 -- 172.21.15.138:0/746810974 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa1900e3d60 con 0x55b6a3254ba0 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa195668640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 0x7fa07c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 0x55b6a334c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a334cc80 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 0x55b6a334c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa195668640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 0x7fa07c036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa18c001da0 tx=0x7fa18c001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 0x55b6a334c740 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 -- 172.21.15.138:0/746810974 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1880083f0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3349e80 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 -- 172.21.15.138:0/746810974 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1880083f0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a334e9b0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 -- 172.21.15.138:0/746810974 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa1880083f0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a334dbb0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19666a640 1 -- 172.21.15.138:0/746810974 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1880083f0 con 0x55b6a3255a60 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 0x55b6a3351d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3352300 con 0x55b6a334e4d0 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.972+0000 7fa195e69640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 0x55b6a3351d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa195e69640 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 0x55b6a3351d30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa195e69640 1 -- 172.21.15.138:0/746810974 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa1900b1040 con 0x55b6a334e4d0 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a30f6f20 con 0x55b6a3360220 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46536/0 (socket says 172.21.15.138:46536) 2024-02-16T10:30:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19666a640 1 -- 172.21.15.138:0/631310263 learned_addr learned my addr 172.21.15.138:0/631310263 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19666a640 1 -- 172.21.15.138:0/631310263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a3360b80 con 0x55b6a3360220 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19666a640 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55b6a3346ca0 tx=0x7fa18800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 -- 172.21.15.138:0/631310263 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa18800f040 con 0x55b6a3360220 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6a3360dd0 con 0x55b6a3360220 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6a3361920 con 0x55b6a3360220 2024-02-16T10:30:52.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 -- 172.21.15.138:0/631310263 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18801a560 con 0x55b6a3360220 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 -- 172.21.15.138:0/631310263 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa18801a800 con 0x55b6a3360220 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 -- 172.21.15.138:0/631310263 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa18801a960 con 0x55b6a3360220 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 0x7fa070036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa07b7fe640 1 -- 172.21.15.138:0/631310263 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa18804b8b0 con 0x55b6a3360220 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.976+0000 7fa195e69640 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 0x7fa070036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa195e69640 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 0x7fa070036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa1900e2210 tx=0x7fa1900c74a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a30ea790 con 0x55b6a336d1a0 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46542/0 (socket says 172.21.15.138:46542) 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 -- 172.21.15.138:0/4130772518 learned_addr learned my addr 172.21.15.138:0/4130772518 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 -- 172.21.15.138:0/4130772518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a336db90 con 0x55b6a336d1a0 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 --2- 172.21.15.138:0/4130772518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa18800efb0 tx=0x7fa1880168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ef3d678d951630 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa0797fa640 1 -- 172.21.15.138:0/4130772518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa188024500 con 0x55b6a336d1a0 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa0797fa640 1 -- 172.21.15.138:0/4130772518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188024660 con 0x55b6a336d1a0 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa0797fa640 1 -- 172.21.15.138:0/4130772518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa188043650 con 0x55b6a336d1a0 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- 172.21.15.138:0/4130772518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 msgr2=0x55b6a336d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 --2- 172.21.15.138:0/4130772518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa18800efb0 tx=0x7fa1880168b0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- 172.21.15.138:0/4130772518 shutdown_connections 2024-02-16T10:30:52.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 --2- 172.21.15.138:0/4130772518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a336d5c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- 172.21.15.138:0/4130772518 >> 172.21.15.138:0/4130772518 conn(0x55b6a3367d20 msgr2=0x55b6a3368c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- 172.21.15.138:0/4130772518 shutdown_connections 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- 172.21.15.138:0/4130772518 wait complete. 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 Processor -- start 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- start start 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19834e980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6a3374460 con 0x55b6a336d1a0 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46556/0 (socket says 172.21.15.138:46556) 2024-02-16T10:30:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 learned_addr learned my addr 172.21.15.138:0/2766159812 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:52.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.980+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6a3361920 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19666a640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa188016a00 tx=0x7fa188049c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 -- 172.21.15.138:0/2766159812 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa188024500 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 -- 172.21.15.138:0/2766159812 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880186c0 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6a3374660 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 -- 172.21.15.138:0/2766159812 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa188023c00 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6a3374a90 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 -- 172.21.15.138:0/2766159812 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa1880233c0 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0600342b0 0x7fa060036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa0677fe640 1 -- 172.21.15.138:0/2766159812 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa188039ca0 con 0x55b6a336d1a0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195e69640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0600342b0 0x7fa060036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:52.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a337f600 0x55b6a3381aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33821f0 con 0x55b6a337f600 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a337f600 0x55b6a3381aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195e69640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0600342b0 0x7fa060036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1900c7510 tx=0x7fa1900de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a337f600 0x55b6a3381aa0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 realm 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a337eb20 con 0x55b6a337f600 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3382c70 con 0x55b6a337f600 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3383130 con 0x55b6a337f600 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33839d0 con 0x55b6a337f600 2024-02-16T10:30:53.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 20 searching for the correct realm 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b6a33856f0 0x55b6a3387ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x55b6a33856f0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19666a640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b6a33856f0 0x55b6a3387ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.984+0000 7fa19666a640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b6a33856f0 0x55b6a3387ae0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa19666a640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa1880163f0 0x7fa18802d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1880163f0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195e69640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa1880163f0 0x7fa18802d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195e69640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa1880163f0 0x7fa18802d430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195e69640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa1900c9030 0x7fa1900e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa1900c9030 0x7fa1900e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa1900c9030 0x7fa1900e3300 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x55b6a337f600 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x55b6a337f600 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.988+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1880163f0 2024-02-16T10:30:53.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x55b6a33856f0 2024-02-16T10:30:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x55b6a337f600 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388020 con 0x7fa1900c9030 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a337f600 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1880163f0 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1900c9030 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.992+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a337f600 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a337f600 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1900c9030 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1880163f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a337f600 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1900c9030 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1900c9030 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1880163f0 2024-02-16T10:30:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a33856f0 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:52.996+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1900c9030 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x55b6a337f600 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa18c02e040 con 0x7fa1880163f0 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3384330 con 0x55b6a337f600 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3383fb0 con 0x55b6a337f600 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3384c00 con 0x7fa1880163f0 2024-02-16T10:30:53.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 zone default found 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 4 Realm: () 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 zonegroup default 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3388410 con 0x7fa1900c9030 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338a290 con 0x55b6a33856f0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338a5f0 con 0x55b6a33856f0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 started sync module instance, tier type = 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.000+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3389860 con 0x7fa1880163f0 2024-02-16T10:30:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94242910802880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338a9a0 con 0x7fa1880163f0 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338b370 con 0x55b6a337f600 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94242910802880] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94242910809712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338b720 con 0x55b6a337f600 2024-02-16T10:30:53.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.004+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338c090 con 0x55b6a33856f0 2024-02-16T10:30:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94242910813168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338c8e0 con 0x55b6a33856f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338d340 con 0x7fa1880163f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94242910809712] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94242910805008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338d6f0 con 0x7fa1880163f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338e0a0 con 0x55b6a337f600 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94242910813168] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94242910805008] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94242910815296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338dbc0 con 0x55b6a337f600 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.008+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338e8f0 con 0x7fa1900c9030 2024-02-16T10:30:53.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.012+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94242910815296] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.012+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.012+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94242910817840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338e5e0 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.012+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338ee20 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.012+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94242910817840] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94242910822720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338f000 con 0x7fa1900c9030 2024-02-16T10:30:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338f800 con 0x7fa1900c9030 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94242910826976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338fc40 con 0x7fa1900c9030 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=0 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=1 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=2 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=3 2024-02-16T10:30:53.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=4 2024-02-16T10:30:53.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=5 2024-02-16T10:30:53.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94242910822720] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.016+0000 7fa19834e980 20 add_watcher() i=6 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94242910826976] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 add_watcher() i=7 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338e640 con 0x55b6a337f600 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94242910823952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338f860 con 0x55b6a337f600 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94242910823952] v31'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa0477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 5 note: GC not initialized 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa0467fc640 20 reqs_thread_entry: start 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 Filter name: none 2024-02-16T10:30:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7f9fb7fff640 20 reqs_thread_entry: start 2024-02-16T10:30:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33b4480 con 0x55b6a337f600 2024-02-16T10:30:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa19834e980 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T10:30:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.020+0000 7fa0477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94242910823952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3394dc0 con 0x55b6a337f600 2024-02-16T10:30:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94242910823952] v31'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94242910802880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338e610 con 0x7fa1880163f0 2024-02-16T10:30:53.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94242910802880] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa19834e980 20 remove_watcher() i=0 2024-02-16T10:30:53.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa19834e980 2 removed watcher, disabling cache 2024-02-16T10:30:53.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94242910809712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33893c0 con 0x55b6a337f600 2024-02-16T10:30:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.024+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94242910809712] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 20 remove_watcher() i=1 2024-02-16T10:30:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94242910813168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33893c0 con 0x55b6a33856f0 2024-02-16T10:30:53.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19666a640 1 -- 172.21.15.138:0/2766159812 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94242910813168] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa188041070 con 0x55b6a33856f0 2024-02-16T10:30:53.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 20 remove_watcher() i=2 2024-02-16T10:30:53.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94242910805008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33893c0 con 0x7fa1880163f0 2024-02-16T10:30:53.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa195e69640 1 -- 172.21.15.138:0/2766159812 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94242910805008] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1900b1040 con 0x7fa1880163f0 2024-02-16T10:30:53.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 20 remove_watcher() i=3 2024-02-16T10:30:53.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.028+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94242910815296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a3389c10 con 0x55b6a337f600 2024-02-16T10:30:53.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94242910815296] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x55b6a337f600 2024-02-16T10:30:53.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa19834e980 20 remove_watcher() i=4 2024-02-16T10:30:53.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94242910817840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a33893c0 con 0x7fa1900c9030 2024-02-16T10:30:53.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94242910817840] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa19834e980 20 remove_watcher() i=5 2024-02-16T10:30:53.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.032+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94242910822720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338c440 con 0x7fa1900c9030 2024-02-16T10:30:53.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94242910822720] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 20 remove_watcher() i=6 2024-02-16T10:30:53.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94242910826976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6a338c440 con 0x7fa1900c9030 2024-02-16T10:30:53.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94242910826976] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa18c00e640 con 0x7fa1900c9030 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 20 remove_watcher() i=7 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa1900c9030 msgr2=0x7fa1900e3300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa1900c9030 0x7fa1900e3300 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a337f600 msgr2=0x55b6a3381aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a337f600 0x55b6a3381aa0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa1880163f0 msgr2=0x7fa18802d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa1880163f0 0x7fa18802d430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b6a33856f0 msgr2=0x55b6a3387ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b6a33856f0 0x55b6a3387ae0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0600342b0 msgr2=0x7fa060036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0600342b0 0x7fa060036770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa1900c7510 tx=0x7fa1900de000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa195668640 1 -- 172.21.15.138:0/2766159812 reap_dead start 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 msgr2=0x55b6a3373f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa188016a00 tx=0x7fa188049c30 comp rx=0 tx=0).stop 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 shutdown_connections 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/2766159812 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a336d1a0 0x55b6a3373f20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 >> 172.21.15.138:0/2766159812 conn(0x55b6a3367d20 msgr2=0x55b6a3368c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 shutdown_connections 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/2766159812 wait complete. 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 msgr2=0x7fa070036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 0x7fa070036770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa1900e2210 tx=0x7fa1900c74a0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 msgr2=0x55b6a3360640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55b6a3346ca0 tx=0x7fa18800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 shutdown_connections 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa0700342b0 0x7fa070036770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 --2- 172.21.15.138:0/631310263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3360220 0x55b6a3360640 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 >> 172.21.15.138:0/631310263 conn(0x55b6a3355030 msgr2=0x55b6a3355b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 shutdown_connections 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.036+0000 7fa19834e980 1 -- 172.21.15.138:0/631310263 wait complete. 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 msgr2=0x55b6a334c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 0x55b6a334c740 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 msgr2=0x55b6a3351d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 0x55b6a3351d30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 msgr2=0x7fa07c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 0x7fa07c036770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa18c001da0 tx=0x7fa18c001300 comp rx=0 tx=0).stop 2024-02-16T10:30:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 msgr2=0x55b6a3345a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa19001b870 tx=0x7fa190019810 comp rx=0 tx=0).stop 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 shutdown_connections 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b6a334e4d0 0x55b6a3351d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b6a3255a60 0x55b6a334c740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa07c0342b0 0x7fa07c036770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 --2- 172.21.15.138:0/746810974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b6a3254ba0 0x55b6a3345a50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 >> 172.21.15.138:0/746810974 conn(0x55b6a31c7f40 msgr2=0x55b6a3339380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 shutdown_connections 2024-02-16T10:30:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.040+0000 7fa19834e980 1 -- 172.21.15.138:0/746810974 wait complete. 2024-02-16T10:30:53.055 INFO:teuthology.orchestra.run.smithi138.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"uLnUXNjlcsyY/mtAnucN97cH","ver":2},"mtime":"2024-02-16T10:30:52.844613Z","data":{"bucket":{"name":"myfoo","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","bucket_id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-02-16T10:30:49.675956Z","linked":true,"has_bucket_info":false}} 2024-02-16T10:30:53.055 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'uLnUXNjlcsyY/mtAnucN97cH', 'ver': 2}, 'mtime': '2024-02-16T10:30:52.844613Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'bucket_id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-02-16T10:30:49.675956Z', 'linked': True, 'has_bucket_info': False}} 2024-02-16T10:30:53.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T10:30:53.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-02-16T10:30:53.055 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-02-16T10:30:53.131 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:53.131 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:53.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89e64d980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600398ead40 0x56003997e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89e64d980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600398c1b60 con 0x5600398ec030 2024-02-16T10:30:53.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89e64d980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x560039888d30 con 0x5600398ead40 2024-02-16T10:30:53.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89b967640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600398ead40 0x56003997e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89c168640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5600398ec030 0x5600398ea630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52302/0 (socket says 172.21.15.138:52302) 2024-02-16T10:30:53.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89c168640 1 -- 172.21.15.138:0/1037103314 learned_addr learned my addr 172.21.15.138:0/1037103314 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:53.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89b967640 1 -- 172.21.15.138:0/1037103314 >> v1:172.21.15.107:6789/0 conn(0x5600398ec030 legacy=0x5600398ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.124+0000 7fa89b967640 1 -- 172.21.15.138:0/1037103314 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600398eb150 con 0x5600398ead40 2024-02-16T10:30:53.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89b967640 1 --2- 172.21.15.138:0/1037103314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x56003997e640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa88400a480 tx=0x7fa88401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1eecf294335357 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89b166640 1 -- 172.21.15.138:0/1037103314 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8840aa530 con 0x5600398ead40 2024-02-16T10:30:53.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89b166640 1 -- 172.21.15.138:0/1037103314 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840a6050 con 0x5600398ead40 2024-02-16T10:30:53.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89b166640 1 -- 172.21.15.138:0/1037103314 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8840aa7e0 con 0x5600398ead40 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 -- 172.21.15.138:0/1037103314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 msgr2=0x56003997e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1037103314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x56003997e640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa88400a480 tx=0x7fa88401b280 comp rx=0 tx=0).stop 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 -- 172.21.15.138:0/1037103314 shutdown_connections 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1037103314 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x56003997e640 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 -- 172.21.15.138:0/1037103314 >> 172.21.15.138:0/1037103314 conn(0x560039970f00 msgr2=0x560039973320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 -- 172.21.15.138:0/1037103314 shutdown_connections 2024-02-16T10:30:53.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.128+0000 7fa89e64d980 1 -- 172.21.15.138:0/1037103314 wait complete. 2024-02-16T10:30:53.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.140+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.140+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560039885fc0 con 0x5600398ead40 2024-02-16T10:30:53.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46576/0 (socket says 172.21.15.138:46576) 2024-02-16T10:30:53.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 -- 172.21.15.138:0/361751122 learned_addr learned my addr 172.21.15.138:0/361751122 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 -- 172.21.15.138:0/361751122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884005d30 con 0x5600398ead40 2024-02-16T10:30:53.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 --2- 172.21.15.138:0/361751122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa894001c00 tx=0x7fa89400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e080e5e2daf97cf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa78a60c640 1 -- 172.21.15.138:0/361751122 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89400e690 con 0x5600398ead40 2024-02-16T10:30:53.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa78a60c640 1 -- 172.21.15.138:0/361751122 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400e810 con 0x5600398ead40 2024-02-16T10:30:53.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa78a60c640 1 -- 172.21.15.138:0/361751122 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89400eb30 con 0x5600398ead40 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- 172.21.15.138:0/361751122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 msgr2=0x560039a61b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 --2- 172.21.15.138:0/361751122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa894001c00 tx=0x7fa89400b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- 172.21.15.138:0/361751122 shutdown_connections 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 --2- 172.21.15.138:0/361751122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a61b50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- 172.21.15.138:0/361751122 >> 172.21.15.138:0/361751122 conn(0x560039970f00 msgr2=0x560039a5d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- 172.21.15.138:0/361751122 shutdown_connections 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- 172.21.15.138:0/361751122 wait complete. 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89e64d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600398817a0 con 0x5600398ead40 2024-02-16T10:30:53.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46590/0 (socket says 172.21.15.138:46590) 2024-02-16T10:30:53.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 -- 172.21.15.138:0/1789193446 learned_addr learned my addr 172.21.15.138:0/1789193446 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.144+0000 7fa89c168640 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600398c1b60 con 0x5600398ead40 2024-02-16T10:30:53.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c168640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa89400b710 tx=0x7fa894000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 -- 172.21.15.138:0/1789193446 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89401f070 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560039a69040 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560039a694f0 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 -- 172.21.15.138:0/1789193446 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89401a910 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 -- 172.21.15.138:0/1789193446 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa89401abf0 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 -- 172.21.15.138:0/1789193446 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa89400a040 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 0x7fa784036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa788e09640 1 -- 172.21.15.138:0/1789193446 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa894049ed0 con 0x5600398ead40 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89b967640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 0x7fa784036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 0x560039a6f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039a6fd30 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 0x560039a6f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89b967640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 0x7fa784036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa8840ac000 tx=0x7fa8840a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 0x560039a6f7f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 -- 172.21.15.138:0/1789193446 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039a70140 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 -- 172.21.15.138:0/1789193446 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa88c00a4d0 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039a719f0 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 -- 172.21.15.138:0/1789193446 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fa88c00a4d0 con 0x5600398ec030 2024-02-16T10:30:53.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039a70bf0 con 0x5600398ec030 2024-02-16T10:30:53.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c969640 1 -- 172.21.15.138:0/1789193446 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa88c00a4d0 con 0x5600398ec030 2024-02-16T10:30:53.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 0x560039a74d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039a753c0 con 0x560039a71510 2024-02-16T10:30:53.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.148+0000 7fa89c168640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 0x560039a74d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c168640 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 0x560039a74d70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c168640 1 -- 172.21.15.138:0/1789193446 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa89402e3f0 con 0x560039a71510 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560039819f20 con 0x560039a83360 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46600/0 (socket says 172.21.15.138:46600) 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c969640 1 -- 172.21.15.138:0/1407884434 learned_addr learned my addr 172.21.15.138:0/1407884434 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c969640 1 -- 172.21.15.138:0/1407884434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560039a83cc0 con 0x560039a83360 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c969640 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x560039a69f30 tx=0x7fa88c018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 -- 172.21.15.138:0/1407884434 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c01d070 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560039a83f10 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 -- 172.21.15.138:0/1407884434 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c014450 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 -- 172.21.15.138:0/1407884434 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c0146f0 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560039a84a60 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 -- 172.21.15.138:0/1407884434 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa88c020020 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 0x7fa774036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa781ffb640 1 -- 172.21.15.138:0/1407884434 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa88c04b0d0 con 0x560039a83360 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.152+0000 7fa89c168640 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 0x7fa774036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c168640 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 0x7fa774036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560039a70630 tx=0x7fa894024c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003980d790 con 0x560039a90300 2024-02-16T10:30:53.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46608/0 (socket says 172.21.15.138:46608) 2024-02-16T10:30:53.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 -- 172.21.15.138:0/2264056467 learned_addr learned my addr 172.21.15.138:0/2264056467 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 -- 172.21.15.138:0/2264056467 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560039a90cf0 con 0x560039a90300 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- 172.21.15.138:0/2264056467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0494c0 tx=0x7fa88c0480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352814bce0336f75 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa77b7fe640 1 -- 172.21.15.138:0/2264056467 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c03b050 con 0x560039a90300 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa77b7fe640 1 -- 172.21.15.138:0/2264056467 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c03b1b0 con 0x560039a90300 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa77b7fe640 1 -- 172.21.15.138:0/2264056467 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c012690 con 0x560039a90300 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- 172.21.15.138:0/2264056467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 msgr2=0x560039a90720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 --2- 172.21.15.138:0/2264056467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0494c0 tx=0x7fa88c0480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- 172.21.15.138:0/2264056467 shutdown_connections 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 --2- 172.21.15.138:0/2264056467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a90720 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- 172.21.15.138:0/2264056467 >> 172.21.15.138:0/2264056467 conn(0x560039a8ae80 msgr2=0x560039a8bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- 172.21.15.138:0/2264056467 shutdown_connections 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- 172.21.15.138:0/2264056467 wait complete. 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 Processor -- start 2024-02-16T10:30:53.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- start start 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89e64d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560039a975c0 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46616/0 (socket says 172.21.15.138:46616) 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 learned_addr learned my addr 172.21.15.138:0/1511985189 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560039a84a60 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.156+0000 7fa89c969640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa88c048120 tx=0x7fa88c049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 -- 172.21.15.138:0/1511985189 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c03b050 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560039a977c0 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 -- 172.21.15.138:0/1511985189 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c02b720 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 -- 172.21.15.138:0/1511985189 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa88c02be60 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560039a97bf0 con 0x560039a90300 2024-02-16T10:30:53.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 -- 172.21.15.138:0/1511985189 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa88c049600 con 0x560039a90300 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa76c034210 0x7fa76c0366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa779ffb640 1 -- 172.21.15.138:0/1511985189 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fa88c04cc90 con 0x560039a90300 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89c168640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa76c034210 0x7fa76c0366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560039aa27c0 0x560039aa4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa53d0 con 0x560039aa27c0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560039aa27c0 0x560039aa4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89c168640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa76c034210 0x7fa76c0366d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560039a75780 tx=0x7fa894038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560039aa27c0 0x560039aa4c80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 realm 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa57c0 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa6010 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa6370 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa6b70 con 0x560039aa27c0 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 20 searching for the correct realm 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560039aa8a20 0x560039aaaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89c969640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560039aa8a20 0x560039aaaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.160+0000 7fa89c969640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560039aa8a20 0x560039aaaee0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c969640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa88c014850 0x7fa88c049950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa88c014850 2024-02-16T10:30:53.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c168640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa88c014850 0x7fa88c049950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c168640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa88c014850 0x7fa88c049950 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c168640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa894041740 0x7fa8940233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa894041740 0x7fa8940233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa894041740 0x7fa8940233c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.164+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa88c014850 2024-02-16T10:30:53.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa88c014850 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.168+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa88c014850 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa88c014850 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa8a20 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.172+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x7fa894041740 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab560 con 0x560039aa27c0 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa8840d9080 con 0x7fa88c014850 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:53.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa74d0 con 0x560039aa27c0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa7d20 con 0x560039aa27c0 2024-02-16T10:30:53.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aa7d20 con 0x7fa88c014850 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 zone default found 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 4 Realm: () 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 zonegroup default 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aab9e0 con 0x7fa894041740 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aad7c0 con 0x560039aa8a20 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aadbb0 con 0x560039aa8a20 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 started sync module instance, tier type = 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:53.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.176+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aacc50 con 0x7fa88c014850 2024-02-16T10:30:53.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94558967482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aad450 con 0x7fa88c014850 2024-02-16T10:30:53.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aae620 con 0x560039aa27c0 2024-02-16T10:30:53.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94558967482288] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94558967484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aaea00 con 0x560039aa27c0 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.180+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aaf370 con 0x560039aa8a20 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94558967484336] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94558967488832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aaf370 con 0x560039aa8a20 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aafce0 con 0x7fa88c014850 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94558967494720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab0530 con 0x7fa88c014850 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab0f50 con 0x560039aa27c0 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94558967488832] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.184+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94558967494720] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94558967496848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039aaeed0 con 0x560039aa27c0 2024-02-16T10:30:53.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab17a0 con 0x7fa894041740 2024-02-16T10:30:53.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94558967496848] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94558967499312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab16d0 con 0x7fa894041740 2024-02-16T10:30:53.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.188+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab2030 con 0x7fa894041740 2024-02-16T10:30:53.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94558967503616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab2400 con 0x7fa894041740 2024-02-16T10:30:53.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab2ea0 con 0x7fa894041740 2024-02-16T10:30:53.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94558967499312] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94558967503616] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94558967507328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab1f20 con 0x7fa894041740 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=0 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=1 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=2 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=3 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=4 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=5 2024-02-16T10:30:53.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.192+0000 7fa89e64d980 20 add_watcher() i=6 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94558967507328] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 add_watcher() i=7 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab5e90 con 0x560039aa27c0 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94558967501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ab3300 con 0x560039aa27c0 2024-02-16T10:30:53.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94558967501360] v31'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa7527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 5 note: GC not initialized 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa7517e2640 20 reqs_thread_entry: start 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 Filter name: none 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa6c2ffd640 20 reqs_thread_entry: start 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ad7cd0 con 0x560039aa27c0 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:53.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ad96d0 con 0x560039aa27c0 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=193 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.196+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 8.a 8:502b17b3:root::.bucket.meta.testx%3amyfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039adad30 con 0x560039aa27c0 2024-02-16T10:30:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 20 rados_obj.operate() r=0 bl.length=371 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-02-16T10:30:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039adf130 con 0x560039aa27c0 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae29f0 con 0x560039aa27c0 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(66 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [create,call,writefull 0~352,setxattr (123)] v31'5 uv5 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x7 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94558967695168 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae23f0 con 0x560039aa27c0 2024-02-16T10:30:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify (1) cookie 94558967496848 notify 133143986192 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x5600398eb150 con 0x560039aa27c0 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa77b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94558967496848 notifier 4556 bl.length()=701 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa77b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x7 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa77b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa77b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(67 notify.4 [notify cookie 94558967695168 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa77b7fe640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa760003ea0 con 0x560039aa27c0 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== watch-notify(notify_complete (2) cookie 94558967695168 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa8840cf970 con 0x560039aa27c0 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:53.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.200+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae2550 con 0x7fa88c014850 2024-02-16T10:30:53.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(69 foo.buckets [call] v31'28 uv28 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae28b0 con 0x7fa88c014850 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'29 uv29 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89e64d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89e64d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89e64d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.204+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94558967703728 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa894041740 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== watch-notify(notify (1) cookie 94558967503616 notify 133143986194 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7fa8840cf970 con 0x7fa894041740 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94558967503616 notifier 4556 bl.length()=314 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:53.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(71 notify.6 [notify cookie 94558967703728 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa760003ea0 con 0x7fa894041740 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== watch-notify(notify_complete (2) cookie 94558967703728 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa8840cfd00 con 0x7fa894041740 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94558967703728 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== watch-notify(notify (1) cookie 94558967496848 notify 133143986193 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7fa8840cfd00 con 0x560039aa27c0 2024-02-16T10:30:53.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94558967496848 notifier 4556 bl.length()=155 2024-02-16T10:30:53.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(73 notify.4 [notify cookie 94558967703728 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77affd640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa6d00032c0 con 0x560039aa27c0 2024-02-16T10:30:53.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== watch-notify(notify_complete (2) cookie 94558967703728 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa8840dd560 con 0x560039aa27c0 2024-02-16T10:30:53.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(75 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 from cache 2024-02-16T10:30:53.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [notify cookie 94558967703728 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== watch-notify(notify (1) cookie 94558967494720 notify 133143986190 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7fa894033040 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94558967494720 notifier 4556 bl.length()=212 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa77b7fe640 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa760003ea0 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(76 notify.3 [notify cookie 94558967703728 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== watch-notify(notify_complete (2) cookie 94558967703728 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560039a694f0 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(77 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.208+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 8.a 8:502b17b3:root::.bucket.meta.testx%3amyfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa7527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94558967501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94558967501360] v31'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94558967482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa88c014850 2024-02-16T10:30:53.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94558967482288] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89e64d980 20 remove_watcher() i=0 2024-02-16T10:30:53.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89e64d980 2 removed watcher, disabling cache 2024-02-16T10:30:53.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.212+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94558967484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94558967484336] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89e64d980 20 remove_watcher() i=1 2024-02-16T10:30:53.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94558967488832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa8a20 2024-02-16T10:30:53.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89c969640 1 -- 172.21.15.138:0/1511985189 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94558967488832] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa88c00a4d0 con 0x560039aa8a20 2024-02-16T10:30:53.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89e64d980 20 remove_watcher() i=2 2024-02-16T10:30:53.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.216+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94558967494720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa88c014850 2024-02-16T10:30:53.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89c168640 1 -- 172.21.15.138:0/1511985189 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94558967494720] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa894055040 con 0x7fa88c014850 2024-02-16T10:30:53.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89e64d980 20 remove_watcher() i=3 2024-02-16T10:30:53.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94558967496848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x560039aa27c0 2024-02-16T10:30:53.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94558967496848] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x560039aa27c0 2024-02-16T10:30:53.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89e64d980 20 remove_watcher() i=4 2024-02-16T10:30:53.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.220+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94558967499312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa894041740 2024-02-16T10:30:53.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94558967499312] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 20 remove_watcher() i=5 2024-02-16T10:30:53.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94558967503616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa894041740 2024-02-16T10:30:53.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94558967503616] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 20 remove_watcher() i=6 2024-02-16T10:30:53.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94558967507328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560039ae21f0 con 0x7fa894041740 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94558967507328] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8840b4670 con 0x7fa894041740 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 20 remove_watcher() i=7 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa894041740 msgr2=0x7fa8940233c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fa894041740 0x7fa8940233c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560039aa27c0 msgr2=0x560039aa4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560039aa27c0 0x560039aa4c80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa88c014850 msgr2=0x7fa88c049950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fa88c014850 0x7fa88c049950 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560039aa8a20 msgr2=0x560039aaaee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.224+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560039aa8a20 0x560039aaaee0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa76c034210 msgr2=0x7fa76c0366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa76c034210 0x7fa76c0366d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560039a75780 tx=0x7fa894038000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 msgr2=0x560039a97080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89b967640 1 -- 172.21.15.138:0/1511985189 reap_dead start 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa88c048120 tx=0x7fa88c049450 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 shutdown_connections 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1511985189 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a90300 0x560039a97080 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 >> 172.21.15.138:0/1511985189 conn(0x560039a8ae80 msgr2=0x560039a8bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 shutdown_connections 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1511985189 wait complete. 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 msgr2=0x7fa774036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 0x7fa774036770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560039a70630 tx=0x7fa894024c60 comp rx=0 tx=0).stop 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 msgr2=0x560039a83780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x560039a69f30 tx=0x7fa88c018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 shutdown_connections 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7740342b0 0x7fa774036770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1407884434 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560039a83360 0x560039a83780 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 >> 172.21.15.138:0/1407884434 conn(0x560039a78170 msgr2=0x560039a78c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 shutdown_connections 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1407884434 wait complete. 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 msgr2=0x560039a6f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 0x560039a6f7f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 msgr2=0x560039a74d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 0x560039a74d70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 msgr2=0x7fa784036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 0x7fa784036770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa8840ac000 tx=0x7fa8840a5000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 msgr2=0x560039a68b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa89400b710 tx=0x7fa894000bd0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 shutdown_connections 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560039a71510 0x560039a74d70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600398ec030 0x560039a6f7f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa7840342b0 0x7fa784036770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 --2- 172.21.15.138:0/1789193446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600398ead40 0x560039a68b00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 >> 172.21.15.138:0/1789193446 conn(0x560039970f00 msgr2=0x560039a5c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 shutdown_connections 2024-02-16T10:30:53.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.228+0000 7fa89e64d980 1 -- 172.21.15.138:0/1789193446 wait complete. 2024-02-16T10:30:53.244 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:30:53.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-02-16T10:30:53.244 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-02-16T10:30:53.321 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:53.355 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:53.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a18de4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564412a93a10 0x564412a95e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a18de4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5644129dcb60 con 0x564412a8f4b0 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a18de4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5644129a3d30 con 0x564412a93a10 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a160fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564412a93a10 0x564412a95e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a168ff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x564412a8f4b0 0x564412a8f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52304/0 (socket says 172.21.15.138:52304) 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a160fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x564412a93a10 0x564412a95e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46620/0 (socket says 172.21.15.138:46620) 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a168ff640 1 -- 172.21.15.138:0/692121728 learned_addr learned my addr 172.21.15.138:0/692121728 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a160fe640 1 -- 172.21.15.138:0/692121728 >> v1:172.21.15.107:6789/0 conn(0x564412a8f4b0 legacy=0x564412a8f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a160fe640 1 -- 172.21.15.138:0/692121728 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412a97350 con 0x564412a93a10 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.312+0000 7f8a160fe640 1 --2- 172.21.15.138:0/692121728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a93a10 0x564412a95e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00a480 tx=0x7f8a0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0002755942f74a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a158fd640 1 -- 172.21.15.138:0/692121728 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c0ab540 con 0x564412a93a10 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a158fd640 1 -- 172.21.15.138:0/692121728 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c0ab6a0 con 0x564412a93a10 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a158fd640 1 -- 172.21.15.138:0/692121728 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0c0ab960 con 0x564412a93a10 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 -- 172.21.15.138:0/692121728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a93a10 msgr2=0x564412a95e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 --2- 172.21.15.138:0/692121728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a93a10 0x564412a95e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00a480 tx=0x7f8a0c01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 -- 172.21.15.138:0/692121728 shutdown_connections 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 --2- 172.21.15.138:0/692121728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a93a10 0x564412a95e00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 -- 172.21.15.138:0/692121728 >> 172.21.15.138:0/692121728 conn(0x564412a8ad80 msgr2=0x564412a8d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 -- 172.21.15.138:0/692121728 shutdown_connections 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.316+0000 7f8a18de4980 1 -- 172.21.15.138:0/692121728 wait complete. 2024-02-16T10:30:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a18de4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a18de4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644129a0fc0 con 0x564412a8f4b0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a168ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a168ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46632/0 (socket says 172.21.15.138:46632) 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a168ff640 1 -- 172.21.15.138:0/1282092401 learned_addr learned my addr 172.21.15.138:0/1282092401 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a168ff640 1 -- 172.21.15.138:0/1282092401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c005d30 con 0x564412a8f4b0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.328+0000 7f8a168ff640 1 --2- 172.21.15.138:0/1282092401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8a08001c00 tx=0x7f8a0800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5161cad29149e8a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8904e09640 1 -- 172.21.15.138:0/1282092401 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0800e690 con 0x564412a8f4b0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8904e09640 1 -- 172.21.15.138:0/1282092401 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800e810 con 0x564412a8f4b0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8904e09640 1 -- 172.21.15.138:0/1282092401 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0800eb30 con 0x564412a8f4b0 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/1282092401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 msgr2=0x564412a03e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1282092401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8a08001c00 tx=0x7f8a0800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/1282092401 shutdown_connections 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1282092401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412a03e30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/1282092401 >> 172.21.15.138:0/1282092401 conn(0x564412a8ad80 msgr2=0x564412b75130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/1282092401 shutdown_connections 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/1282092401 wait complete. 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56441299c7a0 con 0x564412a8f4b0 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a168ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a168ff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46638/0 (socket says 172.21.15.138:46638) 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a168ff640 1 -- 172.21.15.138:0/4168181677 learned_addr learned my addr 172.21.15.138:0/4168181677 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a168ff640 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644129dcb60 con 0x564412a8f4b0 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b710 tx=0x7f8a08000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8903606640 1 -- 172.21.15.138:0/4168181677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0801f070 con 0x564412a8f4b0 2024-02-16T10:30:53.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8903606640 1 -- 172.21.15.138:0/4168181677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0801a910 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564412b83d50 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8903606640 1 -- 172.21.15.138:0/4168181677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0801abf0 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.332+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564412b84200 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8903606640 1 -- 172.21.15.138:0/4168181677 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a0800a040 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8903606640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 0x7f88fc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8903606640 1 -- 172.21.15.138:0/4168181677 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8a0804a010 con 0x564412a8f4b0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 0x7f88fc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 0x564412b8a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412b8aa40 con 0x564412a93a10 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 0x564412b8a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 0x7f88fc0367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0ad000 tx=0x7f8a0c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 0x564412b8a500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 -- 172.21.15.138:0/4168181677 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412b8ae50 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 -- 172.21.15.138:0/4168181677 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412b8c700 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 -- 172.21.15.138:0/4168181677 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412b8b900 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a17100640 1 -- 172.21.15.138:0/4168181677 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412a93a10 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 0x564412b8fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412b900d0 con 0x564412b8c220 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 0x564412b8fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 0x564412b8fa80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.336+0000 7f8a168ff640 1 -- 172.21.15.138:0/4168181677 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8a08024cd0 con 0x564412b8c220 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412934f20 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46644/0 (socket says 172.21.15.138:46644) 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a17100640 1 -- 172.21.15.138:0/1490580842 learned_addr learned my addr 172.21.15.138:0/1490580842 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a17100640 1 -- 172.21.15.138:0/1490580842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412b9e950 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a17100640 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x564412b843b0 tx=0x7f8a10018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 -- 172.21.15.138:0/1490580842 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1001d070 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 -- 172.21.15.138:0/1490580842 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10014450 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564412b9eba0 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 -- 172.21.15.138:0/1490580842 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a100146f0 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564412b9f6f0 con 0x564412b9dff0 2024-02-16T10:30:53.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 -- 172.21.15.138:0/1490580842 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a10020020 con 0x564412b9dff0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 0x7f88f0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8900e01640 1 -- 172.21.15.138:0/1490580842 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8a1004b0d0 con 0x564412b9dff0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a168ff640 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 0x7f88f0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a168ff640 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 0x7f88f0036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x564412b8b340 tx=0x7f8a0800df70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.340+0000 7f8a18de4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412928790 con 0x564412baaf90 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46658/0 (socket says 172.21.15.138:46658) 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 -- 172.21.15.138:0/1859599026 learned_addr learned my addr 172.21.15.138:0/1859599026 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 -- 172.21.15.138:0/1859599026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412bab980 con 0x564412baaf90 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- 172.21.15.138:0/1859599026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8a100494c0 tx=0x7f8a100480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe56974fd48b35f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88fa7fc640 1 -- 172.21.15.138:0/1859599026 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1003b050 con 0x564412baaf90 2024-02-16T10:30:53.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88fa7fc640 1 -- 172.21.15.138:0/1859599026 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1003b1b0 con 0x564412baaf90 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88fa7fc640 1 -- 172.21.15.138:0/1859599026 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a10012690 con 0x564412baaf90 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/1859599026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 msgr2=0x564412bab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1859599026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8a100494c0 tx=0x7f8a100480e0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/1859599026 shutdown_connections 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1859599026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bab3b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/1859599026 >> 172.21.15.138:0/1859599026 conn(0x564412ba5b10 msgr2=0x564412ba69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/1859599026 shutdown_connections 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/1859599026 wait complete. 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 Processor -- start 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- start start 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x564412bb2220 con 0x564412baaf90 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46662/0 (socket says 172.21.15.138:46662) 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 learned_addr learned my addr 172.21.15.138:0/4042941682 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564412b9f6f0 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a17100640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8a10048120 tx=0x7f8a10049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88f8ff9640 1 -- 172.21.15.138:0/4042941682 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1003b050 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564412bb2420 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564412bb2850 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88f8ff9640 1 -- 172.21.15.138:0/4042941682 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1002b720 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.344+0000 7f88f8ff9640 1 -- 172.21.15.138:0/4042941682 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1002be60 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f88f8ff9640 1 -- 172.21.15.138:0/4042941682 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f8a10049600 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f88f8ff9640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88e0034260 0x7f88e0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f88f8ff9640 1 -- 172.21.15.138:0/4042941682 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f8a1004cc90 con 0x564412baaf90 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88e0034260 0x7f88e0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412bbd400 0x564412bbf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc0010 con 0x564412bbd400 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412bbd400 0x564412bbf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88e0034260 0x7f88e0036720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a0801ade0 tx=0x7f8a08044000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412bbd400 0x564412bbf8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 realm 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc0400 con 0x564412bbd400 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc0c80 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc0fe0 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc17e0 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 20 searching for the correct realm 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564412bc3690 0x564412bc5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a17100640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564412bc3690 0x564412bc5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.348+0000 7f8a17100640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564412bc3690 0x564412bc5b50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a17100640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8a10014850 0x7f8a10023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a10014850 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8a10014850 0x7f8a10023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8a10014850 0x7f8a10023420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a168ff640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8a0803a040 0x7f8a0800d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8a0803a040 0x7f8a0800d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8a0803a040 0x7f8a0800d3e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.352+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a10014850 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a10014850 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.356+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a10014850 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a10014850 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.360+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bc3690 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x7f8a0803a040 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6220 con 0x564412bbd400 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8a0c0da080 con 0x7f8a10014850 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc2110 con 0x564412bbd400 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc2960 con 0x564412bbd400 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc2960 con 0x7f8a10014850 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 zone default found 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 4 Realm: () 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 zonegroup default 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc6660 con 0x7f8a0803a040 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc83f0 con 0x564412bc3690 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc87a0 con 0x564412bc3690 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8a1000a4d0 con 0x564412bc3690 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 started sync module instance, tier type = 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.364+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc7880 con 0x7f8a10014850 2024-02-16T10:30:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94850372105184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc8080 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc9250 con 0x564412bbd400 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94850372105184] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94850372111664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc9600 con 0x564412bbd400 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.368+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc9f70 con 0x564412bc3690 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94850372111664] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94850372107232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc9f70 con 0x564412bc3690 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bca970 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94850372117648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcb1c0 con 0x7f8a10014850 2024-02-16T10:30:53.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcbbb0 con 0x564412bbd400 2024-02-16T10:30:53.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94850372107232] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.372+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94850372117648] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94850372119840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc9ad0 con 0x564412bbd400 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcc400 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94850372119840] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94850372122256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcc360 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.376+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcccd0 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94850372122256] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94850372126768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcd0f0 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcbf00 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94850372126768] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94850372127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcd070 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=0 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=1 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=2 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=3 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=4 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=5 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.380+0000 7f8a18de4980 20 add_watcher() i=6 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94850372127824] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 20 add_watcher() i=7 2024-02-16T10:30:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd0b10 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94850372130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcdf40 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94850372130368] v31'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f88cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.384+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd8fd0 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd9470 con 0x7f8a0803a040 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd9910 con 0x564412bc3690 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd7050 con 0x564412bbd400 2024-02-16T10:30:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.388+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.392+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd7050 con 0x7f8a10014850 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.392+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.392+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdaaf0 con 0x564412bc3690 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.392+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.392+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd6040 con 0x564412bbd400 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd6630 con 0x7f8a0803a040 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd6630 con 0x7f8a10014850 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.396+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdb660 con 0x564412bc3690 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.400+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.400+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbb00 con 0x7f8a10014850 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.400+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.400+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbcd0 con 0x7f8a0803a040 2024-02-16T10:30:53.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbcd0 con 0x7f8a10014850 2024-02-16T10:30:53.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbcd0 con 0x7f8a0803a040 2024-02-16T10:30:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.404+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbcd0 con 0x564412bbd400 2024-02-16T10:30:53.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdbcd0 con 0x564412bc3690 2024-02-16T10:30:53.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc200 con 0x7f8a10014850 2024-02-16T10:30:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.408+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc200 con 0x564412bc3690 2024-02-16T10:30:53.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bbd400 2024-02-16T10:30:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bbd400 2024-02-16T10:30:53.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.412+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x7f8a10014850 2024-02-16T10:30:53.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.416+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.420+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x7f8a0803a040 2024-02-16T10:30:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.424+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.424+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.424+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.424+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x7f8a0803a040 2024-02-16T10:30:53.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.428+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.428+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x564412bc3690 2024-02-16T10:30:53.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.428+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.428+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x7f8a0803a040 2024-02-16T10:30:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.432+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'33 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.432+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bdc3c0 con 0x7f8a10014850 2024-02-16T10:30:53.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.432+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8847fff640 20 reqs_thread_entry: start 2024-02-16T10:30:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:53.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 20 Filter name: none 2024-02-16T10:30:53.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8845ffb640 20 reqs_thread_entry: start 2024-02-16T10:30:53.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-02-16T10:30:53.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd8700 con 0x7f8a0803a040 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~386 out=386b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+509 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 20 rados_obj.operate() r=0 bl.length=386 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x564412bbd400 2024-02-16T10:30:53.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94850372174064 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x564412bc3690 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== watch-notify(notify (1) cookie 94850372107232 notify 133143986181 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x564412bb2850 con 0x564412bc3690 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f88fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94850372107232 notifier 4563 bl.length()=170 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(96 notify.2 [notify cookie 94850372174064 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f88fa7fc640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f88dc003d60 con 0x564412bc3690 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== watch-notify(notify_complete (2) cookie 94850372174064 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564412bb2420 con 0x564412bc3690 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x7f8a0803a040 2024-02-16T10:30:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.436+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a18de4980 10 removing email index: 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a18de4980 10 removing user buckets index 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a18de4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94850372174064 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== watch-notify(notify (1) cookie 94850372119840 notify 133143986194 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x564412a97350 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f88f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94850372119840 notifier 4563 bl.length()=175 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(99 notify.4 [notify cookie 94850372174064 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f88f9ffb640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f884c0032c0 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== watch-notify(notify_complete (2) cookie 94850372174064 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8a0c0d0920 con 0x564412bbd400 2024-02-16T10:30:53.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.440+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x564412bbd400 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v31'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a18de4980 10 removing user index: testx$tenanteduser 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a18de4980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a18de4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94850372174064 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== watch-notify(notify (1) cookie 94850372117648 notify 133143986191 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x564412b84200 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(102 notify.3 [notify cookie 94850372174064 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f88fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94850372117648 notifier 4563 bl.length()=167 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f88fa7fc640 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f88dc003d60 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== watch-notify(notify_complete (2) cookie 94850372174064 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564412b83d50 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd4ed0 con 0x7f8a0803a040 2024-02-16T10:30:53.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.444+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f88cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94850372130368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bd8090 con 0x564412bbd400 2024-02-16T10:30:53.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94850372130368] v31'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94850372105184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcd640 con 0x7f8a10014850 2024-02-16T10:30:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94850372105184] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a18de4980 20 remove_watcher() i=0 2024-02-16T10:30:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a18de4980 2 removed watcher, disabling cache 2024-02-16T10:30:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.448+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94850372111664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc73e0 con 0x564412bbd400 2024-02-16T10:30:53.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94850372111664] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a18de4980 20 remove_watcher() i=1 2024-02-16T10:30:53.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94850372107232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc73e0 con 0x564412bc3690 2024-02-16T10:30:53.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a17100640 1 -- 172.21.15.138:0/4042941682 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94850372107232] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a10072040 con 0x564412bc3690 2024-02-16T10:30:53.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a18de4980 20 remove_watcher() i=2 2024-02-16T10:30:53.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.452+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94850372117648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc7be0 con 0x7f8a10014850 2024-02-16T10:30:53.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a168ff640 1 -- 172.21.15.138:0/4042941682 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94850372117648] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a08024cd0 con 0x7f8a10014850 2024-02-16T10:30:53.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 20 remove_watcher() i=3 2024-02-16T10:30:53.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94850372119840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc73e0 con 0x564412bbd400 2024-02-16T10:30:53.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94850372119840] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x564412bbd400 2024-02-16T10:30:53.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 20 remove_watcher() i=4 2024-02-16T10:30:53.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94850372122256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc7be0 con 0x7f8a0803a040 2024-02-16T10:30:53.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94850372122256] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 20 remove_watcher() i=5 2024-02-16T10:30:53.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.456+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94850372126768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bcad20 con 0x7f8a0803a040 2024-02-16T10:30:53.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.460+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94850372126768] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.460+0000 7f8a18de4980 20 remove_watcher() i=6 2024-02-16T10:30:53.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.460+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94850372127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564412bc73e0 con 0x7f8a0803a040 2024-02-16T10:30:53.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.460+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94850372127824] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8a0c0ab810 con 0x7f8a0803a040 2024-02-16T10:30:53.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.460+0000 7f8a18de4980 20 remove_watcher() i=7 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8a0803a040 msgr2=0x7f8a0800d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f8a0803a040 0x7f8a0800d3e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412bbd400 msgr2=0x564412bbf8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412bbd400 0x564412bbf8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8a10014850 msgr2=0x7f8a10023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f8a10014850 0x7f8a10023420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564412bc3690 msgr2=0x564412bc5b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x564412bc3690 0x564412bc5b50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88e0034260 msgr2=0x7f88e0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88e0034260 0x7f88e0036720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a0801ade0 tx=0x7f8a08044000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 msgr2=0x564412bb1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8a10048120 tx=0x7f8a10049450 comp rx=0 tx=0).stop 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a160fe640 1 -- 172.21.15.138:0/4042941682 reap_dead start 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 shutdown_connections 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4042941682 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412baaf90 0x564412bb1ce0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 >> 172.21.15.138:0/4042941682 conn(0x564412ba5b10 msgr2=0x564412ba69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 shutdown_connections 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4042941682 wait complete. 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 msgr2=0x7f88f0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 0x7f88f0036770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x564412b8b340 tx=0x7f8a0800df70 comp rx=0 tx=0).stop 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 msgr2=0x564412b9e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x564412b843b0 tx=0x7f8a10018a60 comp rx=0 tx=0).stop 2024-02-16T10:30:53.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 shutdown_connections 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88f00342b0 0x7f88f0036770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/1490580842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412b9dff0 0x564412b9e410 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 >> 172.21.15.138:0/1490580842 conn(0x564412b92e00 msgr2=0x564412b93910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 shutdown_connections 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/1490580842 wait complete. 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 msgr2=0x564412b8a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 0x564412b8a500 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 msgr2=0x564412b8fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 0x564412b8fa80 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 msgr2=0x7f88fc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 0x7f88fc0367c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0ad000 tx=0x7f8a0c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 msgr2=0x564412b83810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b710 tx=0x7f8a08000bd0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 shutdown_connections 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x564412b8c220 0x564412b8fa80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x564412a93a10 0x564412b8a500 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f88fc034300 0x7f88fc0367c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 --2- 172.21.15.138:0/4168181677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564412a8f4b0 0x564412b83810 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 >> 172.21.15.138:0/4168181677 conn(0x564412a8ad80 msgr2=0x564412b73c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 shutdown_connections 2024-02-16T10:30:53.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.464+0000 7f8a18de4980 1 -- 172.21.15.138:0/4168181677 wait complete. 2024-02-16T10:30:53.489 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T10:30:53.493 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-02-16T10:30:53.536 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:30:53.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T10:30:53.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-02-16T10:30:53.537 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-02-16T10:30:53.573 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:53.574 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:53.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc00774c980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55bca12eb630 0x55bca12eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc00774c980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bca1237b60 con 0x55bca12ebf50 2024-02-16T10:30:53.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc00774c980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bca11fed30 con 0x55bca12eb630 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc005267640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55bca12eb630 0x55bca12eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc005267640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55bca12eb630 0x55bca12eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46668/0 (socket says 172.21.15.138:46668) 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc005267640 1 -- 172.21.15.138:0/3132233173 learned_addr learned my addr 172.21.15.138:0/3132233173 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc004a66640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55bca12ebf50 0x55bca12ec8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52314/0 (socket says 172.21.15.138:52314) 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc005267640 1 -- 172.21.15.138:0/3132233173 >> v1:172.21.15.107:6789/0 conn(0x55bca12ebf50 legacy=0x55bca12ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.568+0000 7fc005267640 1 -- 172.21.15.138:0/3132233173 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca12ed0f0 con 0x55bca12eb630 2024-02-16T10:30:53.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc005267640 1 --2- 172.21.15.138:0/3132233173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca12eba10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a5c0 tx=0x7fbff801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803552f7d8e0f118 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fbffffff640 1 -- 172.21.15.138:0/3132233173 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80aa470 con 0x55bca12eb630 2024-02-16T10:30:53.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fbffffff640 1 -- 172.21.15.138:0/3132233173 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80aa5d0 con 0x55bca12eb630 2024-02-16T10:30:53.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fbffffff640 1 -- 172.21.15.138:0/3132233173 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80aa890 con 0x55bca12eb630 2024-02-16T10:30:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 -- 172.21.15.138:0/3132233173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 msgr2=0x55bca12eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 --2- 172.21.15.138:0/3132233173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca12eba10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a5c0 tx=0x7fbff801b340 comp rx=0 tx=0).stop 2024-02-16T10:30:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 -- 172.21.15.138:0/3132233173 shutdown_connections 2024-02-16T10:30:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 --2- 172.21.15.138:0/3132233173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca12eba10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 -- 172.21.15.138:0/3132233173 >> 172.21.15.138:0/3132233173 conn(0x55bca12e6f00 msgr2=0x55bca12e9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 -- 172.21.15.138:0/3132233173 shutdown_connections 2024-02-16T10:30:53.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.572+0000 7fc00774c980 1 -- 172.21.15.138:0/3132233173 wait complete. 2024-02-16T10:30:53.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc00774c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc00774c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca11fbfc0 con 0x55bca12eb630 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc005267640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc005267640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46674/0 (socket says 172.21.15.138:46674) 2024-02-16T10:30:53.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc005267640 1 -- 172.21.15.138:0/1685669655 learned_addr learned my addr 172.21.15.138:0/1685669655 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc005267640 1 -- 172.21.15.138:0/1685669655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8005df0 con 0x55bca12eb630 2024-02-16T10:30:53.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fc005267640 1 --2- 172.21.15.138:0/1685669655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbff8017f50 tx=0x7fbff8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144719e13ecc3623 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.584+0000 7fbef3606640 1 -- 172.21.15.138:0/1685669655 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80aa9c0 con 0x55bca12eb630 2024-02-16T10:30:53.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fbef3606640 1 -- 172.21.15.138:0/1685669655 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80aab40 con 0x55bca12eb630 2024-02-16T10:30:53.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fbef3606640 1 -- 172.21.15.138:0/1685669655 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80aae20 con 0x55bca12eb630 2024-02-16T10:30:53.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/1685669655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 msgr2=0x55bca13d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 --2- 172.21.15.138:0/1685669655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbff8017f50 tx=0x7fbff8003030 comp rx=0 tx=0).stop 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/1685669655 shutdown_connections 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 --2- 172.21.15.138:0/1685669655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13d5be0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/1685669655 >> 172.21.15.138:0/1685669655 conn(0x55bca12e6f00 msgr2=0x55bca13d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/1685669655 shutdown_connections 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/1685669655 wait complete. 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca11f77a0 con 0x55bca12eb630 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc005267640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc005267640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46676/0 (socket says 172.21.15.138:46676) 2024-02-16T10:30:53.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc005267640 1 -- 172.21.15.138:0/627850826 learned_addr learned my addr 172.21.15.138:0/627850826 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc005267640 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca12ed0f0 con 0x55bca12eb630 2024-02-16T10:30:53.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc005267640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbff8000c10 tx=0x7fbff80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fbef1e03640 1 -- 172.21.15.138:0/627850826 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80be790 con 0x55bca12eb630 2024-02-16T10:30:53.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bca13dcf70 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fbef1e03640 1 -- 172.21.15.138:0/627850826 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80be8f0 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bca13dd3c0 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.588+0000 7fbef1e03640 1 -- 172.21.15.138:0/627850826 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80beb90 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fbef1e03640 1 -- 172.21.15.138:0/627850826 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbff80becf0 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fbef1e03640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 0x7fbeec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fbef1e03640 1 -- 172.21.15.138:0/627850826 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbff80c5070 con 0x55bca12eb630 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc004a66640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 0x7fbeec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 0x55bca13e3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e3c60 con 0x55bca12ebf50 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 0x55bca13e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc004a66640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 0x7fbeec036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbff00012f0 tx=0x7fbff0006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 0x55bca13e3720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 -- 172.21.15.138:0/627850826 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc0000083f0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e4020 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 -- 172.21.15.138:0/627850826 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc0000083f0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e58d0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 -- 172.21.15.138:0/627850826 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fc0000083f0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e4ad0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 -- 172.21.15.138:0/627850826 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc0000083f0 con 0x55bca12ebf50 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 0x55bca13e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e92a0 con 0x55bca13e53f0 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005267640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 0x55bca13e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005267640 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 0x55bca13e8c50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005267640 1 -- 172.21.15.138:0/627850826 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbff80cf070 con 0x55bca13e53f0 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc00774c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca118ff20 con 0x55bca13f7260 2024-02-16T10:30:53.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46686/0 (socket says 172.21.15.138:46686) 2024-02-16T10:30:53.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.592+0000 7fc005a68640 1 -- 172.21.15.138:0/1915815549 learned_addr learned my addr 172.21.15.138:0/1915815549 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 -- 172.21.15.138:0/1915815549 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca13f7bc0 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55bca13dde60 tx=0x7fc00000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 -- 172.21.15.138:0/1915815549 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc00000f040 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 -- 172.21.15.138:0/1915815549 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000019550 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bca13f7e10 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 -- 172.21.15.138:0/1915815549 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0000197f0 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bca13f8960 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 -- 172.21.15.138:0/1915815549 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc000019950 con 0x55bca13f7260 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 0x7fbedc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fbeeaffd640 1 -- 172.21.15.138:0/1915815549 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc00004b880 con 0x55bca13f7260 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005267640 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 0x7fbedc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005267640 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 0x7fbedc036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55bca13e4510 tx=0x7fbff8006820 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc00774c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca1183790 con 0x55bca1404150 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46690/0 (socket says 172.21.15.138:46690) 2024-02-16T10:30:53.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 -- 172.21.15.138:0/1936135830 learned_addr learned my addr 172.21.15.138:0/1936135830 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 -- 172.21.15.138:0/1936135830 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca1404b40 con 0x55bca1404150 2024-02-16T10:30:53.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.596+0000 7fc005a68640 1 --2- 172.21.15.138:0/1936135830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc0000056e0 tx=0x7fc000049cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdbc36e02892c9e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbee8ff9640 1 -- 172.21.15.138:0/1936135830 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0000225d0 con 0x55bca1404150 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbee8ff9640 1 -- 172.21.15.138:0/1936135830 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000007380 con 0x55bca1404150 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbee8ff9640 1 -- 172.21.15.138:0/1936135830 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc000007c50 con 0x55bca1404150 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/1936135830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 msgr2=0x55bca1404570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 --2- 172.21.15.138:0/1936135830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc0000056e0 tx=0x7fc000049cf0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/1936135830 shutdown_connections 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 --2- 172.21.15.138:0/1936135830 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca1404570 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/1936135830 >> 172.21.15.138:0/1936135830 conn(0x55bca13fed20 msgr2=0x55bca13ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/1936135830 shutdown_connections 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/1936135830 wait complete. 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 Processor -- start 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- start start 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bca140b3e0 con 0x55bca1404150 2024-02-16T10:30:53.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005a68640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46704/0 (socket says 172.21.15.138:46704) 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 learned_addr learned my addr 172.21.15.138:0/444988436 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bca13f8960 con 0x55bca1404150 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005a68640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc000022fd0 tx=0x7fc000049b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 -- 172.21.15.138:0/444988436 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc000033070 con 0x55bca1404150 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bca140b5e0 con 0x55bca1404150 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 -- 172.21.15.138:0/444988436 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0000074f0 con 0x55bca1404150 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 -- 172.21.15.138:0/444988436 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc00004bb60 con 0x55bca1404150 2024-02-16T10:30:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bca140ba10 con 0x55bca1404150 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 -- 172.21.15.138:0/444988436 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc00004bcc0 con 0x55bca1404150 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbed00342b0 0x7fbed0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fbedaffd640 1 -- 172.21.15.138:0/444988436 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fc000039c80 con 0x55bca1404150 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.600+0000 7fc005267640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbed00342b0 0x7fbed0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca14165b0 0x55bca1418a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14191a0 con 0x55bca14165b0 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca14165b0 0x55bca1418a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbed00342b0 0x7fbed0036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbff80d2000 tx=0x7fbff80e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca14165b0 0x55bca1418a50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 realm 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1415ad0 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1419c20 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141a110 con 0x55bca14165b0 2024-02-16T10:30:53.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141a9b0 con 0x55bca14165b0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 20 searching for the correct realm 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55bca141c900 0x55bca141ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005a68640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55bca141c900 0x55bca141ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005a68640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55bca141c900 0x55bca141ed90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc000041070 con 0x55bca141c900 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005a68640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc000044050 0x7fc00002ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc000044050 0x7fc00002ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc000044050 0x7fc00002ba40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbff80be070 0x7fbff80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.604+0000 7fc004a66640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbff80be070 0x7fbff80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbff80be070 0x7fbff80c9420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc000041070 con 0x55bca141c900 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.608+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.612+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca141c900 2024-02-16T10:30:53.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fbff80be070 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x55bca14165b0 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f410 con 0x7fc000044050 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141b3d0 con 0x55bca14165b0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.616+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141bc20 con 0x55bca14165b0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141bc20 con 0x7fc000044050 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 zone default found 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 4 Realm: () 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 zonegroup default 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca141f850 con 0x7fbff80be070 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1421610 con 0x55bca141c900 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14219f0 con 0x55bca141c900 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 started sync module instance, tier type = 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1420ef0 con 0x7fc000044050 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94268647672400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14212a0 con 0x7fc000044050 2024-02-16T10:30:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1422750 con 0x55bca14165b0 2024-02-16T10:30:53.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.620+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94268647672400] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94268647677728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1422b00 con 0x55bca14165b0 2024-02-16T10:30:53.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1423470 con 0x55bca141c900 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94268647682000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1423430 con 0x55bca141c900 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14243c0 con 0x7fc000044050 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.624+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94268647677728] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94268647685808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1424770 con 0x7fc000044050 2024-02-16T10:30:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1425120 con 0x55bca14165b0 2024-02-16T10:30:53.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94268647685808] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94268647682000] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94268647684128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1424c40 con 0x55bca14165b0 2024-02-16T10:30:53.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.628+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1425970 con 0x7fbff80be070 2024-02-16T10:30:53.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94268647690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1425a50 con 0x7fbff80be070 2024-02-16T10:30:53.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14263c0 con 0x7fbff80be070 2024-02-16T10:30:53.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94268647684128] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94268647690640] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94268647691696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14224b0 con 0x7fbff80be070 2024-02-16T10:30:53.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.632+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1426860 con 0x7fbff80be070 2024-02-16T10:30:53.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94268647691696] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94268647694112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14267e0 con 0x7fbff80be070 2024-02-16T10:30:53.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=0 2024-02-16T10:30:53.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=1 2024-02-16T10:30:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=2 2024-02-16T10:30:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=3 2024-02-16T10:30:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=4 2024-02-16T10:30:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=5 2024-02-16T10:30:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=6 2024-02-16T10:30:53.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94268647694112] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 20 add_watcher() i=7 2024-02-16T10:30:53.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:53.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1429b00 con 0x55bca14165b0 2024-02-16T10:30:53.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.636+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94268647695536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1426d70 con 0x55bca14165b0 2024-02-16T10:30:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94268647695536] v31'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fbebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc00774c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:53.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc00774c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:53.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1432170 con 0x55bca14165b0 2024-02-16T10:30:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.640+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14321f0 con 0x7fbff80be070 2024-02-16T10:30:53.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1432820 con 0x55bca141c900 2024-02-16T10:30:53.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1432d50 con 0x55bca14165b0 2024-02-16T10:30:53.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1432d50 con 0x7fc000044050 2024-02-16T10:30:53.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.644+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1433280 con 0x55bca141c900 2024-02-16T10:30:53.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.648+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.648+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14337b0 con 0x55bca14165b0 2024-02-16T10:30:53.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.648+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.648+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1433840 con 0x7fbff80be070 2024-02-16T10:30:53.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14338d0 con 0x7fc000044050 2024-02-16T10:30:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1433e60 con 0x55bca141c900 2024-02-16T10:30:53.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.652+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1434390 con 0x7fc000044050 2024-02-16T10:30:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14348c0 con 0x7fbff80be070 2024-02-16T10:30:53.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14348c0 con 0x7fc000044050 2024-02-16T10:30:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.656+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1434a00 con 0x7fbff80be070 2024-02-16T10:30:53.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.660+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'34 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.660+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14301c0 con 0x55bca14165b0 2024-02-16T10:30:53.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.660+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.660+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1431970 con 0x55bca141c900 2024-02-16T10:30:53.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1431970 con 0x7fc000044050 2024-02-16T10:30:53.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1431970 con 0x55bca141c900 2024-02-16T10:30:53.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.664+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1431970 con 0x55bca14165b0 2024-02-16T10:30:53.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.668+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.668+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca14165b0 2024-02-16T10:30:53.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.668+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.668+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x7fc000044050 2024-02-16T10:30:53.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.672+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.676+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x7fbff80be070 2024-02-16T10:30:53.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x7fbff80be070 2024-02-16T10:30:53.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.680+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1435190 con 0x55bca141c900 2024-02-16T10:30:53.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.684+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.684+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1431970 con 0x7fbff80be070 2024-02-16T10:30:53.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.684+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'35 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.684+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca142fd20 con 0x7fc000044050 2024-02-16T10:30:53.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fbebafe5640 20 reqs_thread_entry: start 2024-02-16T10:30:53.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:53.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 Filter name: none 2024-02-16T10:30:53.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fbeb8fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:53.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:53.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca13e08b0 con 0x7fc000044050 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14507a0 con 0x55bca14165b0 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(95 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 get_obj_state: octx=0x7fbff80d30f0 obj=myfoo:four state=0x55bca1451488 s->prefetch_data=0 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:96 3.7s0 3:e1e36dc8:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1452580 con 0x55bca141c900 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(96 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 10 manifest: total_size = 4 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.17609752537966113187 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 get_obj_state: octx=0x7fbff80d30f0 obj=myfoo:four state=0x55bca1451488 s->prefetch_data=0 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 prepare_atomic_modification: state is not atomic. state=0x55bca1451488 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.688+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:97 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1456fb0 con 0x7fc000044050 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.692+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(97 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [stat,call,call] v31'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.692+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 3.7s0 3:e1e36dc8:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca1456fb0 con 0x55bca141c900 2024-02-16T10:30:53.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.692+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(98 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1_four [call] v31'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.692+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:99 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fc000044050 2024-02-16T10:30:53.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fbebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94268647695536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x55bca14165b0 2024-02-16T10:30:53.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(99 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [stat,call,call] v31'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fbee8ff9640 20 handle_completion(): completion ok for obj=four 2024-02-16T10:30:53.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94268647695536] v31'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94268647672400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fc000044050 2024-02-16T10:30:53.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94268647672400] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc00774c980 20 remove_watcher() i=0 2024-02-16T10:30:53.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc00774c980 2 removed watcher, disabling cache 2024-02-16T10:30:53.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.696+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94268647677728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x55bca14165b0 2024-02-16T10:30:53.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94268647677728] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 20 remove_watcher() i=1 2024-02-16T10:30:53.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94268647682000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x55bca141c900 2024-02-16T10:30:53.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc005a68640 1 -- 172.21.15.138:0/444988436 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94268647682000] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc00005f040 con 0x55bca141c900 2024-02-16T10:30:53.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 20 remove_watcher() i=2 2024-02-16T10:30:53.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94268647685808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fc000044050 2024-02-16T10:30:53.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc005267640 1 -- 172.21.15.138:0/444988436 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94268647685808] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff80cf070 con 0x7fc000044050 2024-02-16T10:30:53.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 20 remove_watcher() i=3 2024-02-16T10:30:53.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.700+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94268647684128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x55bca14165b0 2024-02-16T10:30:53.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94268647684128] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x55bca14165b0 2024-02-16T10:30:53.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc00774c980 20 remove_watcher() i=4 2024-02-16T10:30:53.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94268647690640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fbff80be070 2024-02-16T10:30:53.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94268647690640] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc00774c980 20 remove_watcher() i=5 2024-02-16T10:30:53.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.704+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94268647691696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fbff80be070 2024-02-16T10:30:53.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.708+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94268647691696] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.708+0000 7fc00774c980 20 remove_watcher() i=6 2024-02-16T10:30:53.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.708+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94268647694112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55bca14573f0 con 0x7fbff80be070 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.708+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94268647694112] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0003460 con 0x7fbff80be070 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.708+0000 7fc00774c980 20 remove_watcher() i=7 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbff80be070 msgr2=0x7fbff80c9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbff80be070 0x7fbff80c9420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca14165b0 msgr2=0x55bca1418a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca14165b0 0x55bca1418a50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc000044050 msgr2=0x7fc00002ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fc000044050 0x7fc00002ba40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55bca141c900 msgr2=0x55bca141ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55bca141c900 0x55bca141ed90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbed00342b0 msgr2=0x7fbed0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbed00342b0 0x7fbed0036770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbff80d2000 tx=0x7fbff80e0000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 msgr2=0x55bca140aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc004a66640 1 -- 172.21.15.138:0/444988436 reap_dead start 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc000022fd0 tx=0x7fc000049b40 comp rx=0 tx=0).stop 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 shutdown_connections 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/444988436 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca1404150 0x55bca140aea0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 >> 172.21.15.138:0/444988436 conn(0x55bca13fed20 msgr2=0x55bca13ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 shutdown_connections 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/444988436 wait complete. 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 msgr2=0x7fbedc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 0x7fbedc036770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55bca13e4510 tx=0x7fbff8006820 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 msgr2=0x55bca13f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55bca13dde60 tx=0x7fc00000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 shutdown_connections 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbedc0342b0 0x7fbedc036770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/1915815549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca13f7260 0x55bca13f7680 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 >> 172.21.15.138:0/1915815549 conn(0x55bca13ec070 msgr2=0x55bca13ecb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 shutdown_connections 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/1915815549 wait complete. 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 msgr2=0x55bca13e3720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 0x55bca13e3720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 msgr2=0x55bca13e8c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 0x55bca13e8c50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 msgr2=0x7fbeec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 0x7fbeec036770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbff00012f0 tx=0x7fbff0006700 comp rx=0 tx=0).stop 2024-02-16T10:30:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 msgr2=0x55bca13dca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbff8000c10 tx=0x7fbff80180e0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 shutdown_connections 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55bca13e53f0 0x55bca13e8c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55bca12ebf50 0x55bca13e3720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbeec0342b0 0x7fbeec036770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 --2- 172.21.15.138:0/627850826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bca12eb630 0x55bca13dca30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 >> 172.21.15.138:0/627850826 conn(0x55bca12e6f00 msgr2=0x55bca13d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 shutdown_connections 2024-02-16T10:30:53.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.712+0000 7fc00774c980 1 -- 172.21.15.138:0/627850826 wait complete. 2024-02-16T10:30:53.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:53.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-02-16T10:30:53.729 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-02-16T10:30:53.803 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:53.803 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:53.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c90f5980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55710fa5b750 0x55710faea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c90f5980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55710fa33b50 con 0x55710faea790 2024-02-16T10:30:53.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c90f5980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55710f9fad30 con 0x55710fa5b750 2024-02-16T10:30:53.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c6c10640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55710fa5b750 0x55710faea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c6c10640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55710fa5b750 0x55710faea250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46706/0 (socket says 172.21.15.138:46706) 2024-02-16T10:30:53.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c6c10640 1 -- 172.21.15.138:0/3544033585 learned_addr learned my addr 172.21.15.138:0/3544033585 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c640f640 1 --1- 172.21.15.138:0/3544033585 >> v1:172.21.15.107:6789/0 conn(0x55710faea790 0x55710faecb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52316/0 (socket says 172.21.15.138:52316) 2024-02-16T10:30:53.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c6c10640 1 -- 172.21.15.138:0/3544033585 >> v1:172.21.15.107:6789/0 conn(0x55710faea790 legacy=0x55710faecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.796+0000 7ff6c6c10640 1 -- 172.21.15.138:0/3544033585 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55710faef370 con 0x55710fa5b750 2024-02-16T10:30:53.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/3544033585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710faea250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000a4e0 tx=0x7ff6c001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c1e67c2300cb0f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c5c0e640 1 -- 172.21.15.138:0/3544033585 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00aa540 con 0x55710fa5b750 2024-02-16T10:30:53.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c5c0e640 1 -- 172.21.15.138:0/3544033585 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00a6070 con 0x55710fa5b750 2024-02-16T10:30:53.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c5c0e640 1 -- 172.21.15.138:0/3544033585 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00aa850 con 0x55710fa5b750 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3544033585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 msgr2=0x55710faea250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3544033585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710faea250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000a4e0 tx=0x7ff6c001b090 comp rx=0 tx=0).stop 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3544033585 shutdown_connections 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3544033585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710faea250 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3544033585 >> 172.21.15.138:0/3544033585 conn(0x55710fae1d70 msgr2=0x55710fae4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3544033585 shutdown_connections 2024-02-16T10:30:53.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.800+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3544033585 wait complete. 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710f9f7fc0 con 0x55710fa5b750 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c6c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c6c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46718/0 (socket says 172.21.15.138:46718) 2024-02-16T10:30:53.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c6c10640 1 -- 172.21.15.138:0/1662707521 learned_addr learned my addr 172.21.15.138:0/1662707521 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c6c10640 1 -- 172.21.15.138:0/1662707521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c000a1c0 con 0x55710fa5b750 2024-02-16T10:30:53.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/1662707521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0019740 tx=0x7ff6c00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88413aecc43bc94 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff5b4e09640 1 -- 172.21.15.138:0/1662707521 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00aa6f0 con 0x55710fa5b750 2024-02-16T10:30:53.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff5b4e09640 1 -- 172.21.15.138:0/1662707521 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00aa850 con 0x55710fa5b750 2024-02-16T10:30:53.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff5b4e09640 1 -- 172.21.15.138:0/1662707521 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00aaaf0 con 0x55710fa5b750 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1662707521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 msgr2=0x55710fbd16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1662707521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0019740 tx=0x7ff6c00033b0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1662707521 shutdown_connections 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1662707521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd16b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1662707521 >> 172.21.15.138:0/1662707521 conn(0x55710fae1d70 msgr2=0x55710fbcd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1662707521 shutdown_connections 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1662707521 wait complete. 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.816+0000 7ff6c90f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710f9f37a0 con 0x55710fa5b750 2024-02-16T10:30:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c6c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c6c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46734/0 (socket says 172.21.15.138:46734) 2024-02-16T10:30:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c6c10640 1 -- 172.21.15.138:0/1262028992 learned_addr learned my addr 172.21.15.138:0/1262028992 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c6c10640 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55710faef370 con 0x55710fa5b750 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0019740 tx=0x7ff6c0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 -- 172.21.15.138:0/1262028992 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00c4070 con 0x55710fa5b750 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55710fbd89a0 con 0x55710fa5b750 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 -- 172.21.15.138:0/1262028992 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0005030 con 0x55710fa5b750 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 -- 172.21.15.138:0/1262028992 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6c00052d0 con 0x55710fa5b750 2024-02-16T10:30:53.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55710fbd8e50 con 0x55710fa5b750 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 -- 172.21.15.138:0/1262028992 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff6c00a8070 con 0x55710fa5b750 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 0x7ff5ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff5b3606640 1 -- 172.21.15.138:0/1262028992 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff6c00e4110 con 0x55710fa5b750 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c640f640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 0x7ff5ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 0x55710fbdf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.820+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fbdf690 con 0x55710faea790 2024-02-16T10:30:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 0x55710fbdf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c640f640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 0x7ff5ac036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000f70 tx=0x7ff6b0001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 0x55710fbdf150 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/1262028992 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6b80083f0 con 0x55710faea790 2024-02-16T10:30:53.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fbdc860 con 0x55710faea790 2024-02-16T10:30:53.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/1262028992 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff6b80083f0 con 0x55710faea790 2024-02-16T10:30:53.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fbe13e0 con 0x55710faea790 2024-02-16T10:30:53.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/1262028992 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff6b80083f0 con 0x55710faea790 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fbe05e0 con 0x55710faea790 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/1262028992 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff6b80083f0 con 0x55710faea790 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 0x55710fbe4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fbe4db0 con 0x55710fbe0f00 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 0x55710fbe4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 0x55710fbe4760 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c6c10640 1 -- 172.21.15.138:0/1262028992 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff6c00b5c50 con 0x55710fbe0f00 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c90f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710f98bf20 con 0x55710fbf2cb0 2024-02-16T10:30:53.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46742/0 (socket says 172.21.15.138:46742) 2024-02-16T10:30:53.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/3405911395 learned_addr learned my addr 172.21.15.138:0/3405911395 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.824+0000 7ff6c7411640 1 -- 172.21.15.138:0/3405911395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55710fbf3610 con 0x55710fbf2cb0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55710fbd96b0 tx=0x7ff6b800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 -- 172.21.15.138:0/3405911395 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b800f040 con 0x55710fbf2cb0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55710fbf3860 con 0x55710fbf2cb0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 -- 172.21.15.138:0/3405911395 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8019550 con 0x55710fbf2cb0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 -- 172.21.15.138:0/3405911395 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b80197f0 con 0x55710fbf2cb0 2024-02-16T10:30:53.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55710fbf43b0 con 0x55710fbf2cb0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 -- 172.21.15.138:0/3405911395 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff6b80199a0 con 0x55710fbf2cb0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 0x7ff5a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5b0e01640 1 -- 172.21.15.138:0/3405911395 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff6b804b480 con 0x55710fbf2cb0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 0x7ff5a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 0x7ff5a0036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55710fbe0020 tx=0x7ff6c00e24d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c90f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710f97f790 con 0x55710fbffc90 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46752/0 (socket says 172.21.15.138:46752) 2024-02-16T10:30:53.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 -- 172.21.15.138:0/4073830010 learned_addr learned my addr 172.21.15.138:0/4073830010 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 -- 172.21.15.138:0/4073830010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55710fc00680 con 0x55710fbffc90 2024-02-16T10:30:53.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff6c7411640 1 --2- 172.21.15.138:0/4073830010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8019970 tx=0x7ff6b802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b565b7c5fc74387e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5aa7fc640 1 -- 172.21.15.138:0/4073830010 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8048070 con 0x55710fbffc90 2024-02-16T10:30:53.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5aa7fc640 1 -- 172.21.15.138:0/4073830010 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b80154d0 con 0x55710fbffc90 2024-02-16T10:30:53.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.828+0000 7ff5aa7fc640 1 -- 172.21.15.138:0/4073830010 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8015df0 con 0x55710fbffc90 2024-02-16T10:30:53.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/4073830010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 msgr2=0x55710fc000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/4073830010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8019970 tx=0x7ff6b802a410 comp rx=0 tx=0).stop 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/4073830010 shutdown_connections 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/4073830010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc000b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/4073830010 >> 172.21.15.138:0/4073830010 conn(0x55710fbfa810 msgr2=0x55710fbfb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/4073830010 shutdown_connections 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/4073830010 wait complete. 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 Processor -- start 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- start start 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710fc06f10 con 0x55710fbffc90 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c7411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46762/0 (socket says 172.21.15.138:46762) 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 learned_addr learned my addr 172.21.15.138:0/2687412902 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55710fbf43b0 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c7411640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff6b802a8d0 tx=0x7ff6b8049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 -- 172.21.15.138:0/2687412902 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8048070 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55710fc07110 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 -- 172.21.15.138:0/2687412902 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b80481d0 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 -- 172.21.15.138:0/2687412902 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8048340 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55710fc07540 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 -- 172.21.15.138:0/2687412902 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff6b8032020 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5900342b0 0x7ff590036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff5a8ff9640 1 -- 172.21.15.138:0/2687412902 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7ff6b80173b0 con 0x55710fbffc90 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5900342b0 0x7ff590036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710fc120f0 0x55710fc145b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc14d00 con 0x55710fc120f0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.832+0000 7ff6c640f640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710fc120f0 0x55710fc145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5900342b0 0x7ff590036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0000f90 tx=0x7ff6c00e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710fc120f0 0x55710fc145b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 realm 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc115d0 con 0x55710fc120f0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc15780 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc15c40 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc15400 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:53.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 20 searching for the correct realm 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55710fc17f80 0x55710fc1a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x55710fc17f80 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c7411640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55710fc17f80 0x55710fc1a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c7411640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55710fc17f80 0x55710fc1a410 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c7411640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff6b8022070 0x7ff6b802c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x7ff6b8022070 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff6b8022070 0x7ff6b802c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff6b8022070 0x7ff6b802c7e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff6c00e2680 0x7ff6c00e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x7ff6c00e2680 2024-02-16T10:30:53.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff6c00e2680 0x7ff6c00e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.836+0000 7ff6c640f640 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff6c00e2680 0x7ff6c00e2aa0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x55710fc120f0 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x55710fc120f0 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x7ff6c00e2680 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1aae0 con 0x7ff6c00e2680 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6b8022070 2024-02-16T10:30:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.840+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6b8022070 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6b8022070 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.844+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6b8022070 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc17f80 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6c00e2680 2024-02-16T10:30:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x55710fc120f0 2024-02-16T10:30:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.848+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff6b002d040 con 0x7ff6b8022070 2024-02-16T10:30:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc16b40 con 0x55710fc120f0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc167c0 con 0x55710fc120f0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc17410 con 0x7ff6b8022070 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 zone default found 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 4 Realm: () 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 zonegroup default 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1af20 con 0x7ff6c00e2680 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1cda0 con 0x55710fc17f80 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1d100 con 0x55710fc17f80 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 started sync module instance, tier type = 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1c370 con 0x7ff6b8022070 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93944084020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1d100 con 0x7ff6b8022070 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.852+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1da70 con 0x55710fc120f0 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.856+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93944084020944] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.856+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.856+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93944084026832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1d9f0 con 0x55710fc120f0 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.856+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1e7a0 con 0x55710fc17f80 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93944084030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1e6e0 con 0x55710fc17f80 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1f650 con 0x7ff6b8022070 2024-02-16T10:30:53.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93944084026832] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93944084033936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1f650 con 0x7ff6b8022070 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc20080 con 0x55710fc120f0 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93944084030144] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93944084033936] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93944084028960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1fba0 con 0x55710fc120f0 2024-02-16T10:30:53.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.860+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc208d0 con 0x7ff6c00e2680 2024-02-16T10:30:53.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.864+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93944084028960] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.864+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.864+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93944084032336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc205f0 con 0x7ff6c00e2680 2024-02-16T10:30:53.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.864+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc20df0 con 0x7ff6c00e2680 2024-02-16T10:30:53.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93944084039632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc21270 con 0x7ff6c00e2680 2024-02-16T10:30:53.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93944084032336] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc21d40 con 0x7ff6c00e2680 2024-02-16T10:30:53.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93944084039632] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93944084043808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc21d00 con 0x7ff6c00e2680 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=0 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=1 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=2 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=3 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=4 2024-02-16T10:30:53.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=5 2024-02-16T10:30:53.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.868+0000 7ff6c90f5980 20 add_watcher() i=6 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93944084043808] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 add_watcher() i=7 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc20c70 con 0x55710fc120f0 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93944084037968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc20c70 con 0x55710fc120f0 2024-02-16T10:30:53.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93944084037968] v31'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff57d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:53.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 5 note: GC not initialized 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff4f7fff640 20 reqs_thread_entry: start 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 Filter name: none 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff4f5ffb640 20 reqs_thread_entry: start 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc46c00 con 0x7ff6b8022070 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc471c0 con 0x55710fc120f0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(63 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc46280 con 0x7ff6b8022070 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.872+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc486e0 con 0x55710fc120f0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-02-16T10:30:53.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 4.21 4:84770a22:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc47d50 con 0x7ff6c00e2680 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 4.26 4:67063283:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc4d200 con 0x7ff6c00e2680 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 4.2a 4:54a76138:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc4fa60 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 4.2f 4:f5540289:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc4fa60 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 4.2f 4:f6dbaf5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc549d0 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 4.2f 4:f765b22e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc57300 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 4.a 4:530cb943:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc59d90 con 0x7ff6b8022070 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 4.32 4:4e4a0ab4:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc5c810 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:74 4.d 4:b229da45:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc5f630 con 0x55710fc17f80 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 4.c 4:32cbddb3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc620b0 con 0x55710fc120f0 2024-02-16T10:30:53.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 4.4 4:208ef0a8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc64ef0 con 0x7ff6c00e2680 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(68 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(70 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.4 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(71 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.5 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.6 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(67 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(66 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(76 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 20 rados->read ofs=0 len=0 2024-02-16T10:30:53.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.1d 6:bf22f782:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc64ef0 con 0x7ff6c00e2680 2024-02-16T10:30:53.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(77 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:53.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff57d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:53.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93944084037968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc38900 con 0x55710fc120f0 2024-02-16T10:30:53.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93944084037968] v31'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.876+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93944084020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc485b0 con 0x7ff6b8022070 2024-02-16T10:30:53.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93944084020944] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c90f5980 20 remove_watcher() i=0 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c90f5980 2 removed watcher, disabling cache 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93944084026832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc485b0 con 0x55710fc120f0 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93944084026832] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c90f5980 20 remove_watcher() i=1 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.880+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93944084030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc485b0 con 0x55710fc17f80 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c7411640 1 -- 172.21.15.138:0/2687412902 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93944084030144] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b8012070 con 0x55710fc17f80 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 20 remove_watcher() i=2 2024-02-16T10:30:53.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93944084033936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc38900 con 0x7ff6b8022070 2024-02-16T10:30:53.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c6c10640 1 -- 172.21.15.138:0/2687412902 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93944084033936] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6c00dc040 con 0x7ff6b8022070 2024-02-16T10:30:53.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 20 remove_watcher() i=3 2024-02-16T10:30:53.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93944084028960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1bed0 con 0x55710fc120f0 2024-02-16T10:30:53.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93944084028960] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x55710fc120f0 2024-02-16T10:30:53.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 20 remove_watcher() i=4 2024-02-16T10:30:53.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.884+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93944084032336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1f190 con 0x7ff6c00e2680 2024-02-16T10:30:53.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.888+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93944084032336] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.888+0000 7ff6c90f5980 20 remove_watcher() i=5 2024-02-16T10:30:53.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.888+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93944084039632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc38900 con 0x7ff6c00e2680 2024-02-16T10:30:53.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93944084039632] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 20 remove_watcher() i=6 2024-02-16T10:30:53.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93944084043808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55710fc1bed0 con 0x7ff6c00e2680 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93944084043808] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6b000f620 con 0x7ff6c00e2680 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 20 remove_watcher() i=7 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff6c00e2680 msgr2=0x7ff6c00e2aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff6c00e2680 0x7ff6c00e2aa0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710fc120f0 msgr2=0x55710fc145b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710fc120f0 0x55710fc145b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff6b8022070 msgr2=0x7ff6b802c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff6b8022070 0x7ff6b802c7e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55710fc17f80 msgr2=0x55710fc1a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55710fc17f80 0x55710fc1a410 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5900342b0 msgr2=0x7ff590036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5900342b0 0x7ff590036770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0000f90 tx=0x7ff6c00e0000 comp rx=0 tx=0).stop 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 msgr2=0x55710fc069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c640f640 1 -- 172.21.15.138:0/2687412902 reap_dead start 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff6b802a8d0 tx=0x7ff6b8049800 comp rx=0 tx=0).stop 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 shutdown_connections 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/2687412902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbffc90 0x55710fc069d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 >> 172.21.15.138:0/2687412902 conn(0x55710fbfa810 msgr2=0x55710fbfb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 shutdown_connections 2024-02-16T10:30:53.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/2687412902 wait complete. 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 msgr2=0x7ff5a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 0x7ff5a0036770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55710fbe0020 tx=0x7ff6c00e24d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 msgr2=0x55710fbf30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55710fbd96b0 tx=0x7ff6b800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 shutdown_connections 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5a00342b0 0x7ff5a0036770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/3405911395 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fbf2cb0 0x55710fbf30d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 >> 172.21.15.138:0/3405911395 conn(0x55710fbe7ac0 msgr2=0x55710fbe85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 shutdown_connections 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/3405911395 wait complete. 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 msgr2=0x55710fbdf150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 0x55710fbdf150 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 msgr2=0x55710fbe4760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 0x55710fbe4760 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 msgr2=0x7ff5ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 0x7ff5ac036770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000f70 tx=0x7ff6b0001380 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 msgr2=0x55710fbd8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.892+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0019740 tx=0x7ff6c0017e30 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 shutdown_connections 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55710fbe0f00 0x55710fbe4760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55710faea790 0x55710fbdf150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff5ac0342b0 0x7ff5ac036770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 --2- 172.21.15.138:0/1262028992 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55710fa5b750 0x55710fbd8460 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 >> 172.21.15.138:0/1262028992 conn(0x55710fae1d70 msgr2=0x55710fbcbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 shutdown_connections 2024-02-16T10:30:53.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.896+0000 7ff6c90f5980 1 -- 172.21.15.138:0/1262028992 wait complete. 2024-02-16T10:30:53.911 INFO:teuthology.orchestra.run.smithi138.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"813c5b9c-efe5-457a-a257-626d766e0618","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","marker":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-02-16T10:30:53.205388Z","creation_time":"2024-02-16T10:30:49.675956Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-02-16T10:30:53.911 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '813c5b9c-efe5-457a-a257-626d766e0618', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'marker': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-02-16T10:30:53.205388Z', 'creation_time': '2024-02-16T10:30:49.675956Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-02-16T10:30:53.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-02-16T10:30:53.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-02-16T10:30:53.912 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-02-16T10:30:53.984 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:53.984 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:53.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:53.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:53.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b899b2980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621c229fda0 0x5621c22a2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b899b2980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5621c21e5b40 con 0x5621c220d700 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b899b2980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5621c21acd30 con 0x5621c229fda0 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b86ccc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621c229fda0 0x5621c22a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b874cd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5621c220d700 0x5621c229e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52332/0 (socket says 172.21.15.138:52332) 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b86ccc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5621c229fda0 0x5621c22a2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46778/0 (socket says 172.21.15.138:46778) 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.976+0000 7f2b874cd640 1 -- 172.21.15.138:0/1108100408 learned_addr learned my addr 172.21.15.138:0/1108100408 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b86ccc640 1 -- 172.21.15.138:0/1108100408 >> v1:172.21.15.107:6789/0 conn(0x5621c220d700 legacy=0x5621c229e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b86ccc640 1 -- 172.21.15.138:0/1108100408 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c22a36e0 con 0x5621c229fda0 2024-02-16T10:30:53.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/1108100408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c229fda0 0x5621c22a2190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a480 tx=0x7f2b7c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5edc92aa4d6562 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:53.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b864cb640 1 -- 172.21.15.138:0/1108100408 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0ab540 con 0x5621c229fda0 2024-02-16T10:30:53.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b864cb640 1 -- 172.21.15.138:0/1108100408 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0ab6a0 con 0x5621c229fda0 2024-02-16T10:30:53.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b864cb640 1 -- 172.21.15.138:0/1108100408 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c0ab960 con 0x5621c229fda0 2024-02-16T10:30:53.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 -- 172.21.15.138:0/1108100408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c229fda0 msgr2=0x5621c22a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1108100408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c229fda0 0x5621c22a2190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a480 tx=0x7f2b7c01b280 comp rx=0 tx=0).stop 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 -- 172.21.15.138:0/1108100408 shutdown_connections 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1108100408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c229fda0 0x5621c22a2190 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 -- 172.21.15.138:0/1108100408 >> 172.21.15.138:0/1108100408 conn(0x5621c2293d60 msgr2=0x5621c2296180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 -- 172.21.15.138:0/1108100408 shutdown_connections 2024-02-16T10:30:53.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.980+0000 7f2b899b2980 1 -- 172.21.15.138:0/1108100408 wait complete. 2024-02-16T10:30:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c21a9fc0 con 0x5621c220d700 2024-02-16T10:30:54.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b874cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b874cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46788/0 (socket says 172.21.15.138:46788) 2024-02-16T10:30:54.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b874cd640 1 -- 172.21.15.138:0/71427806 learned_addr learned my addr 172.21.15.138:0/71427806 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b874cd640 1 -- 172.21.15.138:0/71427806 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c005d30 con 0x5621c220d700 2024-02-16T10:30:54.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b874cd640 1 --2- 172.21.15.138:0/71427806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006fb0 tx=0x7f2b80001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1dd1b9d8f4a17c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2a7560a640 1 -- 172.21.15.138:0/71427806 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b80004530 con 0x5621c220d700 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2a7560a640 1 -- 172.21.15.138:0/71427806 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80004690 con 0x5621c220d700 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2a7560a640 1 -- 172.21.15.138:0/71427806 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b800049b0 con 0x5621c220d700 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- 172.21.15.138:0/71427806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 msgr2=0x5621c2385970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 --2- 172.21.15.138:0/71427806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006fb0 tx=0x7f2b80001940 comp rx=0 tx=0).stop 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- 172.21.15.138:0/71427806 shutdown_connections 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 --2- 172.21.15.138:0/71427806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c2385970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- 172.21.15.138:0/71427806 >> 172.21.15.138:0/71427806 conn(0x5621c2293d60 msgr2=0x5621c2381420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- 172.21.15.138:0/71427806 shutdown_connections 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- 172.21.15.138:0/71427806 wait complete. 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:53.996+0000 7f2b899b2980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c21a57a0 con 0x5621c220d700 2024-02-16T10:30:54.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b874cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b874cd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46792/0 (socket says 172.21.15.138:46792) 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b874cd640 1 -- 172.21.15.138:0/3458971260 learned_addr learned my addr 172.21.15.138:0/3458971260 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b874cd640 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c21e5b40 con 0x5621c220d700 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b874cd640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5621c2386720 tx=0x7f2b80000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 -- 172.21.15.138:0/3458971260 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b80013760 con 0x5621c220d700 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621c238cff0 con 0x5621c220d700 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621c238d4a0 con 0x5621c220d700 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 -- 172.21.15.138:0/3458971260 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800138c0 con 0x5621c220d700 2024-02-16T10:30:54.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 -- 172.21.15.138:0/3458971260 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b80013b60 con 0x5621c220d700 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 -- 172.21.15.138:0/3458971260 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b80013cc0 con 0x5621c220d700 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2a73e07640 1 -- 172.21.15.138:0/3458971260 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b80049540 con 0x5621c220d700 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 0x5621c2393750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c2393c90 con 0x5621c229fda0 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b87cce640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 0x5621c2393750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 0x7f2a6c036770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ad000 tx=0x7f2b7c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b87cce640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 0x5621c2393750 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b87cce640 1 -- 172.21.15.138:0/3458971260 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b780083f0 con 0x5621c229fda0 2024-02-16T10:30:54.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.000+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c2390e50 con 0x5621c229fda0 2024-02-16T10:30:54.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 -- 172.21.15.138:0/3458971260 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b780083f0 con 0x5621c229fda0 2024-02-16T10:30:54.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c2395990 con 0x5621c229fda0 2024-02-16T10:30:54.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 -- 172.21.15.138:0/3458971260 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2b780083f0 con 0x5621c229fda0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c2394ad0 con 0x5621c229fda0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 -- 172.21.15.138:0/3458971260 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b780083f0 con 0x5621c229fda0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 0x5621c2398d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23992d0 con 0x5621c23953f0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b874cd640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 0x5621c2398d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b874cd640 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 0x5621c2398d10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b874cd640 1 -- 172.21.15.138:0/3458971260 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2b80024020 con 0x5621c23953f0 2024-02-16T10:30:54.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c213df20 con 0x5621c23a71b0 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46806/0 (socket says 172.21.15.138:46806) 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 -- 172.21.15.138:0/1326823841 learned_addr learned my addr 172.21.15.138:0/1326823841 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 -- 172.21.15.138:0/1326823841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c23a7b10 con 0x5621c23a71b0 2024-02-16T10:30:54.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b87cce640 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x5621c238db40 tx=0x7f2b7800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2a71602640 1 -- 172.21.15.138:0/1326823841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7800f040 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621c23a7d60 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2a71602640 1 -- 172.21.15.138:0/1326823841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7801a560 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2a71602640 1 -- 172.21.15.138:0/1326823841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7801a820 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.004+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621c23a88b0 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a71602640 1 -- 172.21.15.138:0/1326823841 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b7801aa10 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a71602640 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 0x7f2a60036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a71602640 1 -- 172.21.15.138:0/1326823841 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b7804bcf0 con 0x5621c23a71b0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b874cd640 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 0x7f2a60036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b874cd640 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 0x7f2a60036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5621c2394570 tx=0x7f2b80028ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c2131790 con 0x5621c23b4080 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46810/0 (socket says 172.21.15.138:46810) 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b87cce640 1 -- 172.21.15.138:0/3659036305 learned_addr learned my addr 172.21.15.138:0/3659036305 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b87cce640 1 -- 172.21.15.138:0/3659036305 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c23b4a70 con 0x5621c23b4080 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b87cce640 1 --2- 172.21.15.138:0/3659036305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804a020 tx=0x7f2b7804a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf88b75a536c4fd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a6affd640 1 -- 172.21.15.138:0/3659036305 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b7801add0 con 0x5621c23b4080 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a6affd640 1 -- 172.21.15.138:0/3659036305 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78024410 con 0x5621c23b4080 2024-02-16T10:30:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2a6affd640 1 -- 172.21.15.138:0/3659036305 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b780183c0 con 0x5621c23b4080 2024-02-16T10:30:54.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- 172.21.15.138:0/3659036305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 msgr2=0x5621c23b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3659036305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804a020 tx=0x7f2b7804a2f0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- 172.21.15.138:0/3659036305 shutdown_connections 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3659036305 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23b44a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- 172.21.15.138:0/3659036305 >> 172.21.15.138:0/3659036305 conn(0x5621c23aec50 msgr2=0x5621c23afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- 172.21.15.138:0/3659036305 shutdown_connections 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- 172.21.15.138:0/3659036305 wait complete. 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 Processor -- start 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- start start 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23bae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.008+0000 7f2b899b2980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621c23bb350 con 0x5621c23b4080 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23bae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b87cce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23bae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46824/0 (socket says 172.21.15.138:46824) 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 learned_addr learned my addr 172.21.15.138:0/253416583 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621c23a88b0 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b87cce640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23bae10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b78018be0 tx=0x7f2b7803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 -- 172.21.15.138:0/253416583 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b78035040 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621c23bb550 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 -- 172.21.15.138:0/253416583 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7801add0 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 -- 172.21.15.138:0/253416583 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b78024580 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621c23bb920 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 -- 172.21.15.138:0/253416583 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2b780233c0 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a50034300 0x7f2a500367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2a697fa640 1 -- 172.21.15.138:0/253416583 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f2b78055c60 con 0x5621c23b4080 2024-02-16T10:30:54.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b874cd640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a50034300 0x7f2a500367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c23c6530 0x5621c23c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23c9140 con 0x5621c23c6530 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c23c6530 0x5621c23c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b874cd640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a50034300 0x7f2a500367c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b80010ae0 tx=0x7f2b80035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c23c6530 0x5621c23c89f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 realm 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23c9530 con 0x5621c23c6530 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:54.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23c9d80 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23ca0e0 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.012+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23c9a20 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 20 searching for the correct realm 2024-02-16T10:30:54.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5621c23cc330 0x5621c23ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b87cce640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5621c23cc330 0x5621c23ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b87cce640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5621c23cc330 0x5621c23ce780 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b87cce640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2b78023670 0x7f2b7801c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b78023670 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b874cd640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2b78023670 0x7f2b7801c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b874cd640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2b78023670 0x7f2b7801c0d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b874cd640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2b80011a90 0x7f2b80006fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2b80011a90 0x7f2b80006fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2b80011a90 0x7f2b80006fe0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.016+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b78023670 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b78023670 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.020+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b78051070 con 0x5621c23cc330 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b78023670 2024-02-16T10:30:54.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.024+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b78023670 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23cc330 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x7f2b80011a90 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cee50 con 0x5621c23c6530 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0da080 con 0x7f2b78023670 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x5621c23c6530 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cab90 con 0x5621c23c6530 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cb7e0 con 0x7f2b78023670 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 zone default found 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 4 Realm: () 2024-02-16T10:30:54.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 zonegroup default 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23cf2e0 con 0x7f2b80011a90 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d1160 con 0x5621c23cc330 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d14c0 con 0x5621c23cc330 2024-02-16T10:30:54.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 started sync module instance, tier type = 2024-02-16T10:30:54.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:54.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.028+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d0730 con 0x7f2b78023670 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702992687760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d1820 con 0x7f2b78023670 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d2190 con 0x5621c23c6530 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702992687760] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702992694512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d2110 con 0x5621c23c6530 2024-02-16T10:30:54.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.032+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d2ec0 con 0x5621c23cc330 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702992697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d3710 con 0x5621c23cc330 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d40e0 con 0x7f2b78023670 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702992694512] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702992702432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x7f2b78023670 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4e00 con 0x5621c23c6530 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702992697824] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.036+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702992702432] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702992700016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4e00 con 0x5621c23c6530 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d5680 con 0x7f2b80011a90 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702992700016] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702992706160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d5430 con 0x7f2b80011a90 2024-02-16T10:30:54.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.040+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d5f00 con 0x7f2b80011a90 2024-02-16T10:30:54.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702992710112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d63a0 con 0x7f2b80011a90 2024-02-16T10:30:54.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d6e40 con 0x7f2b80011a90 2024-02-16T10:30:54.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702992706160] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702992710112] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702992714016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d5ec0 con 0x7f2b80011a90 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=0 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=1 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=2 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=3 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=4 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=5 2024-02-16T10:30:54.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.044+0000 7f2b899b2980 20 add_watcher() i=6 2024-02-16T10:30:54.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702992714016] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 20 add_watcher() i=7 2024-02-16T10:30:54.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:54.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d9e30 con 0x5621c23c6530 2024-02-16T10:30:54.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702992707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d72a0 con 0x5621c23c6530 2024-02-16T10:30:54.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702992707216] v31'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 5 note: GC not initialized 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2a3cfe1640 20 reqs_thread_entry: start 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 20 Filter name: none 2024-02-16T10:30:54.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f29b67fc640 20 reqs_thread_entry: start 2024-02-16T10:30:54.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23fb350 con 0x7f2b80011a90 2024-02-16T10:30:54.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'35 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.048+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x7f2b80011a90 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x5621c23cc330 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d2ec0 con 0x7f2b80011a90 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'18 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d2ec0 con 0x5621c23c6530 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b78023670 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x7f2b78023670 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.052+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x7f2b78023670 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b78023670 2024-02-16T10:30:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b78023670 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23c6530 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f2b7c0ab810 con 0x5621c23c6530 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.056+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b80011a90 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b78023670 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b80011a90 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b7c0ab810 con 0x7f2b80011a90 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'14 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23cc330 2024-02-16T10:30:54.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f2b7806a040 con 0x5621c23cc330 2024-02-16T10:30:54.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x5621c23c6530 2024-02-16T10:30:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f2b7c0ea040 con 0x5621c23c6530 2024-02-16T10:30:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b78023670 2024-02-16T10:30:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.060+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f2b7c0e0040 con 0x7f2b80011a90 2024-02-16T10:30:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.064+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f2b7c0ea040 con 0x7f2b80011a90 2024-02-16T10:30:54.075 INFO:teuthology.orchestra.run.smithi138.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-02-16T10:30:54.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.064+0000 7f2a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.064+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702992707216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x5621c23c6530 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94702992707216] v31'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x5621c23c6530 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702992687760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d4490 con 0x7f2b78023670 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94702992687760] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 20 remove_watcher() i=0 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 2 removed watcher, disabling cache 2024-02-16T10:30:54.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702992694512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x5621c23c6530 2024-02-16T10:30:54.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94702992694512] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x5621c23c6530 2024-02-16T10:30:54.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 20 remove_watcher() i=1 2024-02-16T10:30:54.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.068+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702992697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23caf40 con 0x5621c23cc330 2024-02-16T10:30:54.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b87cce640 1 -- 172.21.15.138:0/253416583 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94702992697824] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b78084040 con 0x5621c23cc330 2024-02-16T10:30:54.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b899b2980 20 remove_watcher() i=2 2024-02-16T10:30:54.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702992702432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d1cf0 con 0x7f2b78023670 2024-02-16T10:30:54.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b874cd640 1 -- 172.21.15.138:0/253416583 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94702992702432] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b80024020 con 0x7f2b78023670 2024-02-16T10:30:54.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b899b2980 20 remove_watcher() i=3 2024-02-16T10:30:54.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.072+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702992700016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d3be0 con 0x5621c23c6530 2024-02-16T10:30:54.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94702992700016] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x5621c23c6530 2024-02-16T10:30:54.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b899b2980 20 remove_watcher() i=4 2024-02-16T10:30:54.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702992706160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d1cf0 con 0x7f2b80011a90 2024-02-16T10:30:54.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94702992706160] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x7f2b80011a90 2024-02-16T10:30:54.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b899b2980 20 remove_watcher() i=5 2024-02-16T10:30:54.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.076+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702992710112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d3270 con 0x7f2b80011a90 2024-02-16T10:30:54.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94702992710112] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x7f2b80011a90 2024-02-16T10:30:54.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 20 remove_watcher() i=6 2024-02-16T10:30:54.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702992714016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5621c23d3270 con 0x7f2b80011a90 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94702992714016] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b7c0ea040 con 0x7f2b80011a90 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 20 remove_watcher() i=7 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2b80011a90 msgr2=0x7f2b80006fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2b80011a90 0x7f2b80006fe0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c23c6530 msgr2=0x5621c23c89f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c23c6530 0x5621c23c89f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2b78023670 msgr2=0x7f2b7801c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2b78023670 0x7f2b7801c0d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5621c23cc330 msgr2=0x5621c23ce780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5621c23cc330 0x5621c23ce780 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a50034300 msgr2=0x7f2a500367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a50034300 0x7f2a500367c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b80010ae0 tx=0x7f2b80035000 comp rx=0 tx=0).stop 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 msgr2=0x5621c23bae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/253416583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23b4080 0x5621c23bae10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b78018be0 tx=0x7f2b7803d040 comp rx=0 tx=0).stop 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b86ccc640 1 -- 172.21.15.138:0/253416583 reap_dead start 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 shutdown_connections 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 >> 172.21.15.138:0/253416583 conn(0x5621c23aec50 msgr2=0x5621c23afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 shutdown_connections 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/253416583 wait complete. 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 msgr2=0x7f2a60036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 0x7f2a60036770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5621c2394570 tx=0x7f2b80028ea0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 msgr2=0x5621c23a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x5621c238db40 tx=0x7f2b7800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 shutdown_connections 2024-02-16T10:30:54.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a600342b0 0x7f2a60036770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/1326823841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c23a71b0 0x5621c23a75d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 >> 172.21.15.138:0/1326823841 conn(0x5621c239bfc0 msgr2=0x5621c239cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 shutdown_connections 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/1326823841 wait complete. 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 msgr2=0x5621c2393750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 0x5621c2393750 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 msgr2=0x5621c2398d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 0x5621c2398d10 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 msgr2=0x7f2a6c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 0x7f2a6c036770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0ad000 tx=0x7f2b7c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 msgr2=0x5621c238cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5621c2386720 tx=0x7f2b80000f50 comp rx=0 tx=0).stop 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 shutdown_connections 2024-02-16T10:30:54.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5621c23953f0 0x5621c2398d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5621c229fda0 0x5621c2393750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2a6c0342b0 0x7f2a6c036770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 --2- 172.21.15.138:0/3458971260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5621c220d700 0x5621c238cab0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 >> 172.21.15.138:0/3458971260 conn(0x5621c2293d60 msgr2=0x5621c237ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 shutdown_connections 2024-02-16T10:30:54.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.080+0000 7f2b899b2980 1 -- 172.21.15.138:0/3458971260 wait complete. 2024-02-16T10:30:54.099 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-02-16T10:30:54.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-02-16T10:30:54.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-02-16T10:30:54.099 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-02-16T10:30:54.175 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:54.175 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:54.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f02655e9980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe55ed0c90 0x55fe55ed3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f02655e9980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fe55e16b50 con 0x55fe55eccba0 2024-02-16T10:30:54.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f02655e9980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fe55dddd30 con 0x55fe55ed0c90 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262903640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe55ed0c90 0x55fe55ed3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262903640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55fe55ed0c90 0x55fe55ed3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46828/0 (socket says 172.21.15.138:46828) 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0263104640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55fe55eccba0 0x55fe55eccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52334/0 (socket says 172.21.15.138:52334) 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262903640 1 -- 172.21.15.138:0/1565218677 learned_addr learned my addr 172.21.15.138:0/1565218677 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262903640 1 -- 172.21.15.138:0/1565218677 >> v1:172.21.15.107:6789/0 conn(0x55fe55eccba0 legacy=0x55fe55eccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262903640 1 -- 172.21.15.138:0/1565218677 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe55ed45d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.168+0000 7f0262102640 1 -- 172.21.15.138:0/1565218677 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972909525 0 0) 0x55fe55e16b50 con 0x55fe55eccba0 2024-02-16T10:30:54.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f0262903640 1 --2- 172.21.15.138:0/1565218677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55ed0c90 0x55fe55ed3080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f024c00a5c0 tx=0x7f024c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9379412db0b42c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f0262102640 1 -- 172.21.15.138:0/1565218677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c0aa470 con 0x55fe55ed0c90 2024-02-16T10:30:54.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f0262102640 1 -- 172.21.15.138:0/1565218677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0aa5d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f0262102640 1 -- 172.21.15.138:0/1565218677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f024c0aa890 con 0x55fe55ed0c90 2024-02-16T10:30:54.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 -- 172.21.15.138:0/1565218677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55ed0c90 msgr2=0x55fe55ed3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 --2- 172.21.15.138:0/1565218677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55ed0c90 0x55fe55ed3080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f024c00a5c0 tx=0x7f024c01b340 comp rx=0 tx=0).stop 2024-02-16T10:30:54.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 -- 172.21.15.138:0/1565218677 shutdown_connections 2024-02-16T10:30:54.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 --2- 172.21.15.138:0/1565218677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55ed0c90 0x55fe55ed3080 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 -- 172.21.15.138:0/1565218677 >> 172.21.15.138:0/1565218677 conn(0x55fe55e3ff40 msgr2=0x55fe55e40350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 -- 172.21.15.138:0/1565218677 shutdown_connections 2024-02-16T10:30:54.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.172+0000 7f02655e9980 1 -- 172.21.15.138:0/1565218677 wait complete. 2024-02-16T10:30:54.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe55ddafc0 con 0x55fe55eccba0 2024-02-16T10:30:54.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f0263104640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f0263104640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46838/0 (socket says 172.21.15.138:46838) 2024-02-16T10:30:54.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f0263104640 1 -- 172.21.15.138:0/2018249689 learned_addr learned my addr 172.21.15.138:0/2018249689 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f0263104640 1 -- 172.21.15.138:0/2018249689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c005df0 con 0x55fe55eccba0 2024-02-16T10:30:54.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f0263104640 1 --2- 172.21.15.138:0/2018249689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f025c00b250 tx=0x7f025c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58159447011e9279 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f015160a640 1 -- 172.21.15.138:0/2018249689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025c014070 con 0x55fe55eccba0 2024-02-16T10:30:54.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f015160a640 1 -- 172.21.15.138:0/2018249689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00d640 con 0x55fe55eccba0 2024-02-16T10:30:54.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f015160a640 1 -- 172.21.15.138:0/2018249689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025c00d960 con 0x55fe55eccba0 2024-02-16T10:30:54.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- 172.21.15.138:0/2018249689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 msgr2=0x55fe55fb6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 --2- 172.21.15.138:0/2018249689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f025c00b250 tx=0x7f025c00b710 comp rx=0 tx=0).stop 2024-02-16T10:30:54.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- 172.21.15.138:0/2018249689 shutdown_connections 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 --2- 172.21.15.138:0/2018249689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fb6640 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- 172.21.15.138:0/2018249689 >> 172.21.15.138:0/2018249689 conn(0x55fe55e3ff40 msgr2=0x55fe55fb21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- 172.21.15.138:0/2018249689 shutdown_connections 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 -- 172.21.15.138:0/2018249689 wait complete. 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.188+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe55dd67a0 con 0x55fe55eccba0 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263104640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263104640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46842/0 (socket says 172.21.15.138:46842) 2024-02-16T10:30:54.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263104640 1 -- 172.21.15.138:0/4232298120 learned_addr learned my addr 172.21.15.138:0/4232298120 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263104640 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c001bb0 con 0x55fe55eccba0 2024-02-16T10:30:54.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263104640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c10 tx=0x7f025c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 -- 172.21.15.138:0/4232298120 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025c0012c0 con 0x55fe55eccba0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe55fbdb80 con 0x55fe55eccba0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 -- 172.21.15.138:0/4232298120 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c021070 con 0x55fe55eccba0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 -- 172.21.15.138:0/4232298120 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025c00fbe0 con 0x55fe55eccba0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe55fbe030 con 0x55fe55eccba0 2024-02-16T10:30:54.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 -- 172.21.15.138:0/4232298120 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f025c00fd40 con 0x55fe55eccba0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 0x7f0148036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f014fe07640 1 -- 172.21.15.138:0/4232298120 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f025c04a0c0 con 0x55fe55eccba0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0262903640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 0x7f0148036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 0x55fe55fc42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fc4820 con 0x55fe55ed0c90 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263905640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 0x55fe55fc42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0262903640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 0x7f0148036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f024c0ae000 tx=0x7f024c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.192+0000 7f0263905640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 0x55fe55fc42e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/4232298120 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fc19e0 con 0x55fe55ed0c90 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/4232298120 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fc6520 con 0x55fe55ed0c90 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/4232298120 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fc5660 con 0x55fe55ed0c90 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/4232298120 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe55ed0c90 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 0x55fe55fc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fc9e60 con 0x55fe55fc5f80 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263104640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 0x55fe55fc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263104640 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 0x55fe55fc98a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263104640 1 -- 172.21.15.138:0/4232298120 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f025c016070 con 0x55fe55fc5f80 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe55d6ef20 con 0x55fe55fd7de0 2024-02-16T10:30:54.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46858/0 (socket says 172.21.15.138:46858) 2024-02-16T10:30:54.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/3265827721 learned_addr learned my addr 172.21.15.138:0/3265827721 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 -- 172.21.15.138:0/3265827721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe55fd8740 con 0x55fe55fd7de0 2024-02-16T10:30:54.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f0263905640 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55fe55fbe6d0 tx=0x7f02540188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f014d602640 1 -- 172.21.15.138:0/3265827721 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f025401d070 con 0x55fe55fd7de0 2024-02-16T10:30:54.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe55fd8990 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f014d602640 1 -- 172.21.15.138:0/3265827721 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254014580 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f014d602640 1 -- 172.21.15.138:0/3265827721 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0254014860 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.196+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe55fd94e0 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f014d602640 1 -- 172.21.15.138:0/3265827721 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0254020020 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f014d602640 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 0x7f013c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f014d602640 1 -- 172.21.15.138:0/3265827721 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f025404b1e0 con 0x55fe55fd7de0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263104640 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 0x7f013c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263104640 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 0x7f013c036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55fe55fc5100 tx=0x7f025c048440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe55d62790 con 0x55fe55e41a10 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46864/0 (socket says 172.21.15.138:46864) 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263905640 1 -- 172.21.15.138:0/54967527 learned_addr learned my addr 172.21.15.138:0/54967527 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263905640 1 -- 172.21.15.138:0/54967527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe55e42400 con 0x55fe55e41a10 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0263905640 1 --2- 172.21.15.138:0/54967527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02540495d0 tx=0x7f025402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f787503d4b307a51 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0146ffd640 1 -- 172.21.15.138:0/54967527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02540149c0 con 0x55fe55e41a10 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0146ffd640 1 -- 172.21.15.138:0/54967527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254014b20 con 0x55fe55e41a10 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f0146ffd640 1 -- 172.21.15.138:0/54967527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0254012df0 con 0x55fe55e41a10 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- 172.21.15.138:0/54967527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 msgr2=0x55fe55e41e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 --2- 172.21.15.138:0/54967527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f02540495d0 tx=0x7f025402bf20 comp rx=0 tx=0).stop 2024-02-16T10:30:54.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- 172.21.15.138:0/54967527 shutdown_connections 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 --2- 172.21.15.138:0/54967527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55e41e30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- 172.21.15.138:0/54967527 >> 172.21.15.138:0/54967527 conn(0x55fe55fdf900 msgr2=0x55fe55fe07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- 172.21.15.138:0/54967527 shutdown_connections 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- 172.21.15.138:0/54967527 wait complete. 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 Processor -- start 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.200+0000 7f02655e9980 1 -- start start 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe55ff0430 con 0x55fe55e41a10 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263905640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46880/0 (socket says 172.21.15.138:46880) 2024-02-16T10:30:54.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 learned_addr learned my addr 172.21.15.138:0/415524915 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe55fd94e0 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263905640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0254045040 tx=0x7f0254049560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 -- 172.21.15.138:0/415524915 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02540149c0 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 -- 172.21.15.138:0/415524915 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254013850 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 -- 172.21.15.138:0/415524915 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0254048320 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe55ff0630 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe55ff0a60 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 -- 172.21.15.138:0/415524915 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0254012930 con 0x55fe55e41a10 2024-02-16T10:30:54.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f012c0342b0 0x7f012c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f01457fa640 1 -- 172.21.15.138:0/415524915 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7f025404cda0 con 0x55fe55e41a10 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263104640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f012c0342b0 0x7f012c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ffb660 0x55fe55ffdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55ffe270 con 0x55fe55ffb660 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0262903640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ffb660 0x55fe55ffdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0263104640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f012c0342b0 0x7f012c036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f025c01b970 tx=0x7f025c03e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.204+0000 7f0262903640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ffb660 0x55fe55ffdb20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 realm 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55ffe660 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55ffeeb0 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fff210 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 20 searching for the correct realm 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fe560018c0 0x55fe56003d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56004400 con 0x55fe560018c0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263905640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fe560018c0 0x55fe56003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263905640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fe560018c0 0x55fe56003d80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263905640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0254055040 0x7f0254024020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56004400 con 0x7f0254055040 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263104640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0254055040 0x7f0254024020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263104640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0254055040 0x7f0254024020 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263104640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f025c01db00 0x7f025c0485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56004400 con 0x7f025c01db00 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f025c01db00 0x7f025c0485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.208+0000 7f0262903640 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f025c01db00 0x7f025c0485f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f0254055040 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.212+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f0254055040 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f0254055040 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.216+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f0254055040 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe560018c0 2024-02-16T10:30:54.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f025c01db00 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x55fe55ffb660 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe55fffa10 con 0x7f0254055040 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56000210 con 0x55fe55ffb660 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560005c0 con 0x55fe55ffb660 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560005c0 con 0x7f0254055040 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.220+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:54.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 zone default found 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 4 Realm: () 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 zonegroup default 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56004840 con 0x7f025c01db00 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56006220 con 0x55fe560018c0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560065d0 con 0x55fe560018c0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 started sync module instance, tier type = 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560056b0 con 0x7f0254055040 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94550852915728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56005eb0 con 0x7f0254055040 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56007080 con 0x55fe55ffb660 2024-02-16T10:30:54.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.224+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94550852915728] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94550852922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56007430 con 0x55fe55ffb660 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56007da0 con 0x55fe560018c0 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94550852925696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56007d60 con 0x55fe560018c0 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56008cf0 con 0x7f0254055040 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94550852922208] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94550852929520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560090a0 con 0x7f0254055040 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.228+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56009a10 con 0x55fe55ffb660 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94550852925696] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94550852929520] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94550852927872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56005b20 con 0x55fe55ffb660 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600a260 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94550852927872] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94550852932976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600a1e0 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.232+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600ab50 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94550852937392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600af70 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600ba10 con 0x7f025c01db00 2024-02-16T10:30:54.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94550852932976] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94550852941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600b9d0 con 0x7f025c01db00 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=0 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=1 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=2 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=3 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=4 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.236+0000 7f02655e9980 20 add_watcher() i=5 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94550852937392] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 add_watcher() i=6 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94550852941040] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 add_watcher() i=7 2024-02-16T10:30:54.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600aad0 con 0x55fe55ffb660 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94550852934896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5600aad0 con 0x55fe55ffb660 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94550852934896] v31'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 5 note: GC not initialized 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f0118fe1640 20 reqs_thread_entry: start 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 Filter name: none 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f00927fc640 20 reqs_thread_entry: start 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.240+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560307b0 con 0x55fe55ffb660 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56032b70 con 0x7f0254055040 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 disabling bucket name=myfoo 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56030b50 con 0x7f0254055040 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe560323e0 con 0x55fe55ffb660 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe5603aea0 con 0x55fe55ffb660 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'6 uv6 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94550853099328 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036500 con 0x55fe55ffb660 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94550852927872 notify 133143986195 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f024c0e1040 con 0x55fe55ffb660 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94550852927872 notifier 4591 bl.length()=725 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(67 notify.4 [notify cookie 94550853099328 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0146ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0146ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0146ffd640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0128003ea0 con 0x55fe55ffb660 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94550853099328 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f024c0b9050 con 0x55fe55ffb660 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.244+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x55fe55ffb660 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94550853111632 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== watch-notify(notify (1) cookie 94550852927872 notify 133143986196 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f024c0b9050 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94550852927872 notifier 4591 bl.length()=534 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(70 notify.4 [notify cookie 94550853111632 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0146ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0146ffd640 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0128004200 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== watch-notify(notify_complete (2) cookie 94550853111632 notify 133143986196 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fe55ed45d0 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.266 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:54.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94550852934896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x55fe55ffb660 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94550852934896] v31'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.248+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94550852915728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x7f0254055040 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94550852915728] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f02655e9980 20 remove_watcher() i=0 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f02655e9980 2 removed watcher, disabling cache 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94550852922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56000210 con 0x55fe55ffb660 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94550852922208] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f02655e9980 20 remove_watcher() i=1 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.252+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94550852925696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x55fe560018c0 2024-02-16T10:30:54.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f0263905640 1 -- 172.21.15.138:0/415524915 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94550852925696] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025400a4d0 con 0x55fe560018c0 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 20 remove_watcher() i=2 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94550852929520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56000210 con 0x7f0254055040 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f0263104640 1 -- 172.21.15.138:0/415524915 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94550852929520] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f025c016070 con 0x7f0254055040 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 20 remove_watcher() i=3 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94550852927872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x55fe55ffb660 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94550852927872] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x55fe55ffb660 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 20 remove_watcher() i=4 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.256+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94550852932976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56000210 con 0x7f025c01db00 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94550852932976] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f02655e9980 20 remove_watcher() i=5 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94550852937392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56036020 con 0x7f025c01db00 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94550852937392] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f02655e9980 20 remove_watcher() i=6 2024-02-16T10:30:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.260+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94550852941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe56000210 con 0x7f025c01db00 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94550852941040] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f024c0b0020 con 0x7f025c01db00 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 20 remove_watcher() i=7 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f025c01db00 msgr2=0x7f025c0485f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f025c01db00 0x7f025c0485f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ffb660 msgr2=0x55fe55ffdb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ffb660 0x55fe55ffdb20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0254055040 msgr2=0x7f0254024020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f0254055040 0x7f0254024020 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fe560018c0 msgr2=0x55fe56003d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55fe560018c0 0x55fe56003d80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f012c0342b0 msgr2=0x7f012c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f012c0342b0 0x7f012c036770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f025c01b970 tx=0x7f025c03e000 comp rx=0 tx=0).stop 2024-02-16T10:30:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 msgr2=0x55fe55fefef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0254045040 tx=0x7f0254049560 comp rx=0 tx=0).stop 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f0262903640 1 -- 172.21.15.138:0/415524915 reap_dead start 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 shutdown_connections 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/415524915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55e41a10 0x55fe55fefef0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 >> 172.21.15.138:0/415524915 conn(0x55fe55fdf900 msgr2=0x55fe55fe07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 shutdown_connections 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/415524915 wait complete. 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 msgr2=0x7f013c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 0x7f013c036770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55fe55fc5100 tx=0x7f025c048440 comp rx=0 tx=0).stop 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 msgr2=0x55fe55fd8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55fe55fbe6d0 tx=0x7f02540188f0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 shutdown_connections 2024-02-16T10:30:54.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f013c0342b0 0x7f013c036770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/3265827721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55fd7de0 0x55fe55fd8200 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 >> 172.21.15.138:0/3265827721 conn(0x55fe55fccbf0 msgr2=0x55fe55fcd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 shutdown_connections 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/3265827721 wait complete. 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 msgr2=0x55fe55fc42e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 0x55fe55fc42e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 msgr2=0x55fe55fc98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 0x55fe55fc98a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 msgr2=0x7f0148036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 0x7f0148036770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f024c0ae000 tx=0x7f024c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 msgr2=0x55fe55fbd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c10 tx=0x7f025c000ee0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 shutdown_connections 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55fe55fc5f80 0x55fe55fc98a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55fe55ed0c90 0x55fe55fc42e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f01480342b0 0x7f0148036770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 --2- 172.21.15.138:0/4232298120 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fe55eccba0 0x55fe55fbd640 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 >> 172.21.15.138:0/4232298120 conn(0x55fe55e3ff40 msgr2=0x55fe55fb0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 shutdown_connections 2024-02-16T10:30:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.264+0000 7f02655e9980 1 -- 172.21.15.138:0/4232298120 wait complete. 2024-02-16T10:30:54.283 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:54.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-02-16T10:30:54.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-02-16T10:30:54.285 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-02-16T10:30:54.355 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:30:54.356 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd3b10980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56023a2039f0 0x56023a205de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd3b10980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56023a14bb50 con 0x56023a173f50 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd3b10980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x56023a112d30 con 0x56023a2039f0 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd0e2a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56023a2039f0 0x56023a205de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd162b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56023a173f50 0x56023a2022d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:52342/0 (socket says 172.21.15.138:52342) 2024-02-16T10:30:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd0e2a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56023a2039f0 0x56023a205de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46896/0 (socket says 172.21.15.138:46896) 2024-02-16T10:30:54.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd162b640 1 -- 172.21.15.138:0/971295361 learned_addr learned my addr 172.21.15.138:0/971295361 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:30:54.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/971295361 >> v1:172.21.15.107:6789/0 conn(0x56023a173f50 legacy=0x56023a2022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.348+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/971295361 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023a207360 con 0x56023a2039f0 2024-02-16T10:30:54.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/971295361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a2039f0 0x56023a205de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800a480 tx=0x7fbdc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baae1c170eb6b053 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdc3fff640 1 -- 172.21.15.138:0/971295361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80ab540 con 0x56023a2039f0 2024-02-16T10:30:54.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdc3fff640 1 -- 172.21.15.138:0/971295361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc80ab6a0 con 0x56023a2039f0 2024-02-16T10:30:54.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdc3fff640 1 -- 172.21.15.138:0/971295361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80ab960 con 0x56023a2039f0 2024-02-16T10:30:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 -- 172.21.15.138:0/971295361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a2039f0 msgr2=0x56023a205de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/971295361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a2039f0 0x56023a205de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800a480 tx=0x7fbdc801b280 comp rx=0 tx=0).stop 2024-02-16T10:30:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 -- 172.21.15.138:0/971295361 shutdown_connections 2024-02-16T10:30:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/971295361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a2039f0 0x56023a205de0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 -- 172.21.15.138:0/971295361 >> 172.21.15.138:0/971295361 conn(0x56023a1f9db0 msgr2=0x56023a1fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 -- 172.21.15.138:0/971295361 shutdown_connections 2024-02-16T10:30:54.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.352+0000 7fbdd3b10980 1 -- 172.21.15.138:0/971295361 wait complete. 2024-02-16T10:30:54.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023a10ffc0 con 0x56023a173f50 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46900/0 (socket says 172.21.15.138:46900) 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 -- 172.21.15.138:0/3139309601 learned_addr learned my addr 172.21.15.138:0/3139309601 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 -- 172.21.15.138:0/3139309601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8005d30 con 0x56023a173f50 2024-02-16T10:30:54.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 --2- 172.21.15.138:0/3139309601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001590 tx=0x7fbdcc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9fc4599daae922 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbcbf606640 1 -- 172.21.15.138:0/3139309601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc004530 con 0x56023a173f50 2024-02-16T10:30:54.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbcbf606640 1 -- 172.21.15.138:0/3139309601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc004690 con 0x56023a173f50 2024-02-16T10:30:54.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbcbf606640 1 -- 172.21.15.138:0/3139309601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc004950 con 0x56023a173f50 2024-02-16T10:30:54.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3139309601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 msgr2=0x56023a2e9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3139309601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001590 tx=0x7fbdcc001a50 comp rx=0 tx=0).stop 2024-02-16T10:30:54.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3139309601 shutdown_connections 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3139309601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2e9710 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3139309601 >> 172.21.15.138:0/3139309601 conn(0x56023a1f9db0 msgr2=0x56023a2e52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3139309601 shutdown_connections 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3139309601 wait complete. 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd3b10980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023a10b7a0 con 0x56023a173f50 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46908/0 (socket says 172.21.15.138:46908) 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.368+0000 7fbdd162b640 1 -- 172.21.15.138:0/3197009654 learned_addr learned my addr 172.21.15.138:0/3197009654 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd162b640 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023a14bb50 con 0x56023a173f50 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd162b640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001a90 tx=0x7fbdcc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 -- 172.21.15.138:0/3197009654 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc013760 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56023a2f0b40 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56023a2f0ff0 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 -- 172.21.15.138:0/3197009654 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0138c0 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 -- 172.21.15.138:0/3197009654 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc013b60 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 -- 172.21.15.138:0/3197009654 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbdcc013cc0 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 0x7fbcb8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbcbde03640 1 -- 172.21.15.138:0/3197009654 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbdcc049300 con 0x56023a173f50 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 0x7fbcb8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 0x56023a2f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a2f7830 con 0x56023a2039f0 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 0x56023a2f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 0x7fbcb8036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80ad000 tx=0x7fbdc80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 0x56023a2f72f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/3197009654 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdc40083f0 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a2f7c20 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/3197009654 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbdc40083f0 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a2f94d0 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/3197009654 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fbdc40083f0 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.372+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a2f8610 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/3197009654 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbdc40083f0 con 0x56023a2039f0 2024-02-16T10:30:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 0x56023a2fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a2fce60 con 0x56023a2f8f30 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd162b640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 0x56023a2fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd162b640 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 0x56023a2fc850 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd162b640 1 -- 172.21.15.138:0/3197009654 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbdcc024020 con 0x56023a2f8f30 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023a0a3f20 con 0x56023a30ad90 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46912/0 (socket says 172.21.15.138:46912) 2024-02-16T10:30:54.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2394977875 learned_addr learned my addr 172.21.15.138:0/2394977875 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2394977875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023a30b6f0 con 0x56023a30ad90 2024-02-16T10:30:54.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x56023a2f16e0 tx=0x7fbdc400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbcb6ffd640 1 -- 172.21.15.138:0/2394977875 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc400f040 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56023a30b940 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbcb6ffd640 1 -- 172.21.15.138:0/2394977875 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4019550 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbcb6ffd640 1 -- 172.21.15.138:0/2394977875 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4019810 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.376+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56023a30c490 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb6ffd640 1 -- 172.21.15.138:0/2394977875 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbdc4019a00 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb6ffd640 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 0x7fbca8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb6ffd640 1 -- 172.21.15.138:0/2394977875 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbdc404b4b0 con 0x56023a30ad90 2024-02-16T10:30:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 0x7fbca8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023a097790 con 0x56023a317cf0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 0x7fbca8036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56023a2f8050 tx=0x7fbdcc047680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46928/0 (socket says 172.21.15.138:46928) 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2863235207 learned_addr learned my addr 172.21.15.138:0/2863235207 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2863235207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023a3186a0 con 0x56023a317cf0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2863235207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4018fd0 tx=0x7fbdc402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4a169122fa7b5f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb4ff9640 1 -- 172.21.15.138:0/2863235207 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4048070 con 0x56023a317cf0 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb4ff9640 1 -- 172.21.15.138:0/2863235207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc404b110 con 0x56023a317cf0 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbcb4ff9640 1 -- 172.21.15.138:0/2863235207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc40153a0 con 0x56023a317cf0 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2863235207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 msgr2=0x56023a3180d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2863235207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4018fd0 tx=0x7fbdc402af40 comp rx=0 tx=0).stop 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2863235207 shutdown_connections 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2863235207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a3180d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2863235207 >> 172.21.15.138:0/2863235207 conn(0x56023a312870 msgr2=0x56023a313750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2863235207 shutdown_connections 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2863235207 wait complete. 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 Processor -- start 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- start start 2024-02-16T10:30:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd3b10980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023a31ef60 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:46930/0 (socket says 172.21.15.138:46930) 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.380+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 learned_addr learned my addr 172.21.15.138:0/2901315934 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023a30c490 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4018fd0 tx=0x7fbdc4049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 -- 172.21.15.138:0/2901315934 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4018530 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56023a31f160 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 -- 172.21.15.138:0/2901315934 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc404b280 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 -- 172.21.15.138:0/2901315934 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4049d20 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56023a31f5f0 con 0x56023a317cf0 2024-02-16T10:30:54.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 -- 172.21.15.138:0/2901315934 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbdc4032020 con 0x56023a317cf0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbc9c0342b0 0x7fbc9c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbca6ffd640 1 -- 172.21.15.138:0/2901315934 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6133+0+0 (secure 0 0 0) 0x7fbdc4037c90 con 0x56023a317cf0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbc9c0342b0 0x7fbc9c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a32a0f0 0x56023a32c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32cd00 con 0x56023a32a0f0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a32a0f0 0x56023a32c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbc9c0342b0 0x7fbc9c036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0464d0 tx=0x7fbdcc031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a32a0f0 0x56023a32c5b0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 realm 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32d0f0 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32d970 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32dcd0 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.384+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32e4d0 con 0x56023a32a0f0 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd3b10980 20 searching for the correct realm 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56023a330380 0x56023a332840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56023a330380 0x56023a332840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56023a330380 0x56023a332840 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd1e2c640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fbdc4022070 0x7fbdc400c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdc4022070 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fbdc4022070 0x7fbdc400c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fbdc4022070 0x7fbdc400c0b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd162b640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbdcc027840 0x7fbdcc028460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbdcc027840 0x7fbdcc028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbdcc027840 0x7fbdcc028460 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.388+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdc4022070 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdc4022070 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.392+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4042040 con 0x56023a330380 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdc4022070 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.396+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdc4022070 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a330380 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x7fbdcc027840 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a332f10 con 0x56023a32a0f0 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbdc80da080 con 0x7fbdc4022070 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:30:54.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32edd0 con 0x56023a32a0f0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32f620 con 0x56023a32a0f0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:30:54.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32f620 con 0x7fbdc4022070 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 zone default found 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 4 Realm: () 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 zonegroup default 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.400+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a333350 con 0x7fbdcc027840 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3351d0 con 0x56023a330380 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a335530 con 0x56023a330380 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 started sync module instance, tier type = 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:30:54.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3347a0 con 0x7fbdc4022070 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567566361344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3358e0 con 0x7fbdc4022070 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a336250 con 0x56023a32a0f0 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.404+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567566361344] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567566368176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a334c90 con 0x56023a32a0f0 2024-02-16T10:30:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a336f80 con 0x56023a330380 2024-02-16T10:30:54.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567566371488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a336ec0 con 0x56023a330380 2024-02-16T10:30:54.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a337e60 con 0x7fbdc4022070 2024-02-16T10:30:54.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567566368176] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567566370304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a338210 con 0x7fbdc4022070 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.408+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a338b80 con 0x56023a32a0f0 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567566371488] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567566370304] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567566373680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3386e0 con 0x56023a32a0f0 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3393d0 con 0x7fbdcc027840 2024-02-16T10:30:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567566373680] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567566375280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a339130 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.412+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a339930 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.416+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567566375280] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.416+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.416+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567566380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a3396f0 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.416+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a33a1c0 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.416+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567566380176] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567566384288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a33a180 con 0x7fbdcc027840 2024-02-16T10:30:54.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=0 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=1 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=2 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=3 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=4 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=5 2024-02-16T10:30:54.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=6 2024-02-16T10:30:54.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567566384288] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 add_watcher() i=7 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 2 all 8 watchers are set, enabling cache 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a33d6c0 con 0x56023a32a0f0 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567566381392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a33aaa0 con 0x56023a32a0f0 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567566381392] v31'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbc877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 5 note: GC not initialized 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbc867e4640 20 reqs_thread_entry: start 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 init_complete bucket index max shards: 11 2024-02-16T10:30:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 Filter name: none 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbbf7fff640 20 reqs_thread_entry: start 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.420+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a35f4c0 con 0x56023a32a0f0 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a361880 con 0x7fbdc4022070 2024-02-16T10:30:54.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 enabling bucket name=myfoo 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a35f860 con 0x7fbdc4022070 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 : miss 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 rados->read ofs=0 len=0 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a362120 con 0x56023a32a0f0 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(65 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.17 8:ea760457:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a369900 con 0x56023a32a0f0 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1, ofs0, ns] 2024-02-16T10:30:54.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94567566548912 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364f60 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94567566373680 notify 133143986197 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x56023a207360 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbcb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94567566373680 notifier 4598 bl.length()=725 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbcb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 info.flags=0x17 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbcb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1 to cache LRU end 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(67 notify.4 [notify cookie 94567566548912 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbcb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbcb4ff9640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbc94003ea0 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94567566548912 notify 133143986197 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdc80d0a60 con 0x56023a32a0f0 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_sources= new_sources= 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential sources added=[] removed=[] 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): orig_dests= new_dests= 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 20 handle_bi_update(): bucket=:myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1]): potential dests added=[] removed=[] 2024-02-16T10:30:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.424+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x56023a32a0f0 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~358] v31'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94567566532000 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x56023a32a0f0 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== watch-notify(notify (1) cookie 94567566373680 notify 133143986198 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7fbdc80d0a60 con 0x56023a32a0f0 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbcb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94567566373680 notifier 4598 bl.length()=534 2024-02-16T10:30:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(70 notify.4 [notify cookie 94567566532000 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbcb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:30:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbcb4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:30:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbcb4ff9640 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbc94004200 con 0x56023a32a0f0 2024-02-16T10:30:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== watch-notify(notify_complete (2) cookie 94567566532000 notify 133143986198 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbdc80d0cc0 con 0x56023a32a0f0 2024-02-16T10:30:54.442 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbc877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567566381392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x56023a32a0f0 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94567566381392] v31'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567566361344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x7fbdc4022070 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.428+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94567566361344] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd3b10980 20 remove_watcher() i=0 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd3b10980 2 removed watcher, disabling cache 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567566368176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32edd0 con 0x56023a32a0f0 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94567566368176] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd3b10980 20 remove_watcher() i=1 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.432+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567566371488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x56023a330380 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd1e2c640 1 -- 172.21.15.138:0/2901315934 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94567566371488] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc4061040 con 0x56023a330380 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 20 remove_watcher() i=2 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567566370304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32edd0 con 0x7fbdc4022070 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd162b640 1 -- 172.21.15.138:0/2901315934 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94567566370304] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdcc024020 con 0x7fbdc4022070 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 20 remove_watcher() i=3 2024-02-16T10:30:54.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567566373680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x56023a32a0f0 2024-02-16T10:30:54.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94567566373680] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x56023a32a0f0 2024-02-16T10:30:54.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 20 remove_watcher() i=4 2024-02-16T10:30:54.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.436+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567566375280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32edd0 con 0x7fbdcc027840 2024-02-16T10:30:54.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94567566375280] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd3b10980 20 remove_watcher() i=5 2024-02-16T10:30:54.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567566380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a364a80 con 0x7fbdcc027840 2024-02-16T10:30:54.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94567566380176] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd3b10980 20 remove_watcher() i=6 2024-02-16T10:30:54.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.440+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567566384288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56023a32edd0 con 0x7fbdcc027840 2024-02-16T10:30:54.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94567566384288] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbdc80ab810 con 0x7fbdcc027840 2024-02-16T10:30:54.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 20 remove_watcher() i=7 2024-02-16T10:30:54.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbdcc027840 msgr2=0x7fbdcc028460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fbdcc027840 0x7fbdcc028460 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a32a0f0 msgr2=0x56023a32c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a32a0f0 0x56023a32c5b0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fbdc4022070 msgr2=0x7fbdc400c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fbdc4022070 0x7fbdc400c0b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56023a330380 msgr2=0x56023a332840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56023a330380 0x56023a332840 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbc9c0342b0 msgr2=0x7fbc9c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbc9c0342b0 0x7fbc9c036770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0464d0 tx=0x7fbdcc031000 comp rx=0 tx=0).stop 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 msgr2=0x56023a31ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd0e2a640 1 -- 172.21.15.138:0/2901315934 reap_dead start 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4018fd0 tx=0x7fbdc4049830 comp rx=0 tx=0).stop 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 shutdown_connections 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2901315934 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a317cf0 0x56023a31ea20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 >> 172.21.15.138:0/2901315934 conn(0x56023a312870 msgr2=0x56023a313750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 shutdown_connections 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2901315934 wait complete. 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 msgr2=0x7fbca8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 0x7fbca8036770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56023a2f8050 tx=0x7fbdcc047680 comp rx=0 tx=0).stop 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 msgr2=0x56023a30b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x56023a2f16e0 tx=0x7fbdc400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 shutdown_connections 2024-02-16T10:30:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbca80342b0 0x7fbca8036770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/2394977875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a30ad90 0x56023a30b1b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 >> 172.21.15.138:0/2394977875 conn(0x56023a2ffba0 msgr2=0x56023a3006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 shutdown_connections 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/2394977875 wait complete. 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 msgr2=0x56023a2f72f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 0x56023a2f72f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 msgr2=0x56023a2fc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 0x56023a2fc850 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 msgr2=0x7fbcb8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 0x7fbcb8036770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80ad000 tx=0x7fbdc80a5040 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 msgr2=0x56023a2f0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001a90 tx=0x7fbdcc001260 comp rx=0 tx=0).stop 2024-02-16T10:30:54.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 shutdown_connections 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56023a2f8f30 0x56023a2fc850 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56023a2039f0 0x56023a2f72f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbcb80342b0 0x7fbcb8036770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 --2- 172.21.15.138:0/3197009654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56023a173f50 0x56023a2f0600 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 >> 172.21.15.138:0/3197009654 conn(0x56023a1f9db0 msgr2=0x56023a2e3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 shutdown_connections 2024-02-16T10:30:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:30:54.444+0000 7fbdd3b10980 1 -- 172.21.15.138:0/3197009654 wait complete. 2024-02-16T10:30:54.464 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:30:54.472 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:30:54.826 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-02-16T10:30:54.842 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:09.843 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T10:31:09.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T10:31:09.844 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T10:31:09.881 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:09.882 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:09.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9225c3b980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56540d5caaf0 0x56540d5ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9225c3b980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56540d512b50 con 0x56540d5c65e0 2024-02-16T10:31:09.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9225c3b980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x56540d4d9d30 con 0x56540d5caaf0 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9222f55640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56540d5caaf0 0x56540d5ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9223756640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x56540d5c65e0 0x56540d5c69c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37114/0 (socket says 172.21.15.138:37114) 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9223756640 1 -- 172.21.15.138:0/2918085216 learned_addr learned my addr 172.21.15.138:0/2918085216 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9222f55640 1 --2- 172.21.15.138:0/2918085216 >> v2:172.21.15.107:3300/0 conn(0x56540d5caaf0 0x56540d5ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:39972/0 (socket says 172.21.15.138:39972) 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9222f55640 1 -- 172.21.15.138:0/2918085216 >> v1:172.21.15.107:6789/0 conn(0x56540d5c65e0 legacy=0x56540d5c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:09.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.876+0000 7f9222f55640 1 -- 172.21.15.138:0/2918085216 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56540d5ce430 con 0x56540d5caaf0 2024-02-16T10:31:09.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9222f55640 1 --2- 172.21.15.138:0/2918085216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5caaf0 0x56540d5ccee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f920c00a480 tx=0x7f920c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c51fa2f42ba15f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9222754640 1 -- 172.21.15.138:0/2918085216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f920c0ab540 con 0x56540d5caaf0 2024-02-16T10:31:09.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9222754640 1 -- 172.21.15.138:0/2918085216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c0ab6a0 con 0x56540d5caaf0 2024-02-16T10:31:09.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9222754640 1 -- 172.21.15.138:0/2918085216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f920c0ab960 con 0x56540d5caaf0 2024-02-16T10:31:09.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 -- 172.21.15.138:0/2918085216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5caaf0 msgr2=0x56540d5ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2918085216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5caaf0 0x56540d5ccee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f920c00a480 tx=0x7f920c01b280 comp rx=0 tx=0).stop 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 -- 172.21.15.138:0/2918085216 shutdown_connections 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2918085216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5caaf0 0x56540d5ccee0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 -- 172.21.15.138:0/2918085216 >> 172.21.15.138:0/2918085216 conn(0x56540d5c1eb0 msgr2=0x56540d5c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 -- 172.21.15.138:0/2918085216 shutdown_connections 2024-02-16T10:31:09.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.880+0000 7f9225c3b980 1 -- 172.21.15.138:0/2918085216 wait complete. 2024-02-16T10:31:09.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9225c3b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9225c3b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56540d4d6fc0 con 0x56540d5c65e0 2024-02-16T10:31:09.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9223756640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9223756640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:39982/0 (socket says 172.21.15.138:39982) 2024-02-16T10:31:09.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.896+0000 7f9223756640 1 -- 172.21.15.138:0/1282991967 learned_addr learned my addr 172.21.15.138:0/1282991967 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:09.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 -- 172.21.15.138:0/1282991967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c005d30 con 0x56540d5c65e0 2024-02-16T10:31:09.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 --2- 172.21.15.138:0/1282991967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f921c001590 tx=0x7f921c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd58dd6b7501771c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f911160a640 1 -- 172.21.15.138:0/1282991967 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f921c004530 con 0x56540d5c65e0 2024-02-16T10:31:09.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f911160a640 1 -- 172.21.15.138:0/1282991967 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c004690 con 0x56540d5c65e0 2024-02-16T10:31:09.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f911160a640 1 -- 172.21.15.138:0/1282991967 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f921c004950 con 0x56540d5c65e0 2024-02-16T10:31:09.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- 172.21.15.138:0/1282991967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 msgr2=0x56540d6ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:09.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 --2- 172.21.15.138:0/1282991967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f921c001590 tx=0x7f921c001a50 comp rx=0 tx=0).stop 2024-02-16T10:31:09.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- 172.21.15.138:0/1282991967 shutdown_connections 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 --2- 172.21.15.138:0/1282991967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6ae600 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- 172.21.15.138:0/1282991967 >> 172.21.15.138:0/1282991967 conn(0x56540d5c1eb0 msgr2=0x56540d6aa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- 172.21.15.138:0/1282991967 shutdown_connections 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- 172.21.15.138:0/1282991967 wait complete. 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9225c3b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56540d4d27a0 con 0x56540d5c65e0 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:39992/0 (socket says 172.21.15.138:39992) 2024-02-16T10:31:09.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 -- 172.21.15.138:0/3861662088 learned_addr learned my addr 172.21.15.138:0/3861662088 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:09.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56540d512b50 con 0x56540d5c65e0 2024-02-16T10:31:09.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f9223756640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f921c001a90 tx=0x7f921c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.900+0000 7f910fe07640 1 -- 172.21.15.138:0/3861662088 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f921c013760 con 0x56540d5c65e0 2024-02-16T10:31:09.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f910fe07640 1 -- 172.21.15.138:0/3861662088 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c0138c0 con 0x56540d5c65e0 2024-02-16T10:31:09.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f910fe07640 1 -- 172.21.15.138:0/3861662088 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f921c013ba0 con 0x56540d5c65e0 2024-02-16T10:31:09.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56540d6b5ad0 con 0x56540d5c65e0 2024-02-16T10:31:09.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56540d6b5f80 con 0x56540d5c65e0 2024-02-16T10:31:09.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f910fe07640 1 -- 172.21.15.138:0/3861662088 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f921c013d00 con 0x56540d5c65e0 2024-02-16T10:31:09.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f910fe07640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 0x7f91080367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f910fe07640 1 -- 172.21.15.138:0/3861662088 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f921c049660 con 0x56540d5c65e0 2024-02-16T10:31:09.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9222f55640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 0x7f91080367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 0x56540d6bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6bcba0 con 0x56540d6ba270 2024-02-16T10:31:09.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9223f57640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 0x56540d6bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9222f55640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 0x7f91080367c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f920c0ad000 tx=0x7f920c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9223f57640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 0x56540d6bc660 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9223f57640 1 -- 172.21.15.138:0/3861662088 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f92140083f0 con 0x56540d6ba270 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6bcf90 con 0x56540d6ba270 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9223f57640 1 -- 172.21.15.138:0/3861662088 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f92140083f0 con 0x56540d6ba270 2024-02-16T10:31:09.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.904+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6be840 con 0x56540d6ba270 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 -- 172.21.15.138:0/3861662088 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f92140083f0 con 0x56540d6ba270 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6bd980 con 0x56540d6ba270 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 -- 172.21.15.138:0/3861662088 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f92140083f0 con 0x56540d6ba270 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 0x56540d6c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6c21d0 con 0x56540d6be2a0 2024-02-16T10:31:09.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223756640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 0x56540d6c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223756640 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 0x56540d6c1bc0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223756640 1 -- 172.21.15.138:0/3861662088 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f921c024020 con 0x56540d6be2a0 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56540d46af20 con 0x56540d6d0100 2024-02-16T10:31:09.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:39996/0 (socket says 172.21.15.138:39996) 2024-02-16T10:31:09.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 -- 172.21.15.138:0/2553709101 learned_addr learned my addr 172.21.15.138:0/2553709101 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 -- 172.21.15.138:0/2553709101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56540d6d0a60 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9223f57640 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56540d6b6670 tx=0x7f921400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f910d602640 1 -- 172.21.15.138:0/2553709101 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f921400f040 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f910d602640 1 -- 172.21.15.138:0/2553709101 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214019550 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56540d6d0cb0 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f910d602640 1 -- 172.21.15.138:0/2553709101 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9214019810 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.908+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56540d6d1800 con 0x56540d6d0100 2024-02-16T10:31:09.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f910d602640 1 -- 172.21.15.138:0/2553709101 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9214019a00 con 0x56540d6d0100 2024-02-16T10:31:09.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f910d602640 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 0x7f90fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f910d602640 1 -- 172.21.15.138:0/2553709101 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f921404b560 con 0x56540d6d0100 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223756640 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 0x7f90fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223756640 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 0x7f90fc036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56540d6bd3c0 tx=0x7f921c028460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56540d45e790 con 0x56540d6dd020 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40004/0 (socket says 172.21.15.138:40004) 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223f57640 1 -- 172.21.15.138:0/3836861114 learned_addr learned my addr 172.21.15.138:0/3836861114 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223f57640 1 -- 172.21.15.138:0/3836861114 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56540d6dda10 con 0x56540d6dd020 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9223f57640 1 --2- 172.21.15.138:0/3836861114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f921400efb0 tx=0x7f921402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0aedbef2d33db1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9106ffd640 1 -- 172.21.15.138:0/3836861114 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9214048070 con 0x56540d6dd020 2024-02-16T10:31:09.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9106ffd640 1 -- 172.21.15.138:0/3836861114 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92140153a0 con 0x56540d6dd020 2024-02-16T10:31:09.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9106ffd640 1 -- 172.21.15.138:0/3836861114 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9214015cc0 con 0x56540d6dd020 2024-02-16T10:31:09.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 -- 172.21.15.138:0/3836861114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 msgr2=0x56540d6dd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:09.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3836861114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f921400efb0 tx=0x7f921402af40 comp rx=0 tx=0).stop 2024-02-16T10:31:09.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 -- 172.21.15.138:0/3836861114 shutdown_connections 2024-02-16T10:31:09.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.912+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3836861114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6dd440 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- 172.21.15.138:0/3836861114 >> 172.21.15.138:0/3836861114 conn(0x56540d6d7ba0 msgr2=0x56540d6d8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- 172.21.15.138:0/3836861114 shutdown_connections 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- 172.21.15.138:0/3836861114 wait complete. 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 Processor -- start 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- start start 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56540d6e4270 con 0x56540d6dd020 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223f57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40014/0 (socket says 172.21.15.138:40014) 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 learned_addr learned my addr 172.21.15.138:0/3817839758 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:09.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56540d6d1800 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223f57640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6e3d30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f921403e040 tx=0x7f9214049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 -- 172.21.15.138:0/3817839758 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9214018530 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 -- 172.21.15.138:0/3817839758 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214015510 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56540d6e4470 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 -- 172.21.15.138:0/3817839758 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9214049b10 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56540d6e4900 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 -- 172.21.15.138:0/3817839758 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9214032020 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90ec0342b0 0x7f90ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f91057fa640 1 -- 172.21.15.138:0/3817839758 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f9214037da0 con 0x56540d6dd020 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.916+0000 7f9223756640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90ec0342b0 0x7f90ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ef450 0x56540d6f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f2030 con 0x56540d6ef450 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ef450 0x56540d6f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223756640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90ec0342b0 0x7f90ec036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f921c000f90 tx=0x7f921c045000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ef450 0x56540d6f18e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 realm 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f2420 con 0x56540d6ef450 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f2c70 con 0x56540d6ef450 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f2fd0 con 0x56540d6ef450 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f2910 con 0x56540d6ef450 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 20 searching for the correct realm 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56540d6f5270 0x56540d6f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223f57640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56540d6f5270 0x56540d6f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223f57640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56540d6f5270 0x56540d6f76a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214042040 con 0x56540d6f5270 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223f57640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f9214022070 0x7f921403b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223756640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f9214022070 0x7f921403b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.920+0000 7f9223756640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f9214022070 0x7f921403b050 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223756640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f921c055040 0x7f921c01d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:09.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f921c055040 0x7f921c01d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:09.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f921c055040 0x7f921c01d970 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214042040 con 0x56540d6f5270 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.924+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214042040 con 0x56540d6f5270 2024-02-16T10:31:09.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.928+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f9214022070 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.932+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6f5270 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x7f921c055040 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f7d70 con 0x56540d6ef450 2024-02-16T10:31:09.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f920c0da080 con 0x7f9214022070 2024-02-16T10:31:09.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f3e30 con 0x56540d6ef450 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f3ab0 con 0x56540d6ef450 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f4700 con 0x7f9214022070 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 zone default found 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 4 Realm: () 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 zonegroup default 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f81b0 con 0x7f921c055040 2024-02-16T10:31:09.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fa030 con 0x56540d6f5270 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.936+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fa390 con 0x56540d6f5270 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 20 started sync module instance, tier type = 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:09.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6f9600 con 0x7f9214022070 2024-02-16T10:31:09.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94919002657120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fa6f0 con 0x7f9214022070 2024-02-16T10:31:09.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fb060 con 0x56540d6ef450 2024-02-16T10:31:09.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94919002657120] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94919002663872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fafe0 con 0x56540d6ef450 2024-02-16T10:31:09.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.940+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fbd90 con 0x56540d6f5270 2024-02-16T10:31:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94919002667184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fbcd0 con 0x56540d6f5270 2024-02-16T10:31:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fcc60 con 0x7f9214022070 2024-02-16T10:31:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94919002663872] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94919002666000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fd010 con 0x7f9214022070 2024-02-16T10:31:09.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.944+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fd9c0 con 0x56540d6ef450 2024-02-16T10:31:09.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94919002667184] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94919002666000] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94919002669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fd4e0 con 0x56540d6ef450 2024-02-16T10:31:09.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fe210 con 0x7f921c055040 2024-02-16T10:31:09.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.948+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94919002669376] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94919002670928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6fe170 con 0x7f921c055040 2024-02-16T10:31:09.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6feae0 con 0x7f921c055040 2024-02-16T10:31:09.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94919002670928] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94919002676704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6feae0 con 0x7f921c055040 2024-02-16T10:31:09.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.952+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6ff450 con 0x7f921c055040 2024-02-16T10:31:09.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94919002676704] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94919002679328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6ff450 con 0x7f921c055040 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=0 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=1 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=2 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=3 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=4 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=5 2024-02-16T10:31:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=6 2024-02-16T10:31:09.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94919002679328] v33'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 20 add_watcher() i=7 2024-02-16T10:31:09.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:09.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d702840 con 0x56540d6ef450 2024-02-16T10:31:09.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.956+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94919002681728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d6ffd80 con 0x56540d6ef450 2024-02-16T10:31:09.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94919002681728] v33'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f90d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:09.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9225c3b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:09.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9225c3b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:09.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7020a0 con 0x56540d6ef450 2024-02-16T10:31:09.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.960+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d701c00 con 0x7f921c055040 2024-02-16T10:31:09.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d701c00 con 0x56540d6f5270 2024-02-16T10:31:09.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70b890 con 0x56540d6ef450 2024-02-16T10:31:09.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'153 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.964+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70b890 con 0x7f9214022070 2024-02-16T10:31:09.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.968+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.968+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70c260 con 0x56540d6f5270 2024-02-16T10:31:09.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.968+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.968+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70c790 con 0x56540d6ef450 2024-02-16T10:31:09.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.972+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.972+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70c790 con 0x7f921c055040 2024-02-16T10:31:09.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.972+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.972+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70c790 con 0x7f9214022070 2024-02-16T10:31:09.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70ccc0 con 0x56540d6f5270 2024-02-16T10:31:09.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70d160 con 0x7f9214022070 2024-02-16T10:31:09.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.976+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709ee0 con 0x7f921c055040 2024-02-16T10:31:09.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.980+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.980+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f9214022070 2024-02-16T10:31:09.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.980+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.980+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a170 con 0x7f921c055040 2024-02-16T10:31:09.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.984+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'36 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:09.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.984+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6ef450 2024-02-16T10:31:09.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.984+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:09.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.984+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:09.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.988+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'39 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.988+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f9214022070 2024-02-16T10:31:09.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.988+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:09.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.988+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:09.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:09.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6ef450 2024-02-16T10:31:10.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6ef450 2024-02-16T10:31:10.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.992+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.996+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.996+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f9214022070 2024-02-16T10:31:10.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.996+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:09.996+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.000+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f921c055040 2024-02-16T10:31:10.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.004+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f921c055040 2024-02-16T10:31:10.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.008+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.008+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x56540d6f5270 2024-02-16T10:31:10.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.008+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'41 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.008+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f921c055040 2024-02-16T10:31:10.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.012+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'37 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.012+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d70a4f0 con 0x7f9214022070 2024-02-16T10:31:10.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f90d8fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 20 Filter name: none 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f90527fc640 20 reqs_thread_entry: start 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x56540d6ef450 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x56540d6ef450 2024-02-16T10:31:10.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f921c055040 2024-02-16T10:31:10.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.016+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x56540d6ef450 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.020+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.024+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f9214022070 2024-02-16T10:31:10.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f921c055040 2024-02-16T10:31:10.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.028+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f921c055040 2024-02-16T10:31:10.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d727cf0 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.032+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f921c055040 2024-02-16T10:31:10.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6ef450 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x56540d6f5270 2024-02-16T10:31:10.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(141 gc.15 [call out=1701b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708ef0 con 0x7f9214022070 2024-02-16T10:31:10.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.036+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.040+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.044+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.048+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.052+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x56540d6f5270 2024-02-16T10:31:10.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f921c055040 2024-02-16T10:31:10.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.056+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d709b20 con 0x7f9214022070 2024-02-16T10:31:10.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f90d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:10.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.060+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94919002681728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d708b00 con 0x56540d6ef450 2024-02-16T10:31:10.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94919002681728] v33'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94919002657120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x7f9214022070 2024-02-16T10:31:10.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94919002657120] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 20 remove_watcher() i=0 2024-02-16T10:31:10.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 2 removed watcher, disabling cache 2024-02-16T10:31:10.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94919002663872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x56540d6ef450 2024-02-16T10:31:10.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94919002663872] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 20 remove_watcher() i=1 2024-02-16T10:31:10.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.064+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94919002667184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x56540d6f5270 2024-02-16T10:31:10.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9223f57640 1 -- 172.21.15.138:0/3817839758 <== osd.3 v2:172.21.15.138:6800/756089529 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94919002667184] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9214060040 con 0x56540d6f5270 2024-02-16T10:31:10.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9225c3b980 20 remove_watcher() i=2 2024-02-16T10:31:10.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94919002666000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x7f9214022070 2024-02-16T10:31:10.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9223756640 1 -- 172.21.15.138:0/3817839758 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94919002666000] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f921c024020 con 0x7f9214022070 2024-02-16T10:31:10.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9225c3b980 20 remove_watcher() i=3 2024-02-16T10:31:10.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.068+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94919002669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x56540d6ef450 2024-02-16T10:31:10.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.072+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94919002669376] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x56540d6ef450 2024-02-16T10:31:10.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.072+0000 7f9225c3b980 20 remove_watcher() i=4 2024-02-16T10:31:10.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.072+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94919002670928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x7f921c055040 2024-02-16T10:31:10.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94919002670928] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9225c3b980 20 remove_watcher() i=5 2024-02-16T10:31:10.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94919002676704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x7f921c055040 2024-02-16T10:31:10.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94919002676704] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9225c3b980 20 remove_watcher() i=6 2024-02-16T10:31:10.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.076+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94919002679328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56540d7094d0 con 0x7f921c055040 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94919002679328] v33'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f920c0ab810 con 0x7f921c055040 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 20 remove_watcher() i=7 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f921c055040 msgr2=0x7f921c01d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f921c055040 0x7f921c01d970 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ef450 msgr2=0x56540d6f18e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ef450 0x56540d6f18e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f9214022070 msgr2=0x7f921403b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f9214022070 0x7f921403b050 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56540d6f5270 msgr2=0x56540d6f76a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x56540d6f5270 0x56540d6f76a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90ec0342b0 msgr2=0x7f90ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90ec0342b0 0x7f90ec036770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f921c000f90 tx=0x7f921c045000 comp rx=0 tx=0).stop 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 msgr2=0x56540d6e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3817839758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6dd020 0x56540d6e3d30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f921403e040 tx=0x7f9214049830 comp rx=0 tx=0).stop 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9222f55640 1 -- 172.21.15.138:0/3817839758 reap_dead start 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 shutdown_connections 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 >> 172.21.15.138:0/3817839758 conn(0x56540d6d7ba0 msgr2=0x56540d6d8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 shutdown_connections 2024-02-16T10:31:10.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3817839758 wait complete. 2024-02-16T10:31:10.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 msgr2=0x7f90fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 0x7f90fc036770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56540d6bd3c0 tx=0x7f921c028460 comp rx=0 tx=0).stop 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 msgr2=0x56540d6d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56540d6b6670 tx=0x7f921400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 shutdown_connections 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f90fc0342b0 0x7f90fc036770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/2553709101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d6d0100 0x56540d6d0520 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 >> 172.21.15.138:0/2553709101 conn(0x56540d6c4f10 msgr2=0x56540d6c5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 shutdown_connections 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/2553709101 wait complete. 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 msgr2=0x56540d6bc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 0x56540d6bc660 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 msgr2=0x56540d6c1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 0x56540d6c1bc0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 msgr2=0x7f91080367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 0x7f91080367c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f920c0ad000 tx=0x7f920c0a5040 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 msgr2=0x56540d6b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f921c001a90 tx=0x7f921c001260 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 shutdown_connections 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56540d6be2a0 0x56540d6c1bc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56540d6ba270 0x56540d6bc660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9108034300 0x7f91080367c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 --2- 172.21.15.138:0/3861662088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56540d5c65e0 0x56540d6b5590 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 >> 172.21.15.138:0/3861662088 conn(0x56540d5c1eb0 msgr2=0x56540d6a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 shutdown_connections 2024-02-16T10:31:10.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.080+0000 7f9225c3b980 1 -- 172.21.15.138:0/3861662088 wait complete. 2024-02-16T10:31:10.104 INFO:teuthology.orchestra.run.smithi138.stdout:[{"tag":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.6414560404946461168\u0000","time":"2024-02-16T10:31:09.836010+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_7","key":"","instance":""}]}] 2024-02-16T10:31:10.105 DEBUG:tasks.util.rgw: json result: [{'tag': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.6414560404946461168\x00', 'time': '2024-02-16T10:31:09.836010+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_7', 'key': '', 'instance': ''}]}] 2024-02-16T10:31:10.105 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-02-16T10:31:10.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-02-16T10:31:10.105 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-02-16T10:31:10.181 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:10.181 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:10.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1cab67b980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5622c6a49b90 0x5622c6a49f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1cab67b980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5622c6993b40 con 0x5622c6a4aa50 2024-02-16T10:31:10.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1cab67b980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5622c695ad30 con 0x5622c6a49b90 2024-02-16T10:31:10.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1ca9196640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5622c6a49b90 0x5622c6a49f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1ca9196640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5622c6a49b90 0x5622c6a49f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40024/0 (socket says 172.21.15.138:40024) 2024-02-16T10:31:10.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1ca9196640 1 -- 172.21.15.138:0/3291357936 learned_addr learned my addr 172.21.15.138:0/3291357936 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1ca9196640 1 -- 172.21.15.138:0/3291357936 >> v1:172.21.15.107:6789/0 conn(0x5622c6a4aa50 legacy=0x5622c6a4ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.176+0000 7f1ca9196640 1 -- 172.21.15.138:0/3291357936 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622c6a4a660 con 0x5622c6a49b90 2024-02-16T10:31:10.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1ca9196640 1 --2- 172.21.15.138:0/3291357936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6a49f70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400a4e0 tx=0x7f1ca401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ed5e35efd332ad server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1c9bfff640 1 -- 172.21.15.138:0/3291357936 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40aa540 con 0x5622c6a49b90 2024-02-16T10:31:10.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1c9bfff640 1 -- 172.21.15.138:0/3291357936 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40a6070 con 0x5622c6a49b90 2024-02-16T10:31:10.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1c9bfff640 1 -- 172.21.15.138:0/3291357936 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40aa850 con 0x5622c6a49b90 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 -- 172.21.15.138:0/3291357936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 msgr2=0x5622c6a49f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3291357936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6a49f70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400a4e0 tx=0x7f1ca401b090 comp rx=0 tx=0).stop 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 -- 172.21.15.138:0/3291357936 shutdown_connections 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3291357936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6a49f70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 -- 172.21.15.138:0/3291357936 >> 172.21.15.138:0/3291357936 conn(0x5622c69bcf30 msgr2=0x5622c69bd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 -- 172.21.15.138:0/3291357936 shutdown_connections 2024-02-16T10:31:10.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.180+0000 7f1cab67b980 1 -- 172.21.15.138:0/3291357936 wait complete. 2024-02-16T10:31:10.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1cab67b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1cab67b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622c6957fc0 con 0x5622c6a49b90 2024-02-16T10:31:10.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1ca9196640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1ca9196640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40028/0 (socket says 172.21.15.138:40028) 2024-02-16T10:31:10.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1ca9196640 1 -- 172.21.15.138:0/384934100 learned_addr learned my addr 172.21.15.138:0/384934100 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1ca9196640 1 -- 172.21.15.138:0/384934100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca400a1c0 con 0x5622c6a49b90 2024-02-16T10:31:10.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1ca9196640 1 --2- 172.21.15.138:0/384934100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4017ca0 tx=0x7f1ca40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b17f3a7169c88f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1b97606640 1 -- 172.21.15.138:0/384934100 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40aa700 con 0x5622c6a49b90 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1b97606640 1 -- 172.21.15.138:0/384934100 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40aa860 con 0x5622c6a49b90 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.196+0000 7f1b97606640 1 -- 172.21.15.138:0/384934100 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40aab40 con 0x5622c6a49b90 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/384934100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 msgr2=0x5622c6b33cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 --2- 172.21.15.138:0/384934100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4017ca0 tx=0x7f1ca40033b0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/384934100 shutdown_connections 2024-02-16T10:31:10.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 --2- 172.21.15.138:0/384934100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b33cb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/384934100 >> 172.21.15.138:0/384934100 conn(0x5622c69bcf30 msgr2=0x5622c6b2f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/384934100 shutdown_connections 2024-02-16T10:31:10.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/384934100 wait complete. 2024-02-16T10:31:10.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622c69537a0 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1ca9196640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1ca9196640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40044/0 (socket says 172.21.15.138:40044) 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1ca9196640 1 -- 172.21.15.138:0/2454884122 learned_addr learned my addr 172.21.15.138:0/2454884122 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1ca9196640 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622c6a4a660 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1ca401b930 tx=0x7f1ca4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1b95e03640 1 -- 172.21.15.138:0/2454884122 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40bd580 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622c6b3afc0 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1b95e03640 1 -- 172.21.15.138:0/2454884122 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40bd6e0 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1b95e03640 1 -- 172.21.15.138:0/2454884122 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ca40bd980 con 0x5622c6a49b90 2024-02-16T10:31:10.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.200+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622c6b3b410 con 0x5622c6a49b90 2024-02-16T10:31:10.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1b95e03640 1 -- 172.21.15.138:0/2454884122 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1ca40c6030 con 0x5622c6a49b90 2024-02-16T10:31:10.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1b95e03640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 0x7f1b90036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1b95e03640 1 -- 172.21.15.138:0/2454884122 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1ca40e4890 con 0x5622c6a49b90 2024-02-16T10:31:10.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 0x7f1b90036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 0x5622c6b41770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b41cb0 con 0x5622c6a4aa50 2024-02-16T10:31:10.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 0x5622c6b41770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 0x7f1b90036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001e20 tx=0x7f1ca00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 0x5622c6b41770 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 -- 172.21.15.138:0/2454884122 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c9c0083f0 con 0x5622c6a4aa50 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b42050 con 0x5622c6a4aa50 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 -- 172.21.15.138:0/2454884122 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c9c0083f0 con 0x5622c6a4aa50 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b43900 con 0x5622c6a4aa50 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 -- 172.21.15.138:0/2454884122 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1c9c0083f0 con 0x5622c6a4aa50 2024-02-16T10:31:10.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b42b00 con 0x5622c6a4aa50 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9997640 1 -- 172.21.15.138:0/2454884122 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c9c0083f0 con 0x5622c6a4aa50 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 0x5622c6b46c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b47290 con 0x5622c6b43420 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 0x5622c6b46c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 0x5622c6b46c80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1ca9196640 1 -- 172.21.15.138:0/2454884122 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1ca40c0a60 con 0x5622c6b43420 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.204+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622c68ebf20 con 0x5622c6b551e0 2024-02-16T10:31:10.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40056/0 (socket says 172.21.15.138:40056) 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9997640 1 -- 172.21.15.138:0/3117570186 learned_addr learned my addr 172.21.15.138:0/3117570186 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9997640 1 -- 172.21.15.138:0/3117570186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622c6b55b40 con 0x5622c6b551e0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9997640 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x5622c6b3bb60 tx=0x7f1c9c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 -- 172.21.15.138:0/3117570186 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c00f040 con 0x5622c6b551e0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 -- 172.21.15.138:0/3117570186 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c019550 con 0x5622c6b551e0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622c6b55d90 con 0x5622c6b551e0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 -- 172.21.15.138:0/3117570186 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c019810 con 0x5622c6b551e0 2024-02-16T10:31:10.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622c6b568e0 con 0x5622c6b551e0 2024-02-16T10:31:10.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 -- 172.21.15.138:0/3117570186 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1c9c019a00 con 0x5622c6b551e0 2024-02-16T10:31:10.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 0x7f1b80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1b8effd640 1 -- 172.21.15.138:0/3117570186 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1c9c04b560 con 0x5622c6b551e0 2024-02-16T10:31:10.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9196640 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 0x7f1b80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.208+0000 7f1ca9196640 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 0x7f1b80036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5622c6b42540 tx=0x7f1ca40be3a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622c68df790 con 0x5622c6b620f0 2024-02-16T10:31:10.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40062/0 (socket says 172.21.15.138:40062) 2024-02-16T10:31:10.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 -- 172.21.15.138:0/600619299 learned_addr learned my addr 172.21.15.138:0/600619299 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 -- 172.21.15.138:0/600619299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622c6b62aa0 con 0x5622c6b620f0 2024-02-16T10:31:10.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 --2- 172.21.15.138:0/600619299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00efb0 tx=0x7f1c9c02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5dc7f3d0716d1f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1b8cff9640 1 -- 172.21.15.138:0/600619299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c048070 con 0x5622c6b620f0 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1b8cff9640 1 -- 172.21.15.138:0/600619299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0153a0 con 0x5622c6b620f0 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1b8cff9640 1 -- 172.21.15.138:0/600619299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c015cc0 con 0x5622c6b620f0 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- 172.21.15.138:0/600619299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 msgr2=0x5622c6b624d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 --2- 172.21.15.138:0/600619299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00efb0 tx=0x7f1c9c02af40 comp rx=0 tx=0).stop 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- 172.21.15.138:0/600619299 shutdown_connections 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 --2- 172.21.15.138:0/600619299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b624d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- 172.21.15.138:0/600619299 >> 172.21.15.138:0/600619299 conn(0x5622c6b5ccc0 msgr2=0x5622c6b5dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- 172.21.15.138:0/600619299 shutdown_connections 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- 172.21.15.138:0/600619299 wait complete. 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 Processor -- start 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- start start 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b68e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1cab67b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622c6b693c0 con 0x5622c6b620f0 2024-02-16T10:31:10.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b68e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b68e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40070/0 (socket says 172.21.15.138:40070) 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 learned_addr learned my addr 172.21.15.138:0/2430729054 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.212+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622c6b568e0 con 0x5622c6b620f0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b68e80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c048770 tx=0x7f1c9c049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 -- 172.21.15.138:0/2430729054 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c018530 con 0x5622c6b620f0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622c6b695c0 con 0x5622c6b620f0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 -- 172.21.15.138:0/2430729054 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c015510 con 0x5622c6b620f0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 -- 172.21.15.138:0/2430729054 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c9c049b30 con 0x5622c6b620f0 2024-02-16T10:31:10.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622c6b69a50 con 0x5622c6b620f0 2024-02-16T10:31:10.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 -- 172.21.15.138:0/2430729054 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1c9c042050 con 0x5622c6b620f0 2024-02-16T10:31:10.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b74034300 0x7f1b740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1b7effd640 1 -- 172.21.15.138:0/2430729054 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1c9c035d10 con 0x5622c6b620f0 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b74034300 0x7f1b740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6b74550 0x5622c6b76a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b77160 con 0x5622c6b74550 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6b74550 0x5622c6b76a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b74034300 0x7f1b740367c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40be410 tx=0x7f1ca40e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6b74550 0x5622c6b76a10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 realm 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b739b0 con 0x5622c6b74550 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b77be0 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.216+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b78460 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b787c0 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:10.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 20 searching for the correct realm 2024-02-16T10:31:10.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5622c6b7a880 0x5622c6b7cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5622c6b7a880 0x5622c6b7cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5622c6b7a880 0x5622c6b7cd40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9997640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1c9c022070 0x7f1c9c022890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1c9c022070 0x7f1c9c022890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1c9c022070 0x7f1c9c022890 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca40c0a60 con 0x7f1c9c022070 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9196640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ca40bd070 0x7f1ca40c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ca40bd070 0x7f1ca40c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.220+0000 7f1ca8995640 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ca40bd070 0x7f1ca40c0420 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.224+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.228+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b7a880 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1ca40bd070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x5622c6b74550 2024-02-16T10:31:10.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.232+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d410 con 0x7f1c9c022070 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b79e10 con 0x5622c6b74550 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b79630 con 0x5622c6b74550 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7d850 con 0x7f1c9c022070 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 zone default found 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 4 Realm: () 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:10.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 zonegroup default 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7dbb0 con 0x7f1ca40bd070 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7fe10 con 0x5622c6b7a880 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80170 con 0x5622c6b7a880 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 started sync module instance, tier type = 2024-02-16T10:31:10.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:10.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.236+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7f3e0 con 0x7f1c9c022070 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707362819904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80170 con 0x7f1c9c022070 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80ae0 con 0x5622c6b74550 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707362819904] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707362825792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80a60 con 0x5622c6b74550 2024-02-16T10:31:10.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.240+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b81810 con 0x5622c6b7a880 2024-02-16T10:31:10.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707362825792] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707362827920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b81750 con 0x5622c6b7a880 2024-02-16T10:31:10.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b821d0 con 0x7f1c9c022070 2024-02-16T10:31:10.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707362831664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b82150 con 0x7f1c9c022070 2024-02-16T10:31:10.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b83090 con 0x5622c6b74550 2024-02-16T10:31:10.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707362827920] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.244+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707362831664] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707362833792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b83050 con 0x5622c6b74550 2024-02-16T10:31:10.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b838e0 con 0x7f1ca40bd070 2024-02-16T10:31:10.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707362833792] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707362835344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b834f0 con 0x7f1ca40bd070 2024-02-16T10:31:10.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.248+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b83e60 con 0x7f1ca40bd070 2024-02-16T10:31:10.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707362835344] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707362836560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b83e60 con 0x7f1ca40bd070 2024-02-16T10:31:10.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b847d0 con 0x7f1ca40bd070 2024-02-16T10:31:10.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707362836560] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707362839248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b847d0 con 0x7f1ca40bd070 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=0 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=1 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=2 2024-02-16T10:31:10.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=3 2024-02-16T10:31:10.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=4 2024-02-16T10:31:10.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=5 2024-02-16T10:31:10.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.252+0000 7f1cab67b980 20 add_watcher() i=6 2024-02-16T10:31:10.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707362839248] v33'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 20 add_watcher() i=7 2024-02-16T10:31:10.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:10.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b87b90 con 0x5622c6b74550 2024-02-16T10:31:10.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707362841856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b850d0 con 0x5622c6b74550 2024-02-16T10:31:10.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707362841856] v33'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1b5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:10.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:10.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:10.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.256+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b901d0 con 0x5622c6b74550 2024-02-16T10:31:10.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.260+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.260+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b90690 con 0x7f1ca40bd070 2024-02-16T10:31:10.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.260+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.260+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b90b30 con 0x5622c6b7a880 2024-02-16T10:31:10.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8e220 con 0x5622c6b74550 2024-02-16T10:31:10.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'158 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8e220 con 0x7f1c9c022070 2024-02-16T10:31:10.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.264+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b91870 con 0x5622c6b7a880 2024-02-16T10:31:10.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.268+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.268+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b91da0 con 0x5622c6b74550 2024-02-16T10:31:10.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.268+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.268+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8e120 con 0x7f1ca40bd070 2024-02-16T10:31:10.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.272+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.272+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8e120 con 0x7f1c9c022070 2024-02-16T10:31:10.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.272+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.272+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92410 con 0x5622c6b7a880 2024-02-16T10:31:10.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.272+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.276+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b928b0 con 0x7f1c9c022070 2024-02-16T10:31:10.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.276+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.276+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d210 con 0x7f1ca40bd070 2024-02-16T10:31:10.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.276+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.276+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1c9c022070 2024-02-16T10:31:10.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.280+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.280+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1ca40bd070 2024-02-16T10:31:10.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.280+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'38 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.280+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b74550 2024-02-16T10:31:10.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.284+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.284+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.284+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'42 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.284+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1c9c022070 2024-02-16T10:31:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b74550 2024-02-16T10:31:10.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.288+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b74550 2024-02-16T10:31:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.292+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.292+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.292+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.292+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1c9c022070 2024-02-16T10:31:10.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.296+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.300+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.300+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.300+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.300+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1ca40bd070 2024-02-16T10:31:10.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.304+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.304+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.304+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.304+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1ca40bd070 2024-02-16T10:31:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.308+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.308+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x5622c6b7a880 2024-02-16T10:31:10.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.308+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'44 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.308+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1ca40bd070 2024-02-16T10:31:10.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.312+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'39 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.312+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8d820 con 0x7f1c9c022070 2024-02-16T10:31:10.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.312+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.312+0000 7f1b5e7e4640 20 reqs_thread_entry: start 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.312+0000 7f1cab67b980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 20 Filter name: none 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1acffff640 20 reqs_thread_entry: start 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-02-16T10:31:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 gc.0 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.316+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(99 gc.0 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-02-16T10:31:10.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.320+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(100 gc.1 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.324+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(105 gc.1 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-02-16T10:31:10.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(106 gc.2 [call] v33'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.328+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(111 gc.2 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-02-16T10:31:10.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(112 gc.3 [call] v33'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.332+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(117 gc.3 [call] v33'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-02-16T10:31:10.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.336+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(118 gc.4 [call] v33'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(123 gc.4 [call] v33'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-02-16T10:31:10.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.340+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(124 gc.5 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(128 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(129 gc.5 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-02-16T10:31:10.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.344+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== osd_op_reply(130 gc.6 [call] v33'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(131 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== osd_op_reply(132 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(134 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.348+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.352+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(135 gc.6 [call] v33'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.352+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-02-16T10:31:10.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.352+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(136 gc.7 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(137 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(138 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== osd_op_reply(140 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.356+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(141 gc.7 [call] v33'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-02-16T10:31:10.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(142 gc.8 [call] v33'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(143 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(144 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.360+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(146 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(147 gc.8 [call] v33'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-02-16T10:31:10.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.364+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(148 gc.9 [call] v33'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(149 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(150 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(152 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.368+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 43 ==== osd_op_reply(153 gc.9 [call] v33'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-02-16T10:31:10.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(154 gc.10 [call] v33'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(155 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(156 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(158 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.372+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:159 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== osd_op_reply(159 gc.10 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-02-16T10:31:10.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(160 gc.11 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(161 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.376+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:162 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(162 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:163 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(163 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:164 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(164 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.380+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:165 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(165 gc.11 [call] v33'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-02-16T10:31:10.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(166 gc.12 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(167 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:168 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(168 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.384+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:169 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== osd_op_reply(169 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:170 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(170 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:171 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1c9c022070 2024-02-16T10:31:10.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 43 ==== osd_op_reply(171 gc.12 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-02-16T10:31:10.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.388+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(172 gc.13 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(173 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:174 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(174 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.392+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:175 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== osd_op_reply(175 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:176 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(176 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.396+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:177 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x7f1ca40bd070 2024-02-16T10:31:10.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== osd_op_reply(177 gc.13 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-02-16T10:31:10.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(178 gc.14 [call] v33'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(179 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:180 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(180 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:181 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 50 ==== osd_op_reply(181 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.400+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:182 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 51 ==== osd_op_reply(182 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:183 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b74550 2024-02-16T10:31:10.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 52 ==== osd_op_reply(183 gc.14 [call] v33'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-02-16T10:31:10.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.404+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 44 ==== osd_op_reply(184 gc.15 [call] v33'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 45 ==== osd_op_reply(185 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:186 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 46 ==== osd_op_reply(186 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:187 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 47 ==== osd_op_reply(187 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:188 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b92ec0 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 48 ==== osd_op_reply(188 gc.15 [call out=1701b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 20 garbage collection: RGWGC::process iterating over entry tag='56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.6414560404946461168', time=2024-02-16T10:31:09.836010+0000, chain.objs.size()=7 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_1 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:189 3.22s0 3:45f1f8cb:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae5c0 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_2 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:190 3.3bs0 3:dce4f1dc:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb0f20 con 0x5622c6b7a880 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_3 2024-02-16T10:31:10.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:191 3.19s0 3:98130bed:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb37e0 con 0x5622c6b74550 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_4 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:192 3.24s0 3:247efa25:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb6000 con 0x7f1ca40bd070 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_5 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:193 3.3fs0 3:fc56fed9:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb8820 con 0x7f1c9c022070 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_6 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:194 3.13s0 3:c85a40ff:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bbb100 con 0x5622c6b7a880 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_7 2024-02-16T10:31:10.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.408+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:195 3.3bs0 3:dd374a23:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb8820 con 0x5622c6b7a880 2024-02-16T10:31:10.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.412+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 49 ==== osd_op_reply(190 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_2 [call] v33'3 uv3 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.412+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 50 ==== osd_op_reply(189 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_1 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 53 ==== osd_op_reply(191 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_3 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 46 ==== osd_op_reply(192 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_4 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 44 ==== osd_op_reply(193 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_5 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 51 ==== osd_op_reply(194 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_6 [call] v33'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 52 ==== osd_op_reply(195 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.1__shadow_.BDFZWFTeemvV3m6YcIlZDu7D3h1dsW9_7 [call] v33'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1cab67b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-02-16T10:31:10.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.416+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:196 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb12e0 con 0x5622c6b7a880 2024-02-16T10:31:10.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.424+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 53 ==== osd_op_reply(196 gc.15 [call] v33'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.424+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:197 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb12e0 con 0x5622c6b7a880 2024-02-16T10:31:10.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.424+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 54 ==== osd_op_reply(197 gc.15 [call] v33'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.424+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-02-16T10:31:10.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.424+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:198 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb12e0 con 0x7f1c9c022070 2024-02-16T10:31:10.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 45 ==== osd_op_reply(198 gc.16 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:199 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bb12e0 con 0x7f1c9c022070 2024-02-16T10:31:10.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 46 ==== osd_op_reply(199 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:200 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8c0a0 con 0x7f1c9c022070 2024-02-16T10:31:10.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 47 ==== osd_op_reply(200 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:201 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 48 ==== osd_op_reply(201 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:202 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 49 ==== osd_op_reply(202 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:203 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.428+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 50 ==== osd_op_reply(203 gc.16 [call] v33'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-02-16T10:31:10.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:204 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 55 ==== osd_op_reply(204 gc.17 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:205 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 56 ==== osd_op_reply(205 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:206 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 57 ==== osd_op_reply(206 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:207 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 58 ==== osd_op_reply(207 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:208 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 59 ==== osd_op_reply(208 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.432+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:209 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 60 ==== osd_op_reply(209 gc.17 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-02-16T10:31:10.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 54 ==== osd_op_reply(210 gc.18 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 55 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 56 ==== osd_op_reply(212 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.436+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 57 ==== osd_op_reply(213 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:214 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 58 ==== osd_op_reply(214 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:215 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 59 ==== osd_op_reply(215 gc.18 [call] v33'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-02-16T10:31:10.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.440+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 60 ==== osd_op_reply(216 gc.19 [call] v33'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 61 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 62 ==== osd_op_reply(218 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 63 ==== osd_op_reply(219 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:220 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 64 ==== osd_op_reply(220 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.444+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:221 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 65 ==== osd_op_reply(221 gc.19 [call] v33'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-02-16T10:31:10.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 61 ==== osd_op_reply(222 gc.20 [call] v33'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 62 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.448+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 63 ==== osd_op_reply(224 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 64 ==== osd_op_reply(225 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:226 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 65 ==== osd_op_reply(226 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:227 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 66 ==== osd_op_reply(227 gc.20 [call] v33'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-02-16T10:31:10.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.452+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 51 ==== osd_op_reply(228 gc.21 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 52 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 53 ==== osd_op_reply(230 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 54 ==== osd_op_reply(231 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:232 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 55 ==== osd_op_reply(232 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.456+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:233 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 56 ==== osd_op_reply(233 gc.21 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-02-16T10:31:10.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 67 ==== osd_op_reply(234 gc.22 [call] v33'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 68 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 69 ==== osd_op_reply(236 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 70 ==== osd_op_reply(237 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 71 ==== osd_op_reply(238 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.460+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 72 ==== osd_op_reply(239 gc.22 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-02-16T10:31:10.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 73 ==== osd_op_reply(240 gc.23 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 74 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.464+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 75 ==== osd_op_reply(242 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 76 ==== osd_op_reply(243 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 77 ==== osd_op_reply(244 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 78 ==== osd_op_reply(245 gc.23 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-02-16T10:31:10.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.468+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 79 ==== osd_op_reply(246 gc.24 [call] v33'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 80 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 81 ==== osd_op_reply(248 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 82 ==== osd_op_reply(249 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 83 ==== osd_op_reply(250 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.472+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 84 ==== osd_op_reply(251 gc.24 [call] v33'18 uv18 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-02-16T10:31:10.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 85 ==== osd_op_reply(252 gc.25 [call] v33'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 86 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 87 ==== osd_op_reply(254 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 88 ==== osd_op_reply(255 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:256 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 89 ==== osd_op_reply(256 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.476+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:257 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.480+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 90 ==== osd_op_reply(257 gc.25 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.480+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-02-16T10:31:10.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.480+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.480+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 47 ==== osd_op_reply(258 gc.26 [call] v33'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.480+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 48 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 49 ==== osd_op_reply(260 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 50 ==== osd_op_reply(261 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 51 ==== osd_op_reply(262 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.484+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 52 ==== osd_op_reply(263 gc.26 [call] v33'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-02-16T10:31:10.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 91 ==== osd_op_reply(264 gc.27 [call] v33'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.488+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 92 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b8c0a0 con 0x5622c6b7a880 2024-02-16T10:31:10.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 93 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 94 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 95 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 96 ==== osd_op_reply(269 gc.27 [call] v33'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-02-16T10:31:10.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.492+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 53 ==== osd_op_reply(270 gc.28 [call] v33'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 54 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 55 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.496+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 56 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 57 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.500+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.504+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 58 ==== osd_op_reply(275 gc.28 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.504+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-02-16T10:31:10.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.504+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.504+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 97 ==== osd_op_reply(276 gc.29 [call] v33'50 uv50 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.504+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 98 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 99 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 100 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 101 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.508+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b7a880 2024-02-16T10:31:10.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.512+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 102 ==== osd_op_reply(281 gc.29 [call] v33'51 uv51 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.512+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-02-16T10:31:10.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.512+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 59 ==== osd_op_reply(282 gc.30 [call] v33'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 60 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 61 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.516+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 62 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 63 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.520+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1ca40bd070 2024-02-16T10:31:10.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.524+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 64 ==== osd_op_reply(287 gc.30 [call] v33'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.524+0000 7f1cab67b980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-02-16T10:31:10.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.524+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.524+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 57 ==== osd_op_reply(288 gc.31 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.524+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 58 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 59 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 60 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:31:10.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 61 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:31:10.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.528+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.532+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 62 ==== osd_op_reply(293 gc.31 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.532+0000 7f1b5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:10.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.532+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707362841856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x5622c6b74550 2024-02-16T10:31:10.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94707362841856] v33'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707362819904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6bae920 con 0x7f1c9c022070 2024-02-16T10:31:10.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94707362819904] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1cab67b980 20 remove_watcher() i=0 2024-02-16T10:31:10.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1cab67b980 2 removed watcher, disabling cache 2024-02-16T10:31:10.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.536+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707362825792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7ef40 con 0x5622c6b74550 2024-02-16T10:31:10.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.540+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94707362825792] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.540+0000 7f1cab67b980 20 remove_watcher() i=1 2024-02-16T10:31:10.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.540+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707362827920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7ef40 con 0x5622c6b7a880 2024-02-16T10:31:10.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1ca9997640 1 -- 172.21.15.138:0/2430729054 <== osd.3 v2:172.21.15.138:6800/756089529 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94707362827920] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c9c012070 con 0x5622c6b7a880 2024-02-16T10:31:10.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1cab67b980 20 remove_watcher() i=2 2024-02-16T10:31:10.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707362831664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80e90 con 0x7f1c9c022070 2024-02-16T10:31:10.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1ca9196640 1 -- 172.21.15.138:0/2430729054 <== osd.2 v2:172.21.15.138:6815/3134970710 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94707362831664] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca40fa040 con 0x7f1c9c022070 2024-02-16T10:31:10.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1cab67b980 20 remove_watcher() i=3 2024-02-16T10:31:10.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.544+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707362833792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7ef40 con 0x5622c6b74550 2024-02-16T10:31:10.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.1 v2:172.21.15.138:6802/802812406 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94707362833792] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x5622c6b74550 2024-02-16T10:31:10.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1cab67b980 20 remove_watcher() i=4 2024-02-16T10:31:10.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707362835344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b81d30 con 0x7f1ca40bd070 2024-02-16T10:31:10.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94707362835344] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1cab67b980 20 remove_watcher() i=5 2024-02-16T10:31:10.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.548+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707362836560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b80e90 con 0x7f1ca40bd070 2024-02-16T10:31:10.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.552+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94707362836560] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.552+0000 7f1cab67b980 20 remove_watcher() i=6 2024-02-16T10:31:10.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.552+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707362839248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5622c6b7ef40 con 0x7f1ca40bd070 2024-02-16T10:31:10.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 <== osd.0 v2:172.21.15.107:6800/1630367885 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94707362839248] v33'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1ca00105b0 con 0x7f1ca40bd070 2024-02-16T10:31:10.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 20 remove_watcher() i=7 2024-02-16T10:31:10.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ca40bd070 msgr2=0x7f1ca40c0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1ca40bd070 0x7f1ca40c0420 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6b74550 msgr2=0x5622c6b76a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6b74550 0x5622c6b76a10 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1c9c022070 msgr2=0x7f1c9c022890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1c9c022070 0x7f1c9c022890 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5622c6b7a880 msgr2=0x5622c6b7cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5622c6b7a880 0x5622c6b7cd40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b74034300 msgr2=0x7f1b740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b74034300 0x7f1b740367c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40be410 tx=0x7f1ca40e0000 comp rx=0 tx=0).stop 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 msgr2=0x5622c6b68e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2430729054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b620f0 0x5622c6b68e80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c048770 tx=0x7f1c9c049830 comp rx=0 tx=0).stop 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1ca8995640 1 -- 172.21.15.138:0/2430729054 reap_dead start 2024-02-16T10:31:10.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 shutdown_connections 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 >> 172.21.15.138:0/2430729054 conn(0x5622c6b5ccc0 msgr2=0x5622c6b5dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 shutdown_connections 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2430729054 wait complete. 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 msgr2=0x7f1b80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 0x7f1b80036770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5622c6b42540 tx=0x7f1ca40be3a0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 msgr2=0x5622c6b55600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x5622c6b3bb60 tx=0x7f1c9c00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 shutdown_connections 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b800342b0 0x7f1b80036770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/3117570186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6b551e0 0x5622c6b55600 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 >> 172.21.15.138:0/3117570186 conn(0x5622c6b49ff0 msgr2=0x5622c6b4ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 shutdown_connections 2024-02-16T10:31:10.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/3117570186 wait complete. 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 msgr2=0x5622c6b41770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.556+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 0x5622c6b41770 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 msgr2=0x5622c6b46c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 0x5622c6b46c80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 msgr2=0x7f1b90036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 0x7f1b90036770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001e20 tx=0x7f1ca00013a0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 msgr2=0x5622c6b3aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1ca401b930 tx=0x7f1ca4017e30 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 shutdown_connections 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5622c6b43420 0x5622c6b46c80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5622c6a4aa50 0x5622c6b41770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f1b900342b0 0x7f1b90036770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 --2- 172.21.15.138:0/2454884122 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5622c6a49b90 0x5622c6b3aa80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 >> 172.21.15.138:0/2454884122 conn(0x5622c69bcf30 msgr2=0x5622c6b2e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 shutdown_connections 2024-02-16T10:31:10.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.560+0000 7f1cab67b980 1 -- 172.21.15.138:0/2454884122 wait complete. 2024-02-16T10:31:10.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-02-16T10:31:10.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-02-16T10:31:10.581 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-02-16T10:31:10.656 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:10.656 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:10.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.648+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.648+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.648+0000 7f7586c3f980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8588fa7d0 0x55a8588fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f7586c3f980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a858844b50 con 0x55a8588fb0f0 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f7586c3f980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a85880bd30 con 0x55a8588fa7d0 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f758475a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8588fa7d0 0x55a8588fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f758475a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a8588fa7d0 0x55a8588fabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40078/0 (socket says 172.21.15.138:40078) 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f758475a640 1 -- 172.21.15.138:0/1397738003 learned_addr learned my addr 172.21.15.138:0/1397738003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f7583f59640 1 --1- 172.21.15.138:0/1397738003 >> v1:172.21.15.107:6789/0 conn(0x55a8588fb0f0 0x55a8588fbaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37136/0 (socket says 172.21.15.138:37136) 2024-02-16T10:31:10.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f758475a640 1 -- 172.21.15.138:0/1397738003 >> v1:172.21.15.107:6789/0 conn(0x55a8588fb0f0 legacy=0x55a8588fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.652+0000 7f758475a640 1 -- 172.21.15.138:0/1397738003 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8588fc2d0 con 0x55a8588fa7d0 2024-02-16T10:31:10.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f758475a640 1 --2- 172.21.15.138:0/1397738003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8588fabb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a4e0 tx=0x7f757c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec78a83c19059da server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7583758640 1 -- 172.21.15.138:0/1397738003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0aa540 con 0x55a8588fa7d0 2024-02-16T10:31:10.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7583758640 1 -- 172.21.15.138:0/1397738003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0a6070 con 0x55a8588fa7d0 2024-02-16T10:31:10.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7583758640 1 -- 172.21.15.138:0/1397738003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0aa850 con 0x55a8588fa7d0 2024-02-16T10:31:10.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 -- 172.21.15.138:0/1397738003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 msgr2=0x55a8588fabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 --2- 172.21.15.138:0/1397738003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8588fabb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a4e0 tx=0x7f757c01b090 comp rx=0 tx=0).stop 2024-02-16T10:31:10.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 -- 172.21.15.138:0/1397738003 shutdown_connections 2024-02-16T10:31:10.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 --2- 172.21.15.138:0/1397738003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8588fabb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 -- 172.21.15.138:0/1397738003 >> 172.21.15.138:0/1397738003 conn(0x55a85886def0 msgr2=0x55a85886e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 -- 172.21.15.138:0/1397738003 shutdown_connections 2024-02-16T10:31:10.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.656+0000 7f7586c3f980 1 -- 172.21.15.138:0/1397738003 wait complete. 2024-02-16T10:31:10.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a858808fc0 con 0x55a8588fa7d0 2024-02-16T10:31:10.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f758475a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f758475a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40084/0 (socket says 172.21.15.138:40084) 2024-02-16T10:31:10.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f758475a640 1 -- 172.21.15.138:0/899318521 learned_addr learned my addr 172.21.15.138:0/899318521 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f758475a640 1 -- 172.21.15.138:0/899318521 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c00a1c0 con 0x55a8588fa7d0 2024-02-16T10:31:10.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f758475a640 1 --2- 172.21.15.138:0/899318521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f757c019740 tx=0x7f757c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b10b28a3e329414 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f747260c640 1 -- 172.21.15.138:0/899318521 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0aa6f0 con 0x55a8588fa7d0 2024-02-16T10:31:10.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f747260c640 1 -- 172.21.15.138:0/899318521 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0aa850 con 0x55a8588fa7d0 2024-02-16T10:31:10.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f747260c640 1 -- 172.21.15.138:0/899318521 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0aaaf0 con 0x55a8588fa7d0 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 -- 172.21.15.138:0/899318521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 msgr2=0x55a8589e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.672+0000 7f7586c3f980 1 --2- 172.21.15.138:0/899318521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f757c019740 tx=0x7f757c0033b0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/899318521 shutdown_connections 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 --2- 172.21.15.138:0/899318521 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589e4de0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/899318521 >> 172.21.15.138:0/899318521 conn(0x55a85886def0 msgr2=0x55a8589e0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/899318521 shutdown_connections 2024-02-16T10:31:10.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/899318521 wait complete. 2024-02-16T10:31:10.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8588047a0 con 0x55a8588fa7d0 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f758475a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f758475a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40094/0 (socket says 172.21.15.138:40094) 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f758475a640 1 -- 172.21.15.138:0/654886127 learned_addr learned my addr 172.21.15.138:0/654886127 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f758475a640 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8588fc2d0 con 0x55a8588fa7d0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f758475a640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f757c019740 tx=0x7f757c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 -- 172.21.15.138:0/654886127 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0c4070 con 0x55a8588fa7d0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 -- 172.21.15.138:0/654886127 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0b5570 con 0x55a8588fa7d0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a8589ec090 con 0x55a8588fa7d0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 -- 172.21.15.138:0/654886127 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c0b5810 con 0x55a8588fa7d0 2024-02-16T10:31:10.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8589ec540 con 0x55a8588fa7d0 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 -- 172.21.15.138:0/654886127 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f757c0a8070 con 0x55a8588fa7d0 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 0x7f746c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7470e09640 1 -- 172.21.15.138:0/654886127 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f757c0e3d90 con 0x55a8588fa7d0 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7583f59640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 0x7f746c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 0x55a8589f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.676+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a8589f2d80 con 0x55a8588fb0f0 2024-02-16T10:31:10.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 0x55a8589f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7583f59640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 0x7f746c036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7578001e50 tx=0x7f75780013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 0x55a8589f2840 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 -- 172.21.15.138:0/654886127 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75740083f0 con 0x55a8588fb0f0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a8589f31b0 con 0x55a8588fb0f0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 -- 172.21.15.138:0/654886127 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75740083f0 con 0x55a8588fb0f0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a8589f4a60 con 0x55a8588fb0f0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 -- 172.21.15.138:0/654886127 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f75740083f0 con 0x55a8588fb0f0 2024-02-16T10:31:10.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a8589f3c60 con 0x55a8588fb0f0 2024-02-16T10:31:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 -- 172.21.15.138:0/654886127 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75740083f0 con 0x55a8588fb0f0 2024-02-16T10:31:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 0x55a8589f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a8589f8430 con 0x55a8589f4580 2024-02-16T10:31:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f758475a640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 0x55a8589f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f758475a640 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 0x55a8589f7de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f758475a640 1 -- 172.21.15.138:0/654886127 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f757c0b4a00 con 0x55a8589f4580 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7586c3f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a85879cf20 con 0x55a858a063b0 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.680+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40102/0 (socket says 172.21.15.138:40102) 2024-02-16T10:31:10.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 -- 172.21.15.138:0/365122172 learned_addr learned my addr 172.21.15.138:0/365122172 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 -- 172.21.15.138:0/365122172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a858a06d10 con 0x55a858a063b0 2024-02-16T10:31:10.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55a8589ecc30 tx=0x7f757400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 -- 172.21.15.138:0/365122172 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757400f040 con 0x55a858a063b0 2024-02-16T10:31:10.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 -- 172.21.15.138:0/365122172 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574019550 con 0x55a858a063b0 2024-02-16T10:31:10.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a858a06f60 con 0x55a858a063b0 2024-02-16T10:31:10.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 -- 172.21.15.138:0/365122172 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75740197f0 con 0x55a858a063b0 2024-02-16T10:31:10.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a858a07ab0 con 0x55a858a063b0 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 -- 172.21.15.138:0/365122172 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7574019950 con 0x55a858a063b0 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 0x7f745c0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7469ffb640 1 -- 172.21.15.138:0/365122172 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f757404b4c0 con 0x55a858a063b0 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f758475a640 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 0x7f745c0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f758475a640 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 0x7f745c0367c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55a8589f36a0 tx=0x7f757c0d2440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7586c3f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a858790790 con 0x55a858a13370 2024-02-16T10:31:10.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40104/0 (socket says 172.21.15.138:40104) 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.684+0000 7f7584f5b640 1 -- 172.21.15.138:0/1415202504 learned_addr learned my addr 172.21.15.138:0/1415202504 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 -- 172.21.15.138:0/1415202504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a858a13d60 con 0x55a858a13370 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 --2- 172.21.15.138:0/1415202504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7574049800 tx=0x7f757402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73104a9398e0c768 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f74637fe640 1 -- 172.21.15.138:0/1415202504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757403b540 con 0x55a858a13370 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f74637fe640 1 -- 172.21.15.138:0/1415202504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740183b0 con 0x55a858a13370 2024-02-16T10:31:10.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f74637fe640 1 -- 172.21.15.138:0/1415202504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75740153a0 con 0x55a858a13370 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/1415202504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 msgr2=0x55a858a13790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 --2- 172.21.15.138:0/1415202504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7574049800 tx=0x7f757402af40 comp rx=0 tx=0).stop 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/1415202504 shutdown_connections 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 --2- 172.21.15.138:0/1415202504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a13790 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/1415202504 >> 172.21.15.138:0/1415202504 conn(0x55a858a0def0 msgr2=0x55a858a0edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/1415202504 shutdown_connections 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/1415202504 wait complete. 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 Processor -- start 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- start start 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a858a1a620 con 0x55a858a13370 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40120/0 (socket says 172.21.15.138:40120) 2024-02-16T10:31:10.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 learned_addr learned my addr 172.21.15.138:0/2659145123 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a858a07ab0 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7584f5b640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7574049800 tx=0x7f7574049790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7461ffb640 1 -- 172.21.15.138:0/2659145123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7574018520 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a858a1a820 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7461ffb640 1 -- 172.21.15.138:0/2659145123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757404b0d0 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7461ffb640 1 -- 172.21.15.138:0/2659145123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7574017a50 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.688+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a858a1ac50 con 0x55a858a13370 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7461ffb640 1 -- 172.21.15.138:0/2659145123 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7574017bb0 con 0x55a858a13370 2024-02-16T10:31:10.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7461ffb640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f74540342b0 0x7f7454036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7461ffb640 1 -- 172.21.15.138:0/2659145123 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7574037d70 con 0x55a858a13370 2024-02-16T10:31:10.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f758475a640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f74540342b0 0x7f7454036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a858a25840 0x55a858a27d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a28450 con 0x55a858a25840 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a858a25840 0x55a858a27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a858a25840 0x55a858a27d00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f758475a640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f74540342b0 0x7f7454036770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f757c0c7e20 tx=0x7f757c0da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 realm 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a24d20 con 0x55a858a25840 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a28ed0 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a29360 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a29c00 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 20 searching for the correct realm 2024-02-16T10:31:10.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a858a2b920 0x55a858a2dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x55a858a2b920 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.692+0000 7f7584f5b640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a858a2b920 0x55a858a2dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7584f5b640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a858a2b920 0x55a858a2dd10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7584f5b640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7574022070 0x7f75740487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x7f7574022070 2024-02-16T10:31:10.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f758475a640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7574022070 0x7f75740487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f758475a640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7574022070 0x7f75740487f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f758475a640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f757c0b5a00 0x7f757c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x7f757c0b5a00 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f757c0b5a00 0x7f757c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f757c0b5a00 0x7f757c0a93c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.696+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e250 con 0x7f757c0b5a00 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f757c0b5a00 2024-02-16T10:31:10.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.700+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f757c0b5a00 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f757c0b5a00 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.704+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f757c0b5a00 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a2b920 2024-02-16T10:31:10.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f757c0b5a00 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x55a858a25840 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f757802d040 con 0x7f7574022070 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:10.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2a530 con 0x55a858a25840 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2a1b0 con 0x55a858a25840 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2ae00 con 0x7f7574022070 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 zone default found 2024-02-16T10:31:10.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 4 Realm: () 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 zonegroup default 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.708+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2e640 con 0x7f757c0b5a00 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a304c0 con 0x55a858a2b920 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 rados->read ofs=0 len=0 2024-02-16T10:31:10.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a30820 con 0x55a858a2b920 2024-02-16T10:31:10.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:10.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 started sync module instance, tier type = 2024-02-16T10:31:10.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:10.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2fa90 con 0x7f7574022070 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181529941488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a30820 con 0x7f7574022070 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a311d0 con 0x55a858a25840 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.712+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181529941488] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181529943616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a31580 con 0x55a858a25840 2024-02-16T10:31:10.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a31ef0 con 0x55a858a2b920 2024-02-16T10:31:10.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181529943616] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181529947376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a31ef0 con 0x55a858a2b920 2024-02-16T10:31:10.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.716+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a328f0 con 0x7f7574022070 2024-02-16T10:31:10.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181529953296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a32870 con 0x7f7574022070 2024-02-16T10:31:10.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a33800 con 0x55a858a25840 2024-02-16T10:31:10.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181529947376] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181529953296] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181529955488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a337c0 con 0x55a858a25840 2024-02-16T10:31:10.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.720+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a34050 con 0x7f757c0b5a00 2024-02-16T10:31:10.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181529955488] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181529957088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a337c0 con 0x7f757c0b5a00 2024-02-16T10:31:10.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a34610 con 0x7f757c0b5a00 2024-02-16T10:31:10.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181529957088] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181529959264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a34610 con 0x7f757c0b5a00 2024-02-16T10:31:10.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.724+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a34f80 con 0x7f757c0b5a00 2024-02-16T10:31:10.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181529959264] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181529960816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a35160 con 0x7f757c0b5a00 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=0 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=1 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=2 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=3 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=4 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=5 2024-02-16T10:31:10.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=6 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181529960816] v33'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 20 add_watcher() i=7 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.728+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a38390 con 0x55a858a25840 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181529976256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a351c0 con 0x55a858a25840 2024-02-16T10:31:10.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181529976256] v33'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f743a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:10.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7586c3f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:10.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7586c3f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:10.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a371f0 con 0x55a858a25840 2024-02-16T10:31:10.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.732+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a36d50 con 0x7f757c0b5a00 2024-02-16T10:31:10.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.736+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'23 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.736+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a36d50 con 0x55a858a2b920 2024-02-16T10:31:10.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.736+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.736+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a36d50 con 0x55a858a25840 2024-02-16T10:31:10.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a415e0 con 0x7f7574022070 2024-02-16T10:31:10.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a41b10 con 0x55a858a2b920 2024-02-16T10:31:10.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.740+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42040 con 0x55a858a25840 2024-02-16T10:31:10.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.744+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.744+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a424e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.744+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.744+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a41b10 con 0x7f7574022070 2024-02-16T10:31:10.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.748+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.748+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a424e0 con 0x55a858a2b920 2024-02-16T10:31:10.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.748+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.748+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42a10 con 0x7f7574022070 2024-02-16T10:31:10.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42f40 con 0x7f757c0b5a00 2024-02-16T10:31:10.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42f40 con 0x7f7574022070 2024-02-16T10:31:10.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.752+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x7f757c0b5a00 2024-02-16T10:31:10.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.756+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'44 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.756+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a25840 2024-02-16T10:31:10.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.756+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.756+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a2b920 2024-02-16T10:31:10.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.760+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'52 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.760+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x7f7574022070 2024-02-16T10:31:10.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.760+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.760+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a2b920 2024-02-16T10:31:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.764+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.764+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a25840 2024-02-16T10:31:10.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.764+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.764+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a25840 2024-02-16T10:31:10.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.768+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.768+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x55a858a2b920 2024-02-16T10:31:10.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.768+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'53 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.768+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42490 con 0x7f7574022070 2024-02-16T10:31:10.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42dd0 con 0x55a858a2b920 2024-02-16T10:31:10.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a42dd0 con 0x55a858a2b920 2024-02-16T10:31:10.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.772+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x55a858a2b920 2024-02-16T10:31:10.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.776+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.776+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x55a858a2b920 2024-02-16T10:31:10.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.776+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.776+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x7f757c0b5a00 2024-02-16T10:31:10.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.780+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.780+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x55a858a2b920 2024-02-16T10:31:10.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.780+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.780+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x7f757c0b5a00 2024-02-16T10:31:10.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.784+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.784+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x55a858a2b920 2024-02-16T10:31:10.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.784+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'54 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.784+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x7f757c0b5a00 2024-02-16T10:31:10.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.788+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'45 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.788+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a43380 con 0x7f7574022070 2024-02-16T10:31:10.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f74397e2640 20 reqs_thread_entry: start 2024-02-16T10:31:10.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:10.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 20 Filter name: none 2024-02-16T10:31:10.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f73aaffd640 20 reqs_thread_entry: start 2024-02-16T10:31:10.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a25840 2024-02-16T10:31:10.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a25840 2024-02-16T10:31:10.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a25840 2024-02-16T10:31:10.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.792+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f757c0b5a00 2024-02-16T10:31:10.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40d70 con 0x55a858a2b920 2024-02-16T10:31:10.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40d70 con 0x55a858a25840 2024-02-16T10:31:10.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.796+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f980 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f980 con 0x55a858a2b920 2024-02-16T10:31:10.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x55a858a25840 2024-02-16T10:31:10.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.800+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x7f757c0b5a00 2024-02-16T10:31:10.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x7f7574022070 2024-02-16T10:31:10.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.804+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x55a858a2b920 2024-02-16T10:31:10.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f7574022070 2024-02-16T10:31:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f7574022070 2024-02-16T10:31:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f757c0b5a00 2024-02-16T10:31:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.808+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f7574022070 2024-02-16T10:31:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f7574022070 2024-02-16T10:31:10.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f757c0b5a00 2024-02-16T10:31:10.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.812+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a25840 2024-02-16T10:31:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a25840 2024-02-16T10:31:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a2b920 2024-02-16T10:31:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.816+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40d70 con 0x7f7574022070 2024-02-16T10:31:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40d70 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.820+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a25840 2024-02-16T10:31:10.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a25840 2024-02-16T10:31:10.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a2b920 2024-02-16T10:31:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.824+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a2b920 2024-02-16T10:31:10.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x55a858a2b920 2024-02-16T10:31:10.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.828+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40d70 con 0x55a858a2b920 2024-02-16T10:31:10.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.832+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x55a858a2b920 2024-02-16T10:31:10.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x55a858a2b920 2024-02-16T10:31:10.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.836+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a408d0 con 0x55a858a2b920 2024-02-16T10:31:10.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.840+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x55a858a2b920 2024-02-16T10:31:10.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f757c0b5a00 2024-02-16T10:31:10.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f757c0b5a00 2024-02-16T10:31:10.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.844+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a40990 con 0x7f7574022070 2024-02-16T10:31:10.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f4e0 con 0x7f7574022070 2024-02-16T10:31:10.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a404f0 con 0x7f7574022070 2024-02-16T10:31:10.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f743a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:10.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.848+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181529976256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a3f980 con 0x55a858a25840 2024-02-16T10:31:10.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94181529976256] v33'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181529941488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a37dc0 con 0x7f7574022070 2024-02-16T10:31:10.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94181529941488] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f7586c3f980 20 remove_watcher() i=0 2024-02-16T10:31:10.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f7586c3f980 2 removed watcher, disabling cache 2024-02-16T10:31:10.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.852+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181529943616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2f5f0 con 0x55a858a25840 2024-02-16T10:31:10.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94181529943616] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7586c3f980 20 remove_watcher() i=1 2024-02-16T10:31:10.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181529947376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2fe40 con 0x55a858a2b920 2024-02-16T10:31:10.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7584f5b640 1 -- 172.21.15.138:0/2659145123 <== osd.3 v2:172.21.15.138:6800/756089529 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94181529947376] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7574032020 con 0x55a858a2b920 2024-02-16T10:31:10.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7586c3f980 20 remove_watcher() i=2 2024-02-16T10:31:10.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.856+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181529953296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2fe40 con 0x7f7574022070 2024-02-16T10:31:10.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f758475a640 1 -- 172.21.15.138:0/2659145123 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94181529953296] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757c0b4a00 con 0x7f7574022070 2024-02-16T10:31:10.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f7586c3f980 20 remove_watcher() i=3 2024-02-16T10:31:10.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181529955488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a32410 con 0x55a858a25840 2024-02-16T10:31:10.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94181529955488] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x55a858a25840 2024-02-16T10:31:10.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f7586c3f980 20 remove_watcher() i=4 2024-02-16T10:31:10.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.860+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181529957088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a2fe40 con 0x7f757c0b5a00 2024-02-16T10:31:10.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94181529957088] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7586c3f980 20 remove_watcher() i=5 2024-02-16T10:31:10.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181529959264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a32410 con 0x7f757c0b5a00 2024-02-16T10:31:10.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94181529959264] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7586c3f980 20 remove_watcher() i=6 2024-02-16T10:31:10.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.864+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181529960816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a858a332e0 con 0x7f757c0b5a00 2024-02-16T10:31:10.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94181529960816] v33'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f757800f6a0 con 0x7f757c0b5a00 2024-02-16T10:31:10.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 20 remove_watcher() i=7 2024-02-16T10:31:10.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f757c0b5a00 msgr2=0x7f757c0a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f757c0b5a00 0x7f757c0a93c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a858a25840 msgr2=0x55a858a27d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a858a25840 0x55a858a27d00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7574022070 msgr2=0x7f75740487f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7574022070 0x7f75740487f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a858a2b920 msgr2=0x55a858a2dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a858a2b920 0x55a858a2dd10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f74540342b0 msgr2=0x7f7454036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f74540342b0 0x7f7454036770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f757c0c7e20 tx=0x7f757c0da000 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7583f59640 1 -- 172.21.15.138:0/2659145123 reap_dead start 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 msgr2=0x55a858a1a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7574049800 tx=0x7f7574049790 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 shutdown_connections 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/2659145123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a13370 0x55a858a1a0e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 >> 172.21.15.138:0/2659145123 conn(0x55a858a0def0 msgr2=0x55a858a0edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 shutdown_connections 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/2659145123 wait complete. 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 msgr2=0x7f745c0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 0x7f745c0367c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55a8589f36a0 tx=0x7f757c0d2440 comp rx=0 tx=0).stop 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 msgr2=0x55a858a067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55a8589ecc30 tx=0x7f757400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 shutdown_connections 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f745c034300 0x7f745c0367c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 --2- 172.21.15.138:0/365122172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a858a063b0 0x55a858a067d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 >> 172.21.15.138:0/365122172 conn(0x55a8589fb1c0 msgr2=0x55a8589fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 shutdown_connections 2024-02-16T10:31:10.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.868+0000 7f7586c3f980 1 -- 172.21.15.138:0/365122172 wait complete. 2024-02-16T10:31:10.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 msgr2=0x55a8589f2840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 0x55a8589f2840 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 msgr2=0x55a8589f7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 0x55a8589f7de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 msgr2=0x7f746c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 0x7f746c036770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7578001e50 tx=0x7f75780013b0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 msgr2=0x55a8589ebb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f757c019740 tx=0x7f757c017e30 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 shutdown_connections 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a8589f4580 0x55a8589f7de0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a8588fb0f0 0x55a8589f2840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f746c0342b0 0x7f746c036770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 --2- 172.21.15.138:0/654886127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a8588fa7d0 0x55a8589ebb50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 >> 172.21.15.138:0/654886127 conn(0x55a85886def0 msgr2=0x55a8589df480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 shutdown_connections 2024-02-16T10:31:10.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.872+0000 7f7586c3f980 1 -- 172.21.15.138:0/654886127 wait complete. 2024-02-16T10:31:10.894 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-02-16T10:31:10.894 DEBUG:tasks.util.rgw: json result: [] 2024-02-16T10:31:10.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:31:10.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:31:10.895 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:31:10.979 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:10.979 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:10.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:10.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f5788983980 1 -- start start 2024-02-16T10:31:10.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f5788983980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d431337710 0x55d4313c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:10.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f5788983980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d43130fb50 con 0x55d4313c8bd0 2024-02-16T10:31:10.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f5788983980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d4312d6d30 con 0x55d431337710 2024-02-16T10:31:10.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f578649e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d431337710 0x55d4313c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:10.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f578649e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d431337710 0x55d4313c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40126/0 (socket says 172.21.15.138:40126) 2024-02-16T10:31:10.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f578649e640 1 -- 172.21.15.138:0/4154012386 learned_addr learned my addr 172.21.15.138:0/4154012386 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:10.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f578649e640 1 -- 172.21.15.138:0/4154012386 >> v1:172.21.15.107:6789/0 conn(0x55d4313c8bd0 legacy=0x55d4313cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.972+0000 7f578649e640 1 -- 172.21.15.138:0/4154012386 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4313cd6f0 con 0x55d431337710 2024-02-16T10:31:10.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f578649e640 1 --2- 172.21.15.138:0/4154012386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4313c8690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f577800a4e0 tx=0x7f577801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79edc553eab6cb98 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f578549c640 1 -- 172.21.15.138:0/4154012386 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780aa540 con 0x55d431337710 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f578549c640 1 -- 172.21.15.138:0/4154012386 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780a6070 con 0x55d431337710 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f578549c640 1 -- 172.21.15.138:0/4154012386 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780aa850 con 0x55d431337710 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 -- 172.21.15.138:0/4154012386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 msgr2=0x55d4313c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 --2- 172.21.15.138:0/4154012386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4313c8690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f577800a4e0 tx=0x7f577801b090 comp rx=0 tx=0).stop 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 -- 172.21.15.138:0/4154012386 shutdown_connections 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 --2- 172.21.15.138:0/4154012386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4313c8690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 -- 172.21.15.138:0/4154012386 >> 172.21.15.138:0/4154012386 conn(0x55d4313bdd70 msgr2=0x55d4313c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:10.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 -- 172.21.15.138:0/4154012386 shutdown_connections 2024-02-16T10:31:10.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.976+0000 7f5788983980 1 -- 172.21.15.138:0/4154012386 wait complete. 2024-02-16T10:31:11.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:11.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f5788983980 1 -- start start 2024-02-16T10:31:11.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f5788983980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f5788983980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4312d3fc0 con 0x55d431337710 2024-02-16T10:31:11.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f578649e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f578649e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40128/0 (socket says 172.21.15.138:40128) 2024-02-16T10:31:11.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.992+0000 7f578649e640 1 -- 172.21.15.138:0/2750596182 learned_addr learned my addr 172.21.15.138:0/2750596182 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 -- 172.21.15.138:0/2750596182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577800a1c0 con 0x55d431337710 2024-02-16T10:31:11.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 --2- 172.21.15.138:0/2750596182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5778017ca0 tx=0x7f57780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac875f46a4e55c0a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5674608640 1 -- 172.21.15.138:0/2750596182 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780aa700 con 0x55d431337710 2024-02-16T10:31:11.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5674608640 1 -- 172.21.15.138:0/2750596182 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780aa860 con 0x55d431337710 2024-02-16T10:31:11.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5674608640 1 -- 172.21.15.138:0/2750596182 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780aab40 con 0x55d431337710 2024-02-16T10:31:11.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/2750596182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 msgr2=0x55d4314af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 --2- 172.21.15.138:0/2750596182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5778017ca0 tx=0x7f57780033b0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/2750596182 shutdown_connections 2024-02-16T10:31:11.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 --2- 172.21.15.138:0/2750596182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314af990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/2750596182 >> 172.21.15.138:0/2750596182 conn(0x55d4313bdd70 msgr2=0x55d4314ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/2750596182 shutdown_connections 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/2750596182 wait complete. 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- start start 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4312cf7a0 con 0x55d431337710 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40140/0 (socket says 172.21.15.138:40140) 2024-02-16T10:31:11.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 -- 172.21.15.138:0/609231831 learned_addr learned my addr 172.21.15.138:0/609231831 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4313cd6f0 con 0x55d431337710 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f578649e640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f577801b930 tx=0x7f5778017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5672e05640 1 -- 172.21.15.138:0/609231831 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780bd790 con 0x55d431337710 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4314b6dd0 con 0x55d431337710 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5672e05640 1 -- 172.21.15.138:0/609231831 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780bd8f0 con 0x55d431337710 2024-02-16T10:31:11.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:10.996+0000 7f5672e05640 1 -- 172.21.15.138:0/609231831 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57780bdb90 con 0x55d431337710 2024-02-16T10:31:11.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4314b7220 con 0x55d431337710 2024-02-16T10:31:11.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5672e05640 1 -- 172.21.15.138:0/609231831 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f57780c6030 con 0x55d431337710 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5672e05640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 0x7f566c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5672e05640 1 -- 172.21.15.138:0/609231831 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f57780e4b50 con 0x55d431337710 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5785c9d640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 0x7f566c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 0x55d4314bd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314bda70 con 0x55d4313c8bd0 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 0x55d4314bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5785c9d640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 0x7f566c036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5770000f70 tx=0x7f5770001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 0x55d4314bd530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 -- 172.21.15.138:0/609231831 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f57800083f0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314bde10 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 -- 172.21.15.138:0/609231831 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f57800083f0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314bf6c0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 -- 172.21.15.138:0/609231831 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f57800083f0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314be8c0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5786c9f640 1 -- 172.21.15.138:0/609231831 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f57800083f0 con 0x55d4313c8bd0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 0x55d4314c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314c3050 con 0x55d4314bf1e0 2024-02-16T10:31:11.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.000+0000 7f578649e640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 0x55d4314c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f578649e640 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 0x55d4314c2a40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f578649e640 1 -- 172.21.15.138:0/609231831 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f57780c0a70 con 0x55d4314bf1e0 2024-02-16T10:31:11.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:11.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 -- start start 2024-02-16T10:31:11.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d431267f20 con 0x55d4314d5390 2024-02-16T10:31:11.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40150/0 (socket says 172.21.15.138:40150) 2024-02-16T10:31:11.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5786c9f640 1 -- 172.21.15.138:0/1893203058 learned_addr learned my addr 172.21.15.138:0/1893203058 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5786c9f640 1 -- 172.21.15.138:0/1893203058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4314d5cf0 con 0x55d4314d5390 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5786c9f640 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55d4314b7920 tx=0x7f578000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f566bfff640 1 -- 172.21.15.138:0/1893203058 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578000f040 con 0x55d4314d5390 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4314d5f40 con 0x55d4314d5390 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f566bfff640 1 -- 172.21.15.138:0/1893203058 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780019550 con 0x55d4314d5390 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f566bfff640 1 -- 172.21.15.138:0/1893203058 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5780019810 con 0x55d4314d5390 2024-02-16T10:31:11.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.004+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4314d6a90 con 0x55d4314d5390 2024-02-16T10:31:11.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f566bfff640 1 -- 172.21.15.138:0/1893203058 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5780019a00 con 0x55d4314d5390 2024-02-16T10:31:11.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f566bfff640 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 0x7f5660036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f566bfff640 1 -- 172.21.15.138:0/1893203058 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f578004b560 con 0x55d4314d5390 2024-02-16T10:31:11.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f578649e640 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 0x7f5660036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- start start 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f578649e640 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 0x7f5660036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d4314be300 tx=0x7f57780dc040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d43125b790 con 0x55d4314e2280 2024-02-16T10:31:11.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40160/0 (socket says 172.21.15.138:40160) 2024-02-16T10:31:11.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5786c9f640 1 -- 172.21.15.138:0/2286337701 learned_addr learned my addr 172.21.15.138:0/2286337701 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5786c9f640 1 -- 172.21.15.138:0/2286337701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4314e2c70 con 0x55d4314e2280 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5786c9f640 1 --2- 172.21.15.138:0/2286337701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f578000bfd0 tx=0x7f578002af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef120c8a57a646e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5669ffb640 1 -- 172.21.15.138:0/2286337701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5780048070 con 0x55d4314e2280 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5669ffb640 1 -- 172.21.15.138:0/2286337701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800153a0 con 0x55d4314e2280 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5669ffb640 1 -- 172.21.15.138:0/2286337701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5780015cc0 con 0x55d4314e2280 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- 172.21.15.138:0/2286337701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 msgr2=0x55d4314e26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 --2- 172.21.15.138:0/2286337701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f578000bfd0 tx=0x7f578002af40 comp rx=0 tx=0).stop 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- 172.21.15.138:0/2286337701 shutdown_connections 2024-02-16T10:31:11.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 --2- 172.21.15.138:0/2286337701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e26a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- 172.21.15.138:0/2286337701 >> 172.21.15.138:0/2286337701 conn(0x55d4314dce50 msgr2=0x55d4314ddd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- 172.21.15.138:0/2286337701 shutdown_connections 2024-02-16T10:31:11.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- 172.21.15.138:0/2286337701 wait complete. 2024-02-16T10:31:11.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 Processor -- start 2024-02-16T10:31:11.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- start start 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.008+0000 7f5788983980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4314e9510 con 0x55d4314e2280 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5786c9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40172/0 (socket says 172.21.15.138:40172) 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 learned_addr learned my addr 172.21.15.138:0/4174580612 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4314d6a90 con 0x55d4314e2280 2024-02-16T10:31:11.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5786c9f640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5780048720 tx=0x7f5780049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 -- 172.21.15.138:0/4174580612 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5780018530 con 0x55d4314e2280 2024-02-16T10:31:11.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4314e9710 con 0x55d4314e2280 2024-02-16T10:31:11.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 -- 172.21.15.138:0/4174580612 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780015510 con 0x55d4314e2280 2024-02-16T10:31:11.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 -- 172.21.15.138:0/4174580612 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5780049b10 con 0x55d4314e2280 2024-02-16T10:31:11.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4314e9ba0 con 0x55d4314e2280 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 -- 172.21.15.138:0/4174580612 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5780032020 con 0x55d4314e2280 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56500342b0 0x7f5650036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5657fff640 1 -- 172.21.15.138:0/4174580612 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f5780037d40 con 0x55d4314e2280 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f578649e640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56500342b0 0x7f5650036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4314f4730 0x55d4314f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f7320 con 0x55d4314f4730 2024-02-16T10:31:11.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5785c9d640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4314f4730 0x55d4314f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f578649e640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56500342b0 0x7f5650036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d4314c3410 tx=0x7f57780e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.012+0000 7f5785c9d640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4314f4730 0x55d4314f6bd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 realm 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f3c10 con 0x55d4314f4730 2024-02-16T10:31:11.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f7da0 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f8620 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f8980 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:11.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 20 searching for the correct realm 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d4314faa80 0x55d4314fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5786c9f640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d4314faa80 0x55d4314fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5786c9f640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d4314faa80 0x55d4314fcf40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780042040 con 0x55d4314faa80 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5786c9f640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5780022070 0x7f5780022870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f578649e640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5780022070 0x7f5780022870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f578649e640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5780022070 0x7f5780022870 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f578649e640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57780bd070 0x7f57780be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.016+0000 7f5785c9d640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57780bd070 0x7f57780be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57780bd070 0x7f57780be5d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780042040 con 0x55d4314faa80 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.020+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780042040 con 0x55d4314faa80 2024-02-16T10:31:11.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.024+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314faa80 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f57780bd070 2024-02-16T10:31:11.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x55d4314f4730 2024-02-16T10:31:11.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fd610 con 0x7f5780022070 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.028+0000 7f5788983980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fa050 con 0x55d4314f4730 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314f9870 con 0x55d4314f4730 2024-02-16T10:31:11.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fda50 con 0x7f5780022070 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 zone default found 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 4 Realm: () 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 zonegroup default 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314fddb0 con 0x7f57780bd070 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500010 con 0x55d4314faa80 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500370 con 0x55d4314faa80 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 started sync module instance, tier type = 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:11.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4314ff5e0 con 0x7f5780022070 2024-02-16T10:31:11.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369848750400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500370 con 0x7f5780022070 2024-02-16T10:31:11.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.032+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500ce0 con 0x55d4314f4730 2024-02-16T10:31:11.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.036+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369848750400] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.036+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.036+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369848752528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500ce0 con 0x55d4314f4730 2024-02-16T10:31:11.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.036+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4315016a0 con 0x55d4314faa80 2024-02-16T10:31:11.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.036+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369848752528] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369848759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431500ce0 con 0x55d4314faa80 2024-02-16T10:31:11.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4315020c0 con 0x7f5780022070 2024-02-16T10:31:11.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369848761280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431502080 con 0x7f5780022070 2024-02-16T10:31:11.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431502fc0 con 0x55d4314f4730 2024-02-16T10:31:11.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369848759056] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.040+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369848761280] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369848765152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431502fc0 con 0x55d4314f4730 2024-02-16T10:31:11.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431503400 con 0x7f57780bd070 2024-02-16T10:31:11.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369848765152] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369848756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4315033c0 con 0x7f57780bd070 2024-02-16T10:31:11.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.044+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431503dc0 con 0x7f57780bd070 2024-02-16T10:31:11.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369848756288] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369848763504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431503dc0 con 0x7f57780bd070 2024-02-16T10:31:11.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431504600 con 0x7f57780bd070 2024-02-16T10:31:11.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369848763504] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369848768800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4315047e0 con 0x7f57780bd070 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=0 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=1 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=2 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=3 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=4 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=5 2024-02-16T10:31:11.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.048+0000 7f5788983980 20 add_watcher() i=6 2024-02-16T10:31:11.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369848768800] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 20 add_watcher() i=7 2024-02-16T10:31:11.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:11.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431507ba0 con 0x55d4314f4730 2024-02-16T10:31:11.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369848772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431504f90 con 0x55d4314f4730 2024-02-16T10:31:11.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369848772304] v33'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f563cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:11.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:11.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.052+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150ffd0 con 0x55d4314f4730 2024-02-16T10:31:11.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.056+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.056+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431510030 con 0x7f57780bd070 2024-02-16T10:31:11.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.056+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.056+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d4315106e0 con 0x55d4314faa80 2024-02-16T10:31:11.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431510c10 con 0x55d4314f4730 2024-02-16T10:31:11.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431511140 con 0x7f5780022070 2024-02-16T10:31:11.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.060+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431511670 con 0x55d4314faa80 2024-02-16T10:31:11.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.064+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.064+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431511ba0 con 0x55d4314f4730 2024-02-16T10:31:11.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.064+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.064+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431512040 con 0x7f57780bd070 2024-02-16T10:31:11.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.068+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.068+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431511670 con 0x7f5780022070 2024-02-16T10:31:11.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.068+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.068+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431512040 con 0x55d4314faa80 2024-02-16T10:31:11.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150e080 con 0x7f5780022070 2024-02-16T10:31:11.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150e670 con 0x7f57780bd070 2024-02-16T10:31:11.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.072+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150dbe0 con 0x7f5780022070 2024-02-16T10:31:11.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.076+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.076+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150f850 con 0x7f57780bd070 2024-02-16T10:31:11.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.076+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'46 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.076+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314f4730 2024-02-16T10:31:11.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'55 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f5780022070 2024-02-16T10:31:11.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.080+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.084+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.084+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314f4730 2024-02-16T10:31:11.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.084+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.084+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314f4730 2024-02-16T10:31:11.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.088+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.088+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.088+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'56 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.088+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f5780022070 2024-02-16T10:31:11.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.092+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.096+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.096+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.096+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.096+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f57780bd070 2024-02-16T10:31:11.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f57780bd070 2024-02-16T10:31:11.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.100+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x55d4314faa80 2024-02-16T10:31:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.104+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'57 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.104+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f57780bd070 2024-02-16T10:31:11.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'47 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150fa20 con 0x7f5780022070 2024-02-16T10:31:11.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f55b77fe640 20 reqs_thread_entry: start 2024-02-16T10:31:11.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:11.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 20 Filter name: none 2024-02-16T10:31:11.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f55b57fa640 20 reqs_thread_entry: start 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.108+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7f0 con 0x55d4314f4730 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:11.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x7f5780022070 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:31:11.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f563cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369848772304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x55d4314f4730 2024-02-16T10:31:11.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94369848772304] v33'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.112+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369848750400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x7f5780022070 2024-02-16T10:31:11.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94369848750400] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5788983980 20 remove_watcher() i=0 2024-02-16T10:31:11.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5788983980 2 removed watcher, disabling cache 2024-02-16T10:31:11.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369848752528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x55d4314f4730 2024-02-16T10:31:11.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94369848752528] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5788983980 20 remove_watcher() i=1 2024-02-16T10:31:11.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.116+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369848759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x55d4314faa80 2024-02-16T10:31:11.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f5786c9f640 1 -- 172.21.15.138:0/4174580612 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94369848759056] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5780060040 con 0x55d4314faa80 2024-02-16T10:31:11.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f5788983980 20 remove_watcher() i=2 2024-02-16T10:31:11.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369848761280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d43150d7c0 con 0x7f5780022070 2024-02-16T10:31:11.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f578649e640 1 -- 172.21.15.138:0/4174580612 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94369848761280] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57780c0a70 con 0x7f5780022070 2024-02-16T10:31:11.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f5788983980 20 remove_watcher() i=3 2024-02-16T10:31:11.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.120+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369848765152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431501310 con 0x55d4314f4730 2024-02-16T10:31:11.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94369848765152] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x55d4314f4730 2024-02-16T10:31:11.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5788983980 20 remove_watcher() i=4 2024-02-16T10:31:11.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369848756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431502ae0 con 0x7f57780bd070 2024-02-16T10:31:11.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94369848756288] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5788983980 20 remove_watcher() i=5 2024-02-16T10:31:11.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.124+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369848763504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431501310 con 0x7f57780bd070 2024-02-16T10:31:11.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.128+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94369848763504] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.128+0000 7f5788983980 20 remove_watcher() i=6 2024-02-16T10:31:11.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.128+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369848768800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d431502470 con 0x7f57780bd070 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94369848768800] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f577000bdd0 con 0x7f57780bd070 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 20 remove_watcher() i=7 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57780bd070 msgr2=0x7f57780be5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57780bd070 0x7f57780be5d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4314f4730 msgr2=0x55d4314f6bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4314f4730 0x55d4314f6bd0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5780022070 msgr2=0x7f5780022870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5780022070 0x7f5780022870 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d4314faa80 msgr2=0x55d4314fcf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d4314faa80 0x55d4314fcf40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56500342b0 msgr2=0x7f5650036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56500342b0 0x7f5650036770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d4314c3410 tx=0x7f57780e7000 comp rx=0 tx=0).stop 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 msgr2=0x55d4314e8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5780048720 tx=0x7f5780049830 comp rx=0 tx=0).stop 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5785c9d640 1 -- 172.21.15.138:0/4174580612 reap_dead start 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 shutdown_connections 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/4174580612 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314e2280 0x55d4314e8fd0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 >> 172.21.15.138:0/4174580612 conn(0x55d4314dce50 msgr2=0x55d4314ddd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 shutdown_connections 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/4174580612 wait complete. 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 msgr2=0x7f5660036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 0x7f5660036770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d4314be300 tx=0x7f57780dc040 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 msgr2=0x55d4314d57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55d4314b7920 tx=0x7f578000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 shutdown_connections 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56600342b0 0x7f5660036770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/1893203058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d4314d5390 0x55d4314d57b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 >> 172.21.15.138:0/1893203058 conn(0x55d4313c4f20 msgr2=0x55d4313c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 shutdown_connections 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/1893203058 wait complete. 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 msgr2=0x55d4314bd530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 0x55d4314bd530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 msgr2=0x55d4314c2a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 0x55d4314c2a40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 msgr2=0x7f566c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 0x7f566c036770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5770000f70 tx=0x7f5770001420 comp rx=0 tx=0).stop 2024-02-16T10:31:11.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 msgr2=0x55d4314b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f577801b930 tx=0x7f5778017e30 comp rx=0 tx=0).stop 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 shutdown_connections 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d4314bf1e0 0x55d4314c2a40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d4313c8bd0 0x55d4314bd530 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f566c0342b0 0x7f566c036770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 --2- 172.21.15.138:0/609231831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d431337710 0x55d4314b6890 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 >> 172.21.15.138:0/609231831 conn(0x55d4313bdd70 msgr2=0x55d4314a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 shutdown_connections 2024-02-16T10:31:11.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.132+0000 7f5788983980 1 -- 172.21.15.138:0/609231831 wait complete. 2024-02-16T10:31:11.151 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:31:11.163 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-02-16T10:31:11.169 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.226 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.247 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.292 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T10:31:11.303 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:31:11.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:31:11.303 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:31:11.341 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:11.341 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:11.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d40f5980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ddabed87e0 0x55ddabed8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d40f5980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ddabe22b60 con 0x55ddabed9100 2024-02-16T10:31:11.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d40f5980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ddabde9d30 con 0x55ddabed87e0 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ddabed87e0 0x55ddabed8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ddabed87e0 0x55ddabed8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40186/0 (socket says 172.21.15.138:40186) 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d140f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ddabed9100 0x55ddabed9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37160/0 (socket says 172.21.15.138:37160) 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3395045728 learned_addr learned my addr 172.21.15.138:0/3395045728 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3395045728 >> v1:172.21.15.107:6789/0 conn(0x55ddabed9100 legacy=0x55ddabed9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3395045728 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddabeda2e0 con 0x55ddabed87e0 2024-02-16T10:31:11.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.336+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/3395045728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabed8bc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00a5c0 tx=0x7fe2bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9108d499730288 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d0c0e640 1 -- 172.21.15.138:0/3395045728 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0aa470 con 0x55ddabed87e0 2024-02-16T10:31:11.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d0c0e640 1 -- 172.21.15.138:0/3395045728 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0aa5d0 con 0x55ddabed87e0 2024-02-16T10:31:11.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d0c0e640 1 -- 172.21.15.138:0/3395045728 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0aa890 con 0x55ddabed87e0 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3395045728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 msgr2=0x55ddabed8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3395045728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabed8bc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00a5c0 tx=0x7fe2bc01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3395045728 shutdown_connections 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3395045728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabed8bc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3395045728 >> 172.21.15.138:0/3395045728 conn(0x55ddabe4bf00 msgr2=0x55ddabe4c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3395045728 shutdown_connections 2024-02-16T10:31:11.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.340+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3395045728 wait complete. 2024-02-16T10:31:11.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddabde6fc0 con 0x55ddabed87e0 2024-02-16T10:31:11.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d1c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d1c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40190/0 (socket says 172.21.15.138:40190) 2024-02-16T10:31:11.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3947571680 learned_addr learned my addr 172.21.15.138:0/3947571680 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3947571680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc005df0 con 0x55ddabed87e0 2024-02-16T10:31:11.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/3947571680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc017f50 tx=0x7fe2bc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a588410294543f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe1bfe07640 1 -- 172.21.15.138:0/3947571680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0aa9c0 con 0x55ddabed87e0 2024-02-16T10:31:11.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe1bfe07640 1 -- 172.21.15.138:0/3947571680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0aab40 con 0x55ddabed87e0 2024-02-16T10:31:11.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe1bfe07640 1 -- 172.21.15.138:0/3947571680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0aae20 con 0x55ddabed87e0 2024-02-16T10:31:11.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3947571680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 msgr2=0x55ddabfc2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3947571680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc017f50 tx=0x7fe2bc003030 comp rx=0 tx=0).stop 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3947571680 shutdown_connections 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3947571680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc2ea0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3947571680 >> 172.21.15.138:0/3947571680 conn(0x55ddabe4bf00 msgr2=0x55ddabfbea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3947571680 shutdown_connections 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.356+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3947571680 wait complete. 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddabde27a0 con 0x55ddabed87e0 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d1c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d1c10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40192/0 (socket says 172.21.15.138:40192) 2024-02-16T10:31:11.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3673797006 learned_addr learned my addr 172.21.15.138:0/3673797006 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddabeda2e0 con 0x55ddabed87e0 2024-02-16T10:31:11.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc000c10 tx=0x7fe2bc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 -- 172.21.15.138:0/3673797006 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0be660 con 0x55ddabed87e0 2024-02-16T10:31:11.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddabfca2f0 con 0x55ddabed87e0 2024-02-16T10:31:11.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 -- 172.21.15.138:0/3673797006 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0be7c0 con 0x55ddabed87e0 2024-02-16T10:31:11.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 -- 172.21.15.138:0/3673797006 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc0bea60 con 0x55ddabed87e0 2024-02-16T10:31:11.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddabfca740 con 0x55ddabed87e0 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 -- 172.21.15.138:0/3673797006 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe2bc0bec90 con 0x55ddabed87e0 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 0x7fe1b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe1be604640 1 -- 172.21.15.138:0/3673797006 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe2bc0c5070 con 0x55ddabed87e0 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d140f640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 0x7fe1b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 0x55ddabfd0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.360+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddabfd0f90 con 0x55ddabed9100 2024-02-16T10:31:11.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 0x55ddabfd0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d140f640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 0x7fe1b8036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40012f0 tx=0x7fe2c4006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 0x55ddabfd0a50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 -- 172.21.15.138:0/3673797006 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe2cc0083f0 con 0x55ddabed9100 2024-02-16T10:31:11.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddabfd1330 con 0x55ddabed9100 2024-02-16T10:31:11.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 -- 172.21.15.138:0/3673797006 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe2cc0083f0 con 0x55ddabed9100 2024-02-16T10:31:11.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddabfd2be0 con 0x55ddabed9100 2024-02-16T10:31:11.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 -- 172.21.15.138:0/3673797006 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe2cc0083f0 con 0x55ddabed9100 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddabfd1de0 con 0x55ddabed9100 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 -- 172.21.15.138:0/3673797006 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe2cc0083f0 con 0x55ddabed9100 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 0x55ddabfd5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddabfd65b0 con 0x55ddabfd2700 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 0x55ddabfd5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 0x55ddabfd5f60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d1c10640 1 -- 172.21.15.138:0/3673797006 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe2bc0cf070 con 0x55ddabfd2700 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d40f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddabd7af20 con 0x55ddabfe4550 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40202/0 (socket says 172.21.15.138:40202) 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.364+0000 7fe2d2411640 1 -- 172.21.15.138:0/233090381 learned_addr learned my addr 172.21.15.138:0/233090381 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d2411640 1 -- 172.21.15.138:0/233090381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddabfe4eb0 con 0x55ddabfe4550 2024-02-16T10:31:11.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d2411640 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55ddabfcb190 tx=0x7fe2cc00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 -- 172.21.15.138:0/233090381 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc00f040 con 0x55ddabfe4550 2024-02-16T10:31:11.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 -- 172.21.15.138:0/233090381 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc019550 con 0x55ddabfe4550 2024-02-16T10:31:11.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddabfe5100 con 0x55ddabfe4550 2024-02-16T10:31:11.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 -- 172.21.15.138:0/233090381 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0197f0 con 0x55ddabfe4550 2024-02-16T10:31:11.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddabfe5c50 con 0x55ddabfe4550 2024-02-16T10:31:11.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 -- 172.21.15.138:0/233090381 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe2cc019950 con 0x55ddabfe4550 2024-02-16T10:31:11.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 0x7fe1ac0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe1b77fe640 1 -- 172.21.15.138:0/233090381 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe2cc04b4c0 con 0x55ddabfe4550 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 0x7fe1ac0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 0x7fe1ac0367c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ddabfd1820 tx=0x7fe2bc0bd3b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d40f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddabd6e790 con 0x55ddabff14c0 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40210/0 (socket says 172.21.15.138:40210) 2024-02-16T10:31:11.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.368+0000 7fe2d2411640 1 -- 172.21.15.138:0/1364983883 learned_addr learned my addr 172.21.15.138:0/1364983883 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 -- 172.21.15.138:0/1364983883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddabff1eb0 con 0x55ddabff14c0 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 --2- 172.21.15.138:0/1364983883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc049800 tx=0x7fe2cc02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b7ad7950ddb7e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1b57fa640 1 -- 172.21.15.138:0/1364983883 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc03b540 con 0x55ddabff14c0 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1b57fa640 1 -- 172.21.15.138:0/1364983883 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0183b0 con 0x55ddabff14c0 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1b57fa640 1 -- 172.21.15.138:0/1364983883 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0153a0 con 0x55ddabff14c0 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/1364983883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 msgr2=0x55ddabff18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/1364983883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc049800 tx=0x7fe2cc02af40 comp rx=0 tx=0).stop 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/1364983883 shutdown_connections 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/1364983883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff18e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/1364983883 >> 172.21.15.138:0/1364983883 conn(0x55ddabfec090 msgr2=0x55ddabfecf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/1364983883 shutdown_connections 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/1364983883 wait complete. 2024-02-16T10:31:11.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 Processor -- start 2024-02-16T10:31:11.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- start start 2024-02-16T10:31:11.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddabff8750 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40224/0 (socket says 172.21.15.138:40224) 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 learned_addr learned my addr 172.21.15.138:0/842911254 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddabfe5c50 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d2411640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc049800 tx=0x7fe2cc049790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1a37fe640 1 -- 172.21.15.138:0/842911254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc015ed0 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ddabff8950 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1a37fe640 1 -- 172.21.15.138:0/842911254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc018520 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe1a37fe640 1 -- 172.21.15.138:0/842911254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc04b200 con 0x55ddabff14c0 2024-02-16T10:31:11.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.372+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddabff8d80 con 0x55ddabff14c0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe1a37fe640 1 -- 172.21.15.138:0/842911254 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe2cc017a50 con 0x55ddabff14c0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe1a37fe640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe19c034210 0x7fe19c0366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe1a37fe640 1 -- 172.21.15.138:0/842911254 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe2cc037d70 con 0x55ddabff14c0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe19c034210 0x7fe19c0366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddac003940 0x55ddac005e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac006550 con 0x55ddac003940 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddac003940 0x55ddac005e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe19c034210 0x7fe19c0366d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005290 tx=0x7fe2bc0e5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddac003940 0x55ddac005e00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 realm 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac002df0 con 0x55ddac003940 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac006fd0 con 0x55ddac003940 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac006c70 con 0x55ddac003940 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac007d90 con 0x55ddac003940 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 20 searching for the correct realm 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ddac009c80 0x55ddac00c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.376+0000 7fe2d2411640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ddac009c80 0x55ddac00c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d2411640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ddac009c80 0x55ddac00c140 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d2411640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe2cc022070 0x7fe2cc0076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe2cc022070 0x7fe2cc0076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe2cc022070 0x7fe2cc0076c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0cf070 con 0x7fe2cc022070 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d1c10640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe2bc0d2070 0x7fe2bc0a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe2bc0d2070 0x7fe2bc0a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe2bc0d2070 0x7fe2bc0a93d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.380+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.384+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.388+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac009c80 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2bc0d2070 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x55ddac003940 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00c810 con 0x7fe2cc022070 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac0086f0 con 0x55ddac003940 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac008f40 con 0x55ddac003940 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac008f40 con 0x7fe2cc022070 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 zone default found 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 4 Realm: () 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:11.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 zonegroup default 2024-02-16T10:31:11.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.392+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00cc50 con 0x7fe2bc0d2070 2024-02-16T10:31:11.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00ea10 con 0x55ddac009c80 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00ee00 con 0x55ddac009c80 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 started sync module instance, tier type = 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00dea0 con 0x7fe2cc022070 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410561870336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00e6a0 con 0x7fe2cc022070 2024-02-16T10:31:11.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00f870 con 0x55ddac003940 2024-02-16T10:31:11.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.396+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94410561870336] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410561872384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac00fc20 con 0x55ddac003940 2024-02-16T10:31:11.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac010590 con 0x55ddac009c80 2024-02-16T10:31:11.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94410561872384] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94410561876880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac010590 con 0x55ddac009c80 2024-02-16T10:31:11.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.400+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac010f50 con 0x7fe2cc022070 2024-02-16T10:31:11.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94410561882800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac0117a0 con 0x7fe2cc022070 2024-02-16T10:31:11.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac0121a0 con 0x55ddac003940 2024-02-16T10:31:11.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94410561876880] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94410561882800] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410561887392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac011300 con 0x55ddac003940 2024-02-16T10:31:11.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.404+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac0129f0 con 0x7fe2bc0d2070 2024-02-16T10:31:11.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.408+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94410561887392] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.408+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.408+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94410561880304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac011300 con 0x7fe2bc0d2070 2024-02-16T10:31:11.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.408+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac012f20 con 0x7fe2bc0d2070 2024-02-16T10:31:11.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94410561880304] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94410561889200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac012ee0 con 0x7fe2bc0d2070 2024-02-16T10:31:11.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac013850 con 0x7fe2bc0d2070 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94410561889200] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94410561893776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac012ee0 con 0x7fe2bc0d2070 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=0 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=1 2024-02-16T10:31:11.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=2 2024-02-16T10:31:11.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=3 2024-02-16T10:31:11.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=4 2024-02-16T10:31:11.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=5 2024-02-16T10:31:11.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.412+0000 7fe2d40f5980 20 add_watcher() i=6 2024-02-16T10:31:11.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94410561893776] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 add_watcher() i=7 2024-02-16T10:31:11.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:11.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac016c60 con 0x55ddac003940 2024-02-16T10:31:11.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94410561891344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac0141a0 con 0x55ddac003940 2024-02-16T10:31:11.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94410561891344] v33'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe1837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 5 note: GC not initialized 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe1827fc640 20 reqs_thread_entry: start 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 Filter name: none 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe0f3fff640 20 reqs_thread_entry: start 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.416+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac039130 con 0x7fe2cc022070 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 : miss 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.8 8:12c0d38e:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03aa00 con 0x55ddac003940 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:31:11.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 info.flags=0x17 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 to cache LRU end 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 20 get_obj_state: octx=0x7fe2bc0a9ed0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ddac03cad8 s->prefetch_data=0 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 3.9s0 3:91b1c150:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x55ddac009c80 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 10 manifest: total_size = 5 2024-02-16T10:31:11.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 20 get_obj_state: setting s->obj_tag to _2YhN6-fWmZUt1LQM1aXeFaUfHHZCRvm 2024-02-16T10:31:11.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe1837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94410561891344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x55ddac003940 2024-02-16T10:31:11.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94410561891344] v33'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.420+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94410561870336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x7fe2cc022070 2024-02-16T10:31:11.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94410561870336] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d40f5980 20 remove_watcher() i=0 2024-02-16T10:31:11.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d40f5980 2 removed watcher, disabling cache 2024-02-16T10:31:11.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94410561872384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x55ddac003940 2024-02-16T10:31:11.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94410561872384] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d40f5980 20 remove_watcher() i=1 2024-02-16T10:31:11.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.424+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94410561876880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x55ddac009c80 2024-02-16T10:31:11.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d2411640 1 -- 172.21.15.138:0/842911254 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94410561876880] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2cc032020 con 0x55ddac009c80 2024-02-16T10:31:11.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d40f5980 20 remove_watcher() i=2 2024-02-16T10:31:11.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94410561882800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x7fe2cc022070 2024-02-16T10:31:11.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d1c10640 1 -- 172.21.15.138:0/842911254 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94410561882800] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2bc0fd040 con 0x7fe2cc022070 2024-02-16T10:31:11.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d40f5980 20 remove_watcher() i=3 2024-02-16T10:31:11.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.428+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94410561887392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x55ddac003940 2024-02-16T10:31:11.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94410561887392] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x55ddac003940 2024-02-16T10:31:11.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d40f5980 20 remove_watcher() i=4 2024-02-16T10:31:11.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94410561880304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x7fe2bc0d2070 2024-02-16T10:31:11.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94410561880304] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d40f5980 20 remove_watcher() i=5 2024-02-16T10:31:11.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.432+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94410561889200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x7fe2bc0d2070 2024-02-16T10:31:11.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94410561889200] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 20 remove_watcher() i=6 2024-02-16T10:31:11.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94410561893776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ddac03dc40 con 0x7fe2bc0d2070 2024-02-16T10:31:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94410561893776] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe2c4003460 con 0x7fe2bc0d2070 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 20 remove_watcher() i=7 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe2bc0d2070 msgr2=0x7fe2bc0a93d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe2bc0d2070 0x7fe2bc0a93d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddac003940 msgr2=0x55ddac005e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddac003940 0x55ddac005e00 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe2cc022070 msgr2=0x7fe2cc0076c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe2cc022070 0x7fe2cc0076c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ddac009c80 msgr2=0x55ddac00c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ddac009c80 0x55ddac00c140 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe19c034210 msgr2=0x7fe19c0366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe19c034210 0x7fe19c0366d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005290 tx=0x7fe2bc0e5000 comp rx=0 tx=0).stop 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 msgr2=0x55ddabff8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc049800 tx=0x7fe2cc049790 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d140f640 1 -- 172.21.15.138:0/842911254 reap_dead start 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 shutdown_connections 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/842911254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabff14c0 0x55ddabff8210 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 >> 172.21.15.138:0/842911254 conn(0x55ddabfec090 msgr2=0x55ddabfecf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 shutdown_connections 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/842911254 wait complete. 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 msgr2=0x7fe1ac0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 0x7fe1ac0367c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ddabfd1820 tx=0x7fe2bc0bd3b0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 msgr2=0x55ddabfe4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55ddabfcb190 tx=0x7fe2cc00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 shutdown_connections 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1ac034300 0x7fe1ac0367c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/233090381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabfe4550 0x55ddabfe4970 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 >> 172.21.15.138:0/233090381 conn(0x55ddabfd9360 msgr2=0x55ddabfd9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.436+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 shutdown_connections 2024-02-16T10:31:11.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/233090381 wait complete. 2024-02-16T10:31:11.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 msgr2=0x55ddabfd0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 0x55ddabfd0a50 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 msgr2=0x55ddabfd5f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 0x55ddabfd5f60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 msgr2=0x7fe1b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 0x7fe1b8036770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40012f0 tx=0x7fe2c4006700 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 msgr2=0x55ddabfc9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc000c10 tx=0x7fe2bc0180e0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 shutdown_connections 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ddabfd2700 0x55ddabfd5f60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ddabed9100 0x55ddabfd0a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe1b80342b0 0x7fe1b8036770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 --2- 172.21.15.138:0/3673797006 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ddabed87e0 0x55ddabfc9db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 >> 172.21.15.138:0/3673797006 conn(0x55ddabe4bf00 msgr2=0x55ddabfbd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 shutdown_connections 2024-02-16T10:31:11.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.440+0000 7fe2d40f5980 1 -- 172.21.15.138:0/3673797006 wait complete. 2024-02-16T10:31:11.457 INFO:teuthology.orchestra.run.smithi138.stdout:fooFoofooFooFULL_CONTROL 2024-02-16T10:31:11.457 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-02-16T10:31:11.460 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-02-16T10:31:11.466 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:31:11.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-02-16T10:31:11.467 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:31:11.536 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:11.536 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:11.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb543f8a980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a0818e5720 0x55a0819766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb543f8a980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a0818bdb60 con 0x55a081976be0 2024-02-16T10:31:11.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb543f8a980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a081884d30 con 0x55a0818e5720 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb541aa5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a0818e5720 0x55a0819766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb541aa5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55a0818e5720 0x55a0819766a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40236/0 (socket says 172.21.15.138:40236) 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb541aa5640 1 -- 172.21.15.138:0/2186923807 learned_addr learned my addr 172.21.15.138:0/2186923807 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.528+0000 7fb5412a4640 1 --1- 172.21.15.138:0/2186923807 >> v1:172.21.15.107:6789/0 conn(0x55a081976be0 0x55a081978fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37168/0 (socket says 172.21.15.138:37168) 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb541aa5640 1 -- 172.21.15.138:0/2186923807 >> v1:172.21.15.107:6789/0 conn(0x55a081976be0 legacy=0x55a081978fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb541aa5640 1 -- 172.21.15.138:0/2186923807 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a08197b700 con 0x55a0818e5720 2024-02-16T10:31:11.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb541aa5640 1 --2- 172.21.15.138:0/2186923807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a0819766a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00a5c0 tx=0x7fb53c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5daeb5037e8170 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb540aa3640 1 -- 172.21.15.138:0/2186923807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0aa470 con 0x55a0818e5720 2024-02-16T10:31:11.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb540aa3640 1 -- 172.21.15.138:0/2186923807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c0aa5d0 con 0x55a0818e5720 2024-02-16T10:31:11.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb540aa3640 1 -- 172.21.15.138:0/2186923807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0aa890 con 0x55a0818e5720 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb543f8a980 1 -- 172.21.15.138:0/2186923807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 msgr2=0x55a0819766a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2186923807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a0819766a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00a5c0 tx=0x7fb53c01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb543f8a980 1 -- 172.21.15.138:0/2186923807 shutdown_connections 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2186923807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a0819766a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.532+0000 7fb543f8a980 1 -- 172.21.15.138:0/2186923807 >> 172.21.15.138:0/2186923807 conn(0x55a08196bd80 msgr2=0x55a08196e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.536+0000 7fb543f8a980 1 -- 172.21.15.138:0/2186923807 shutdown_connections 2024-02-16T10:31:11.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.536+0000 7fb543f8a980 1 -- 172.21.15.138:0/2186923807 wait complete. 2024-02-16T10:31:11.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.548+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.548+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.548+0000 7fb543f8a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.548+0000 7fb543f8a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a081881fc0 con 0x55a0818e5720 2024-02-16T10:31:11.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40242/0 (socket says 172.21.15.138:40242) 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 -- 172.21.15.138:0/484792623 learned_addr learned my addr 172.21.15.138:0/484792623 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 -- 172.21.15.138:0/484792623 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c005df0 con 0x55a0818e5720 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 --2- 172.21.15.138:0/484792623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb53c01b380 tx=0x7fb53c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16553bb61264c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb42fe07640 1 -- 172.21.15.138:0/484792623 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0aa9b0 con 0x55a0818e5720 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb42fe07640 1 -- 172.21.15.138:0/484792623 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c0aab30 con 0x55a0818e5720 2024-02-16T10:31:11.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb42fe07640 1 -- 172.21.15.138:0/484792623 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0aae10 con 0x55a0818e5720 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- 172.21.15.138:0/484792623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 msgr2=0x55a081a5da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 --2- 172.21.15.138:0/484792623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb53c01b380 tx=0x7fb53c003030 comp rx=0 tx=0).stop 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- 172.21.15.138:0/484792623 shutdown_connections 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 --2- 172.21.15.138:0/484792623 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a5da00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- 172.21.15.138:0/484792623 >> 172.21.15.138:0/484792623 conn(0x55a08196bd80 msgr2=0x55a081a594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- 172.21.15.138:0/484792623 shutdown_connections 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- 172.21.15.138:0/484792623 wait complete. 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb543f8a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a08187d7a0 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40244/0 (socket says 172.21.15.138:40244) 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.552+0000 7fb541aa5640 1 -- 172.21.15.138:0/2741952408 learned_addr learned my addr 172.21.15.138:0/2741952408 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb541aa5640 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a08197b700 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb541aa5640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005940 tx=0x7fb53c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 -- 172.21.15.138:0/2741952408 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0c6710 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 -- 172.21.15.138:0/2741952408 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c0c6870 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a081a64f00 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 -- 172.21.15.138:0/2741952408 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53c0c6b50 con 0x55a0818e5720 2024-02-16T10:31:11.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a081a653b0 con 0x55a0818e5720 2024-02-16T10:31:11.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 -- 172.21.15.138:0/2741952408 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb53c0c6d00 con 0x55a0818e5720 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 0x7fb428036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb42e604640 1 -- 172.21.15.138:0/2741952408 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb53c0e5230 con 0x55a0818e5720 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5412a4640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 0x7fb428036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 0x55a081a6b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a6bba0 con 0x55a081976be0 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5422a6640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 0x55a081a6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5412a4640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 0x7fb428036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000f70 tx=0x7fb52c001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5422a6640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 0x55a081a6b660 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5422a6640 1 -- 172.21.15.138:0/2741952408 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a68d40 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb5422a6640 1 -- 172.21.15.138:0/2741952408 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.556+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a6d580 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 -- 172.21.15.138:0/2741952408 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a6c3e0 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 -- 172.21.15.138:0/2741952408 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081976be0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 0x55a081a70de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a71320 con 0x55a081a6e9f0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb541aa5640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 0x55a081a70de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb541aa5640 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 0x55a081a70de0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb541aa5640 1 -- 172.21.15.138:0/2741952408 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb53c0b0020 con 0x55a081a6e9f0 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a081815f20 con 0x55a081a7f100 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40258/0 (socket says 172.21.15.138:40258) 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 -- 172.21.15.138:0/3056881218 learned_addr learned my addr 172.21.15.138:0/3056881218 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 -- 172.21.15.138:0/3056881218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a081a7fa60 con 0x55a081a7f100 2024-02-16T10:31:11.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb5422a6640 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55a081a65560 tx=0x7fb534018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb4277fe640 1 -- 172.21.15.138:0/3056881218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53401d070 con 0x55a081a7f100 2024-02-16T10:31:11.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a081a7fcb0 con 0x55a081a7f100 2024-02-16T10:31:11.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb4277fe640 1 -- 172.21.15.138:0/3056881218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534014450 con 0x55a081a7f100 2024-02-16T10:31:11.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb4277fe640 1 -- 172.21.15.138:0/3056881218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5340146f0 con 0x55a081a7f100 2024-02-16T10:31:11.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.560+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a081a80800 con 0x55a081a7f100 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4277fe640 1 -- 172.21.15.138:0/3056881218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb534020020 con 0x55a081a7f100 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4277fe640 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 0x7fb41c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4277fe640 1 -- 172.21.15.138:0/3056881218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb53404b240 con 0x55a081a7f100 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb541aa5640 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 0x7fb41c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb541aa5640 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 0x7fb41c036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a081a6cf90 tx=0x7fb53c0e3650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a081809790 con 0x55a081a8c030 2024-02-16T10:31:11.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40262/0 (socket says 172.21.15.138:40262) 2024-02-16T10:31:11.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb5422a6640 1 -- 172.21.15.138:0/186253874 learned_addr learned my addr 172.21.15.138:0/186253874 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb5422a6640 1 -- 172.21.15.138:0/186253874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a081a8ca20 con 0x55a081a8c030 2024-02-16T10:31:11.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb5422a6640 1 --2- 172.21.15.138:0/186253874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb534049500 tx=0x7fb534049640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8988348a74446827 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4257fa640 1 -- 172.21.15.138:0/186253874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53403b240 con 0x55a081a8c030 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4257fa640 1 -- 172.21.15.138:0/186253874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53402b350 con 0x55a081a8c030 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb4257fa640 1 -- 172.21.15.138:0/186253874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb534012560 con 0x55a081a8c030 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 -- 172.21.15.138:0/186253874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 msgr2=0x55a081a8c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 --2- 172.21.15.138:0/186253874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb534049500 tx=0x7fb534049640 comp rx=0 tx=0).stop 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 -- 172.21.15.138:0/186253874 shutdown_connections 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 --2- 172.21.15.138:0/186253874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a8c450 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.564+0000 7fb543f8a980 1 -- 172.21.15.138:0/186253874 >> 172.21.15.138:0/186253874 conn(0x55a081a86c00 msgr2=0x55a081a87ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- 172.21.15.138:0/186253874 shutdown_connections 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- 172.21.15.138:0/186253874 wait complete. 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 Processor -- start 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- start start 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a081a932b0 con 0x55a081a8c030 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5422a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40266/0 (socket says 172.21.15.138:40266) 2024-02-16T10:31:11.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 learned_addr learned my addr 172.21.15.138:0/1494254590 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a081a80800 con 0x55a081a8c030 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5422a6640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb534012f90 tx=0x7fb534049490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 -- 172.21.15.138:0/1494254590 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb534034070 con 0x55a081a8c030 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 -- 172.21.15.138:0/1494254590 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534016440 con 0x55a081a8c030 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a081a934b0 con 0x55a081a8c030 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 -- 172.21.15.138:0/1494254590 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb53402b4c0 con 0x55a081a8c030 2024-02-16T10:31:11.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a081a938e0 con 0x55a081a8c030 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 -- 172.21.15.138:0/1494254590 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb534049aa0 con 0x55a081a8c030 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb40c0342b0 0x7fb40c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb4137fe640 1 -- 172.21.15.138:0/1494254590 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb53404ce30 con 0x55a081a8c030 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb541aa5640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb40c0342b0 0x7fb40c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081a9e4c0 0x55a081aa0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa10d0 con 0x55a081a9e4c0 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.568+0000 7fb5412a4640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081a9e4c0 0x55a081aa0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb40c0342b0 0x7fb40c036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0bf040 tx=0x7fb53c0e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081a9e4c0 0x55a081aa0980 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 realm 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081a9d920 con 0x55a081a9e4c0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa1b50 con 0x55a081a9e4c0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa17f0 con 0x55a081a9e4c0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa2910 con 0x55a081a9e4c0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 20 searching for the correct realm 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a081aa47c0 0x55a081aa6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x55a081aa47c0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5422a6640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a081aa47c0 0x55a081aa6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5422a6640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a081aa47c0 0x55a081aa6c80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5422a6640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb534014850 0x7fb534023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x7fb534014850 2024-02-16T10:31:11.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb534014850 0x7fb534023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb534014850 0x7fb534023420 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb53c009040 0x7fb53c0bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.572+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x7fb53c009040 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb53c009040 0x7fb53c0bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb53c009040 0x7fb53c0bc660 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7350 con 0x7fb53c009040 2024-02-16T10:31:11.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.576+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb53c009040 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.580+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb53c009040 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb53c009040 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb53c009040 2024-02-16T10:31:11.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081aa47c0 2024-02-16T10:31:11.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.584+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb53c009040 2024-02-16T10:31:11.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x55a081a9e4c0 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fb52c02d040 con 0x7fb534014850 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa3270 con 0x55a081a9e4c0 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa3ac0 con 0x55a081a9e4c0 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa3ac0 con 0x7fb534014850 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 zone default found 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 4 Realm: () 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 zonegroup default 2024-02-16T10:31:11.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa7790 con 0x7fb53c009040 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa9550 con 0x55a081aa47c0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa98e0 con 0x55a081aa47c0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 started sync module instance, tier type = 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.588+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa89e0 con 0x7fb534014850 2024-02-16T10:31:11.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94147858564416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aa91e0 con 0x7fb534014850 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aaa350 con 0x55a081a9e4c0 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94147858564416] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94147858570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aaa700 con 0x55a081a9e4c0 2024-02-16T10:31:11.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.592+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aab070 con 0x55a081aa47c0 2024-02-16T10:31:11.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94147858570832] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94147858566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aab070 con 0x55a081aa47c0 2024-02-16T10:31:11.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aaba30 con 0x7fb534014850 2024-02-16T10:31:11.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94147858576784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aac280 con 0x7fb534014850 2024-02-16T10:31:11.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aacc80 con 0x55a081a9e4c0 2024-02-16T10:31:11.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.596+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94147858566464] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94147858576784] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94147858578912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aaabd0 con 0x55a081a9e4c0 2024-02-16T10:31:11.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aad500 con 0x7fb53c009040 2024-02-16T10:31:11.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94147858578912] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94147858581376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aad490 con 0x7fb53c009040 2024-02-16T10:31:11.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.600+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aade00 con 0x7fb53c009040 2024-02-16T10:31:11.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.604+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94147858581376] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.604+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.604+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94147858583536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aade00 con 0x7fb53c009040 2024-02-16T10:31:11.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.604+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aae660 con 0x7fb53c009040 2024-02-16T10:31:11.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.604+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94147858583536] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94147858585952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aae840 con 0x7fb53c009040 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=0 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=1 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=2 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=3 2024-02-16T10:31:11.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=4 2024-02-16T10:31:11.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=5 2024-02-16T10:31:11.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=6 2024-02-16T10:31:11.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94147858585952] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 20 add_watcher() i=7 2024-02-16T10:31:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ab1c00 con 0x55a081a9e4c0 2024-02-16T10:31:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.608+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94147858589488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081aaf020 con 0x55a081a9e4c0 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94147858589488] v33'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb3f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 5 note: GC not initialized 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb3f27fc640 20 reqs_thread_entry: start 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 Filter name: none 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb363fff640 20 reqs_thread_entry: start 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:31:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad3f80 con 0x7fb534014850 2024-02-16T10:31:11.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:31:11.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:31:11.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:31:11.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 : miss 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.8 8:12c0d38e:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad5850 con 0x55a081a9e4c0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 info.flags=0x17 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 to cache LRU end 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 get_obj_state: octx=0x7fb53c0e8040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55a081ad7ba8 s->prefetch_data=0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 3.9s0 3:91b1c150:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x55a081aa47c0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 10 manifest: total_size = 5 2024-02-16T10:31:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 20 get_obj_state: setting s->obj_tag to _T5UKySAeh1WKkW6K_Slzh7WnFKHHSRu 2024-02-16T10:31:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb3f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.612+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94147858589488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x55a081a9e4c0 2024-02-16T10:31:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94147858589488] v33'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94147858564416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x7fb534014850 2024-02-16T10:31:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94147858564416] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb543f8a980 20 remove_watcher() i=0 2024-02-16T10:31:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb543f8a980 2 removed watcher, disabling cache 2024-02-16T10:31:11.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.616+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94147858570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x55a081a9e4c0 2024-02-16T10:31:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94147858570832] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 20 remove_watcher() i=1 2024-02-16T10:31:11.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94147858566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x55a081aa47c0 2024-02-16T10:31:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb5422a6640 1 -- 172.21.15.138:0/1494254590 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94147858566464] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53400a4d0 con 0x55a081aa47c0 2024-02-16T10:31:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 20 remove_watcher() i=2 2024-02-16T10:31:11.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94147858576784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x7fb534014850 2024-02-16T10:31:11.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb541aa5640 1 -- 172.21.15.138:0/1494254590 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94147858576784] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb53c0b0020 con 0x7fb534014850 2024-02-16T10:31:11.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 20 remove_watcher() i=3 2024-02-16T10:31:11.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.620+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94147858578912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x55a081a9e4c0 2024-02-16T10:31:11.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.624+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94147858578912] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x55a081a9e4c0 2024-02-16T10:31:11.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.624+0000 7fb543f8a980 20 remove_watcher() i=4 2024-02-16T10:31:11.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.624+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94147858581376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x7fb53c009040 2024-02-16T10:31:11.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94147858581376] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb543f8a980 20 remove_watcher() i=5 2024-02-16T10:31:11.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94147858583536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x7fb53c009040 2024-02-16T10:31:11.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94147858583536] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb543f8a980 20 remove_watcher() i=6 2024-02-16T10:31:11.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.628+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94147858585952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a081ad8aa0 con 0x7fb53c009040 2024-02-16T10:31:11.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94147858585952] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb52c00f620 con 0x7fb53c009040 2024-02-16T10:31:11.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 20 remove_watcher() i=7 2024-02-16T10:31:11.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb53c009040 msgr2=0x7fb53c0bc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb53c009040 0x7fb53c0bc660 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081a9e4c0 msgr2=0x55a081aa0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081a9e4c0 0x55a081aa0980 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb534014850 msgr2=0x7fb534023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb534014850 0x7fb534023420 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a081aa47c0 msgr2=0x55a081aa6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55a081aa47c0 0x55a081aa6c80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb40c0342b0 msgr2=0x7fb40c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb40c0342b0 0x7fb40c036770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0bf040 tx=0x7fb53c0e0000 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 msgr2=0x55a081a92d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb5412a4640 1 -- 172.21.15.138:0/1494254590 reap_dead start 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb534012f90 tx=0x7fb534049490 comp rx=0 tx=0).stop 2024-02-16T10:31:11.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 shutdown_connections 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/1494254590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a8c030 0x55a081a92d70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 >> 172.21.15.138:0/1494254590 conn(0x55a081a86c00 msgr2=0x55a081a87ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 shutdown_connections 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/1494254590 wait complete. 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 msgr2=0x7fb41c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 0x7fb41c036770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a081a6cf90 tx=0x7fb53c0e3650 comp rx=0 tx=0).stop 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 msgr2=0x55a081a7f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55a081a65560 tx=0x7fb534018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 shutdown_connections 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb41c0342b0 0x7fb41c036770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/3056881218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a081a7f100 0x55a081a7f520 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 >> 172.21.15.138:0/3056881218 conn(0x55a081a73f10 msgr2=0x55a081a74a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 shutdown_connections 2024-02-16T10:31:11.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/3056881218 wait complete. 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 msgr2=0x55a081a6b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 0x55a081a6b660 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 msgr2=0x55a081a70de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 0x55a081a70de0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 msgr2=0x7fb428036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 0x7fb428036770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000f70 tx=0x7fb52c001380 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 msgr2=0x55a081a649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005940 tx=0x7fb53c0180e0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 shutdown_connections 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55a081a6e9f0 0x55a081a70de0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55a081976be0 0x55a081a6b660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb4280342b0 0x7fb428036770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 --2- 172.21.15.138:0/2741952408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a0818e5720 0x55a081a649c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 >> 172.21.15.138:0/2741952408 conn(0x55a08196bd80 msgr2=0x55a081a57fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 shutdown_connections 2024-02-16T10:31:11.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.632+0000 7fb543f8a980 1 -- 172.21.15.138:0/2741952408 wait complete. 2024-02-16T10:31:11.651 INFO:teuthology.orchestra.run.smithi138.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T10:31:11.651 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-02-16T10:31:11.653 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-02-16T10:31:11.674 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:11.780 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-02-16T10:31:11.780 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-02-16T10:31:11.781 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-02-16T10:31:11.781 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T10:31:11.781 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T10:31:11.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-02-16T10:31:11.781 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-02-16T10:31:11.820 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:11.820 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:11.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a7965c980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c2bd60b00 0x563c2bd62ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a7965c980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563c2bca8b60 con 0x563c2bd5c5f0 2024-02-16T10:31:11.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a7965c980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563c2bc6fd30 con 0x563c2bd60b00 2024-02-16T10:31:11.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.812+0000 7f1a76976640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c2bd60b00 0x563c2bd62ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76976640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563c2bd60b00 0x563c2bd62ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40282/0 (socket says 172.21.15.138:40282) 2024-02-16T10:31:11.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a77177640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563c2bd5c5f0 0x563c2bd5c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37182/0 (socket says 172.21.15.138:37182) 2024-02-16T10:31:11.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76976640 1 -- 172.21.15.138:0/2021984346 learned_addr learned my addr 172.21.15.138:0/2021984346 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76976640 1 -- 172.21.15.138:0/2021984346 >> v1:172.21.15.107:6789/0 conn(0x563c2bd5c5f0 legacy=0x563c2bd5c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76976640 1 -- 172.21.15.138:0/2021984346 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2bd64440 con 0x563c2bd60b00 2024-02-16T10:31:11.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76976640 1 --2- 172.21.15.138:0/2021984346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd60b00 0x563c2bd62ef0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00a5c0 tx=0x7f1a6c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37981360e3e0f95d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76175640 1 -- 172.21.15.138:0/2021984346 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c0aa470 con 0x563c2bd60b00 2024-02-16T10:31:11.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76175640 1 -- 172.21.15.138:0/2021984346 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c0aa5d0 con 0x563c2bd60b00 2024-02-16T10:31:11.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a76175640 1 -- 172.21.15.138:0/2021984346 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a6c0aa890 con 0x563c2bd60b00 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a7965c980 1 -- 172.21.15.138:0/2021984346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd60b00 msgr2=0x563c2bd62ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2021984346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd60b00 0x563c2bd62ef0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00a5c0 tx=0x7f1a6c01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a7965c980 1 -- 172.21.15.138:0/2021984346 shutdown_connections 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2021984346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd60b00 0x563c2bd62ef0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.816+0000 7f1a7965c980 1 -- 172.21.15.138:0/2021984346 >> 172.21.15.138:0/2021984346 conn(0x563c2bd57ec0 msgr2=0x563c2bd5a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.820+0000 7f1a7965c980 1 -- 172.21.15.138:0/2021984346 shutdown_connections 2024-02-16T10:31:11.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.820+0000 7f1a7965c980 1 -- 172.21.15.138:0/2021984346 wait complete. 2024-02-16T10:31:11.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.832+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.832+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2bc6cfc0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40284/0 (socket says 172.21.15.138:40284) 2024-02-16T10:31:11.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 -- 172.21.15.138:0/3552300956 learned_addr learned my addr 172.21.15.138:0/3552300956 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 -- 172.21.15.138:0/3552300956 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c005df0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 --2- 172.21.15.138:0/3552300956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fb0 tx=0x7f1a68001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bd5929855d5cf0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f196560a640 1 -- 172.21.15.138:0/3552300956 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a68013420 con 0x563c2bd5c5f0 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f196560a640 1 -- 172.21.15.138:0/3552300956 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68013580 con 0x563c2bd5c5f0 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f196560a640 1 -- 172.21.15.138:0/3552300956 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a68013860 con 0x563c2bd5c5f0 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- 172.21.15.138:0/3552300956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 msgr2=0x563c2be46640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3552300956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fb0 tx=0x7f1a68001940 comp rx=0 tx=0).stop 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- 172.21.15.138:0/3552300956 shutdown_connections 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3552300956 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be46640 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- 172.21.15.138:0/3552300956 >> 172.21.15.138:0/3552300956 conn(0x563c2bd57ec0 msgr2=0x563c2be421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- 172.21.15.138:0/3552300956 shutdown_connections 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- 172.21.15.138:0/3552300956 wait complete. 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a7965c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2bc687a0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40288/0 (socket says 172.21.15.138:40288) 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.836+0000 7f1a77177640 1 -- 172.21.15.138:0/220905841 learned_addr learned my addr 172.21.15.138:0/220905841 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77177640 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2bca8b60 con 0x563c2bd5c5f0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77177640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x563c2be474d0 tx=0x7f1a68000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 -- 172.21.15.138:0/220905841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a680037a0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c2be4db10 con 0x563c2bd5c5f0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 -- 172.21.15.138:0/220905841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68003900 con 0x563c2bd5c5f0 2024-02-16T10:31:11.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 -- 172.21.15.138:0/220905841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a68003ba0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c2be4dfc0 con 0x563c2bd5c5f0 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 -- 172.21.15.138:0/220905841 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a68028460 con 0x563c2bd5c5f0 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 0x7f195c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1963e07640 1 -- 172.21.15.138:0/220905841 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1a68049680 con 0x563c2bd5c5f0 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a76976640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 0x7f195c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 0x563c2be542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be54800 con 0x563c2bd60b00 2024-02-16T10:31:11.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77978640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 0x563c2be542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a76976640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 0x7f195c036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0ae000 tx=0x7f1a6c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77978640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 0x563c2be542c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77978640 1 -- 172.21.15.138:0/220905841 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a700083f0 con 0x563c2bd60b00 2024-02-16T10:31:11.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be519d0 con 0x563c2bd60b00 2024-02-16T10:31:11.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a77978640 1 -- 172.21.15.138:0/220905841 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a700083f0 con 0x563c2bd60b00 2024-02-16T10:31:11.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.840+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be56500 con 0x563c2bd60b00 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 -- 172.21.15.138:0/220905841 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f1a700083f0 con 0x563c2bd60b00 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be55700 con 0x563c2bd60b00 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 -- 172.21.15.138:0/220905841 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a700083f0 con 0x563c2bd60b00 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 0x563c2be59880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be59f70 con 0x563c2be56020 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77177640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 0x563c2be59880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77177640 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 0x563c2be59880 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77177640 1 -- 172.21.15.138:0/220905841 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1a68024020 con 0x563c2be56020 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2bc00f20 con 0x563c2bcd29a0 2024-02-16T10:31:11.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40292/0 (socket says 172.21.15.138:40292) 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 -- 172.21.15.138:0/2975431310 learned_addr learned my addr 172.21.15.138:0/2975431310 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 -- 172.21.15.138:0/2975431310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2bcd1380 con 0x563c2bcd29a0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a77978640 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x563c2be4e6b0 tx=0x7f1a7000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1961602640 1 -- 172.21.15.138:0/2975431310 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x563c2bcd29a0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c2bcd15d0 con 0x563c2bcd29a0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c2bcd1a60 con 0x563c2bcd29a0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1961602640 1 -- 172.21.15.138:0/2975431310 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70019550 con 0x563c2bcd29a0 2024-02-16T10:31:11.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.844+0000 7f1961602640 1 -- 172.21.15.138:0/2975431310 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a700197f0 con 0x563c2bcd29a0 2024-02-16T10:31:11.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1961602640 1 -- 172.21.15.138:0/2975431310 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a70019950 con 0x563c2bcd29a0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1961602640 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 0x7f1950036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1961602640 1 -- 172.21.15.138:0/2975431310 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1a7004ba10 con 0x563c2bcd29a0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77177640 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 0x7f1950036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2bbf4790 con 0x563c2be770d0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77177640 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 0x7f1950036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563c2be55080 tx=0x7f1a68003e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40298/0 (socket says 172.21.15.138:40298) 2024-02-16T10:31:11.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77978640 1 -- 172.21.15.138:0/226960187 learned_addr learned my addr 172.21.15.138:0/226960187 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77978640 1 -- 172.21.15.138:0/226960187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2be77ac0 con 0x563c2be770d0 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a77978640 1 --2- 172.21.15.138:0/226960187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a700056e0 tx=0x7f1a70022540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f4c327ce9f3f4e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f195affd640 1 -- 172.21.15.138:0/226960187 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a70048070 con 0x563c2be770d0 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f195affd640 1 -- 172.21.15.138:0/226960187 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70049e90 con 0x563c2be770d0 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f195affd640 1 -- 172.21.15.138:0/226960187 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a7002bca0 con 0x563c2be770d0 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- 172.21.15.138:0/226960187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 msgr2=0x563c2be774f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 --2- 172.21.15.138:0/226960187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a700056e0 tx=0x7f1a70022540 comp rx=0 tx=0).stop 2024-02-16T10:31:11.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- 172.21.15.138:0/226960187 shutdown_connections 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 --2- 172.21.15.138:0/226960187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be774f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- 172.21.15.138:0/226960187 >> 172.21.15.138:0/226960187 conn(0x563c2be71c50 msgr2=0x563c2be72b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- 172.21.15.138:0/226960187 shutdown_connections 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.848+0000 7f1a7965c980 1 -- 172.21.15.138:0/226960187 wait complete. 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 Processor -- start 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 -- start start 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2be7e240 con 0x563c2be770d0 2024-02-16T10:31:11.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77978640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40306/0 (socket says 172.21.15.138:40306) 2024-02-16T10:31:11.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 learned_addr learned my addr 172.21.15.138:0/3056152907 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2bcd1a60 con 0x563c2be770d0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77978640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a70022580 tx=0x7f1a70049ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 -- 172.21.15.138:0/3056152907 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a70031070 con 0x563c2be770d0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c2be7e440 con 0x563c2be770d0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 -- 172.21.15.138:0/3056152907 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70007380 con 0x563c2be770d0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 -- 172.21.15.138:0/3056152907 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a7002b860 con 0x563c2be770d0 2024-02-16T10:31:11.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c2be7e8d0 con 0x563c2be770d0 2024-02-16T10:31:11.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 -- 172.21.15.138:0/3056152907 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f1a70007620 con 0x563c2be770d0 2024-02-16T10:31:11.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19400342b0 0x7f1940036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f19597fa640 1 -- 172.21.15.138:0/3056152907 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1a70037d30 con 0x563c2be770d0 2024-02-16T10:31:11.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a77177640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19400342b0 0x7f1940036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2be89490 0x563c2be8b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.852+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8c0a0 con 0x563c2be89490 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2be89490 0x563c2be8b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19400342b0 0x7f1940036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a68003ec0 tx=0x7f1a6803c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2be89490 0x563c2be8b950 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 realm 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8c490 con 0x563c2be89490 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8cd10 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8d070 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8d870 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 20 searching for the correct realm 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c2be8f700 0x563c2be91b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77978640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c2be8f700 0x563c2be91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77978640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c2be8f700 0x563c2be91b10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70012070 con 0x563c2be8f700 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77978640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a70056040 0x7f1a7001a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a70056040 0x7f1a7001a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a70056040 0x7f1a7001a9b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a68057040 0x7f1a6804a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.856+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a68057040 0x7f1a6804a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a68057040 0x7f1a6804a9b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:11.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70012070 con 0x563c2be8f700 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.860+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70012070 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.864+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a70056040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be8f700 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x7f1a68057040 2024-02-16T10:31:11.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.868+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be921e0 con 0x563c2be89490 2024-02-16T10:31:11.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f1a6c0dd040 con 0x7f1a70056040 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8e070 con 0x563c2be89490 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8e420 con 0x563c2be89490 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8e800 con 0x7f1a70056040 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 zone default found 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 4 Realm: () 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 zonegroup default 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be8ecb0 con 0x7f1a68057040 2024-02-16T10:31:11.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be94050 con 0x563c2be8f700 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be94430 con 0x563c2be8f700 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 started sync module instance, tier type = 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:11.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.872+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be93930 con 0x7f1a70056040 2024-02-16T10:31:11.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94816434730128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be93ce0 con 0x7f1a70056040 2024-02-16T10:31:11.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be951f0 con 0x563c2be89490 2024-02-16T10:31:11.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94816434730128] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94816434735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be955a0 con 0x563c2be89490 2024-02-16T10:31:11.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.876+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be95f10 con 0x563c2be8f700 2024-02-16T10:31:11.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94816434735184] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94816434736240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be95f10 con 0x563c2be8f700 2024-02-16T10:31:11.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be96930 con 0x7f1a70056040 2024-02-16T10:31:11.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94816434742320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be97180 con 0x7f1a70056040 2024-02-16T10:31:11.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be97b80 con 0x563c2be89490 2024-02-16T10:31:11.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94816434736240] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.880+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94816434742320] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94816434744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be95a70 con 0x563c2be89490 2024-02-16T10:31:11.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be983d0 con 0x7f1a68057040 2024-02-16T10:31:11.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94816434744544] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94816434747008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be98330 con 0x7f1a68057040 2024-02-16T10:31:11.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.884+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be98ca0 con 0x7f1a68057040 2024-02-16T10:31:11.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94816434747008] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94816434749264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be98ca0 con 0x7f1a68057040 2024-02-16T10:31:11.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be99500 con 0x7f1a68057040 2024-02-16T10:31:11.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94816434749264] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94816434751968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be994c0 con 0x7f1a68057040 2024-02-16T10:31:11.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=0 2024-02-16T10:31:11.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=1 2024-02-16T10:31:11.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=2 2024-02-16T10:31:11.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=3 2024-02-16T10:31:11.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=4 2024-02-16T10:31:11.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=5 2024-02-16T10:31:11.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.888+0000 7f1a7965c980 20 add_watcher() i=6 2024-02-16T10:31:11.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94816434751968] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a7965c980 20 add_watcher() i=7 2024-02-16T10:31:11.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a7965c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:11.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be9c970 con 0x563c2be89490 2024-02-16T10:31:11.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.892+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94816434753280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2be99eb0 con 0x563c2be89490 2024-02-16T10:31:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94816434753280] v33'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f192dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a7965c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a7965c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea4f30 con 0x563c2be89490 2024-02-16T10:31:11.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.896+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea53d0 con 0x7f1a68057040 2024-02-16T10:31:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea5870 con 0x563c2be8f700 2024-02-16T10:31:11.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea30a0 con 0x563c2be89490 2024-02-16T10:31:11.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.900+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea3070 con 0x7f1a70056040 2024-02-16T10:31:11.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea65b0 con 0x563c2be8f700 2024-02-16T10:31:11.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea6ae0 con 0x563c2be89490 2024-02-16T10:31:11.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.904+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea2f70 con 0x7f1a68057040 2024-02-16T10:31:11.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.908+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'42 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.908+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea2f70 con 0x7f1a70056040 2024-02-16T10:31:11.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.908+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.908+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea7150 con 0x563c2be8f700 2024-02-16T10:31:11.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.912+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.912+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea75f0 con 0x7f1a70056040 2024-02-16T10:31:11.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.912+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.912+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1fd0 con 0x7f1a68057040 2024-02-16T10:31:11.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.916+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.916+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea25e0 con 0x7f1a70056040 2024-02-16T10:31:11.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.916+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.916+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea25e0 con 0x7f1a68057040 2024-02-16T10:31:11.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.916+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'48 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.920+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be89490 2024-02-16T10:31:11.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.920+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.920+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.920+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'58 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.920+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a70056040 2024-02-16T10:31:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.924+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.924+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.924+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.924+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be89490 2024-02-16T10:31:11.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.928+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.928+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be89490 2024-02-16T10:31:11.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.928+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.928+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'59 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a70056040 2024-02-16T10:31:11.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.932+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.936+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a68057040 2024-02-16T10:31:11.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.940+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.940+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.940+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.940+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a68057040 2024-02-16T10:31:11.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.944+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'43 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.944+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x563c2be8f700 2024-02-16T10:31:11.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.948+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'60 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.948+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a68057040 2024-02-16T10:31:11.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.948+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'49 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.948+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1e00 con 0x7f1a70056040 2024-02-16T10:31:11.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f192cfe1640 20 reqs_thread_entry: start 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 Filter name: none 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f18a67fc640 20 reqs_thread_entry: start 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea5ec0 con 0x7f1a70056040 2024-02-16T10:31:11.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 : miss 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 8.8 8:12c0d38e:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec3630 con 0x563c2be89490 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(95 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 info.flags=0x17 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 to cache LRU end 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 2024-02-16T10:31:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 4.2f 4:f71a4fb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf407e0 con 0x563c2be89490 2024-02-16T10:31:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(96 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 4.c 4:321b5073:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40820 con 0x563c2be89490 2024-02-16T10:31:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(97 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40820 con 0x563c2be8f700 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(98 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [call out=424b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+424 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:99 4.5 4:a127193b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40820 con 0x563c2be8f700 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(99 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a70060040 con 0x563c2be8f700 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.952+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:100 4.3f 4:fe138c38:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40820 con 0x7f1a70056040 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(100 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:101 4.15 4:aa015c5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40840 con 0x7f1a70056040 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(101 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40840 con 0x7f1a68057040 2024-02-16T10:31:11.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(102 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-02-16T10:31:11.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:103 4.9 4:93c0bcb9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40840 con 0x563c2be89490 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(103 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:104 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40860 con 0x7f1a70056040 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(104 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:105 4.11 4:89a8512a:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40860 con 0x7f1a68057040 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(105 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.956+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:106 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf40860 con 0x563c2be8f700 2024-02-16T10:31:11.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(106 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [call out=697b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+697 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-02-16T10:31:11.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:31:11.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:107 3.1s0 3:83e9e9bf:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec3b60 con 0x7f1a68057040 2024-02-16T10:31:11.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(107 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+891 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 10 manifest: total_size = 6 2024-02-16T10:31:11.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.721018011467805412 2024-02-16T10:31:11.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 20 prepare_atomic_modification: state is not atomic. state=0x563c2bf3fc88 2024-02-16T10:31:11.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 2024-02-16T10:31:11.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:108 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec8430 con 0x563c2be8f700 2024-02-16T10:31:11.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(108 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [stat,call,call] v33'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.960+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:109 3.1s0 3:83e9e9bf:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec6470 con 0x7f1a68057040 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(109 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:110 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec8870 con 0x563c2be8f700 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:111 3.1cs0 3:3bb33504:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec8870 con 0x563c2be89490 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(111 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 10 manifest: total_size = 3 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.15592132751177444694 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 20 prepare_atomic_modification: state is not atomic. state=0x563c2bf3fc88 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.964+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:112 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec88b0 con 0x7f1a68057040 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.968+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(110 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [stat,call,call] v33'10 uv10 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.968+0000 7f195affd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-02-16T10:31:11.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.968+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(112 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.968+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:113 3.1cs0 3:3bb33504:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec88b0 con 0x563c2be89490 2024-02-16T10:31:11.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(113 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:114 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9490 con 0x7f1a68057040 2024-02-16T10:31:11.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:115 3.3ds0 3:bf9da7c7:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9490 con 0x563c2be8f700 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(115 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 10 manifest: total_size = 4 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.11751816452897206550 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 20 prepare_atomic_modification: state is not atomic. state=0x563c2bf3fc88 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 2024-02-16T10:31:11.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:116 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9490 con 0x7f1a70056040 2024-02-16T10:31:11.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(114 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f195a7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-02-16T10:31:11.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(116 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.972+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:117 3.3ds0 3:bf9da7c7:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9490 con 0x563c2be8f700 2024-02-16T10:31:11.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(117 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec93f0 con 0x7f1a70056040 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:119 3.30s0 3:0eec53a6:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2beca4f0 con 0x563c2be8f700 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(119 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 10 manifest: total_size = 5 2024-02-16T10:31:11.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.3809275912263072830 2024-02-16T10:31:11.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 20 prepare_atomic_modification: state is not atomic. state=0x563c2bf3fc88 2024-02-16T10:31:11.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 2024-02-16T10:31:11.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.976+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:120 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2beceb20 con 0x563c2be8f700 2024-02-16T10:31:11.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(118 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f195affd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-02-16T10:31:11.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(120 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [stat,call,call] v33'14 uv14 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:121 3.30s0 3:0eec53a6:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2beceb20 con 0x563c2be8f700 2024-02-16T10:31:11.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(121 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:122 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec5400 con 0x563c2be8f700 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:123 3.9s0 3:91b1c150:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec5b80 con 0x563c2be8f700 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(123 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 10 manifest: total_size = 5 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 20 get_obj_state: setting s->obj_tag to _T5UKySAeh1WKkW6K_Slzh7WnFKHHSRu 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 20 get_obj_state: octx=0x7f1a68037040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563c2bf3fc88 s->prefetch_data=0 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 20 prepare_atomic_modification: state is not atomic. state=0x563c2bf3fc88 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 2024-02-16T10:31:11.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.980+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:124 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2beccbb0 con 0x563c2be8f700 2024-02-16T10:31:11.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.984+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(122 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [stat,call,call] v33'15 uv15 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.984+0000 7f195a7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-02-16T10:31:11.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.984+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(124 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [stat,call,call] v33'16 uv16 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.984+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:125 3.9s0 3:91b1c150:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec5400 con 0x563c2be8f700 2024-02-16T10:31:11.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(125 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:126 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be8f700 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:127 4.2f 4:f71a4fb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be89490 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:128 4.c 4:321b5073:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf3ff40 con 0x563c2be89490 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:129 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2becc5c0 con 0x563c2be8f700 2024-02-16T10:31:11.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:130 4.5 4:a127193b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be8f700 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:131 4.3f 4:fe138c38:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bf3ff40 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:132 4.15 4:aa015c5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bed9f30 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:133 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcce0 con 0x7f1a68057040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:134 4.9 4:93c0bcb9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedfb10 con 0x563c2be89490 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:135 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee24b0 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:136 4.11 4:89a8512a:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee4e50 con 0x7f1a68057040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:137 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee7bb0 con 0x563c2be8f700 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(128 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(127 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(131 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(132 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(135 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(133 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(134 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:11.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(129 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:11.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(136 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:11.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(130 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(126 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [stat,call,call] v33'17 uv17 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f195a7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 43 ==== osd_op_reply(137 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [call out=124b] v0'0 uv17 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5])"; uploads.size()=0; is_truncated=0 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:138 4.2f 4:f71a4fb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x563c2be89490 2024-02-16T10:31:12.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:139 4.c 4:321b5073:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be89490 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:140 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee7bb0 con 0x563c2be8f700 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:141 4.5 4:a127193b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee24b0 con 0x563c2be8f700 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:142 4.3f 4:fe138c38:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x7f1a70056040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:143 4.15 4:aa015c5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee7bb0 con 0x7f1a70056040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:144 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x7f1a68057040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:145 4.9 4:93c0bcb9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee24b0 con 0x563c2be89490 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:146 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bee77f0 con 0x7f1a70056040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:147 4.11 4:89a8512a:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x7f1a68057040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.988+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:148 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2becc590 con 0x563c2be8f700 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 44 ==== osd_op_reply(140 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(142 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(138 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(143 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 45 ==== osd_op_reply(141 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(139 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 46 ==== osd_op_reply(148 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [call out=124b] v0'0 uv17 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(144 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(146 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(145 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(147 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x7f1a70056040 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(149 foo.buckets [call] v33'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a7965c980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a7965c980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a7965c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94816435430688 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x7f1a68057040 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== watch-notify(notify (1) cookie 94816434749264 notify 141733920789 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f1a6c0e9390 con 0x7f1a68057040 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f195a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94816434749264 notifier 4647 bl.length()=149 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(150 notify.6 [notify cookie 94816435430688 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.992+0000 7f195a7fc640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18ac0032c0 con 0x7f1a68057040 2024-02-16T10:31:12.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== watch-notify(notify_complete (2) cookie 94816435430688 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1a6c0b9070 con 0x7f1a68057040 2024-02-16T10:31:12.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x7f1a70056040 2024-02-16T10:31:12.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(152 myfoo [call,call,delete] v33'40 uv40 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a7965c980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 from cache 2024-02-16T10:31:12.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a7965c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5, ofs0, ns] 2024-02-16T10:31:12.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:153 7.d 7:b4812045:::notify.4:head [notify cookie 94816435430688 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== watch-notify(notify (1) cookie 94816434744544 notify 141733920795 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f1a6c0b9070 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f195a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94816434744544 notifier 4647 bl.length()=206 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f195a7fc640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18ac0032c0 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(153 notify.4 [notify cookie 94816435430688 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== watch-notify(notify_complete (2) cookie 94816435430688 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563c2bd64440 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(154 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:11.996+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:155 8.8 8:12c0d38e:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x563c2be89490 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(155 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [call,call,delete] v33'4 uv4 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:156 4.2f 4:f71a4fb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x563c2be89490 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:157 4.c 4:321b5073:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be89490 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:158 4.5 4:a310d8c8:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bed97a0 con 0x563c2be8f700 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:159 4.5 4:a127193b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x563c2be8f700 2024-02-16T10:31:12.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:160 4.3f 4:fe138c38:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1300 con 0x7f1a70056040 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:161 4.15 4:aa015c5e:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedcd40 con 0x7f1a70056040 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:162 4.7 4:e0d379d7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bed97a0 con 0x7f1a68057040 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:163 4.9 4:93c0bcb9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be89490 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:164 4.1a 4:58b7f735:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x7f1a70056040 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:165 4.11 4:89a8512a:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bed97a0 con 0x7f1a68057040 2024-02-16T10:31:12.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:166 4.1f 4:faa756a0:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea1300 con 0x563c2be8f700 2024-02-16T10:31:12.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.000+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(156 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.0 [delete] v33'16 uv16 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(161 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.5 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(163 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.7 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(164 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.8 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 47 ==== osd_op_reply(158 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.2 [delete] v33'11 uv11 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 48 ==== osd_op_reply(166 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.10 [delete] v33'18 uv18 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(162 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.6 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 49 ==== osd_op_reply(159 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.3 [delete] v33'12 uv12 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(160 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.4 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(157 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.1 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(165 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5.9 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 : miss 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:167 6.16 6:6a1d42e2:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc900 con 0x563c2be8f700 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 50 ==== osd_op_reply(167 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 info.flags=0x0 2024-02-16T10:31:12.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 10 adding default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 to cache LRU end 2024-02-16T10:31:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 10 removing default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 from cache 2024-02-16T10:31:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5, ofs0, ns] 2024-02-16T10:31:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:168 7.e 7:7759931f:::notify.3:head [notify cookie 94816435430688 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc900 con 0x7f1a70056040 2024-02-16T10:31:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== watch-notify(notify (1) cookie 94816434742320 notify 141733920785 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7f1a68050070 con 0x7f1a70056040 2024-02-16T10:31:12.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f195a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94816434742320 notifier 4647 bl.length()=203 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(168 notify.3 [notify cookie 94816435430688 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f195a7fc640 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18ac0032a0 con 0x7f1a70056040 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== watch-notify(notify_complete (2) cookie 94816435430688 notify 141733920785 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563c2be4dfc0 con 0x7f1a70056040 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(169 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.004+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:170 6.16 6:6a1d42e2:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc900 con 0x563c2be8f700 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.008+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 51 ==== osd_op_reply(170 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.5 [delete] v33'25 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.008+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x7f1a70056040 2024-02-16T10:31:12.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.008+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== osd_op_reply(171 foo.buckets [call] v33'41 uv41 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f192dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94816434753280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be89490 2024-02-16T10:31:12.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94816434753280] v33'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94816434730128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x7f1a70056040 2024-02-16T10:31:12.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94816434730128] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a7965c980 20 remove_watcher() i=0 2024-02-16T10:31:12.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a7965c980 2 removed watcher, disabling cache 2024-02-16T10:31:12.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.012+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94816434735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea47c0 con 0x563c2be89490 2024-02-16T10:31:12.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 50 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94816434735184] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a7965c980 20 remove_watcher() i=1 2024-02-16T10:31:12.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94816434736240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x563c2be8f700 2024-02-16T10:31:12.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a77978640 1 -- 172.21.15.138:0/3056152907 <== osd.3 v2:172.21.15.138:6800/756089529 52 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94816434736240] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a700712d0 con 0x563c2be8f700 2024-02-16T10:31:12.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a7965c980 20 remove_watcher() i=2 2024-02-16T10:31:12.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.016+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94816434742320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x7f1a70056040 2024-02-16T10:31:12.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a77177640 1 -- 172.21.15.138:0/3056152907 <== osd.2 v2:172.21.15.138:6815/3134970710 43 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94816434742320] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a68024020 con 0x7f1a70056040 2024-02-16T10:31:12.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a7965c980 20 remove_watcher() i=3 2024-02-16T10:31:12.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94816434744544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea47c0 con 0x563c2be89490 2024-02-16T10:31:12.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.1 v2:172.21.15.138:6802/802812406 51 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94816434744544] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x563c2be89490 2024-02-16T10:31:12.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a7965c980 20 remove_watcher() i=4 2024-02-16T10:31:12.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.020+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94816434747008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bec9b80 con 0x7f1a68057040 2024-02-16T10:31:12.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94816434747008] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a7965c980 20 remove_watcher() i=5 2024-02-16T10:31:12.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94816434749264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bedc510 con 0x7f1a68057040 2024-02-16T10:31:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94816434749264] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a7965c980 20 remove_watcher() i=6 2024-02-16T10:31:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.024+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94816434751968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563c2bea47c0 con 0x7f1a68057040 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94816434751968] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a6c0b0020 con 0x7f1a68057040 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 20 remove_watcher() i=7 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a68057040 msgr2=0x7f1a6804a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f1a68057040 0x7f1a6804a9b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2be89490 msgr2=0x563c2be8b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2be89490 0x563c2be8b950 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a70056040 msgr2=0x7f1a7001a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f1a70056040 0x7f1a7001a9b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c2be8f700 msgr2=0x563c2be91b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563c2be8f700 0x563c2be91b10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19400342b0 msgr2=0x7f1940036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19400342b0 0x7f1940036770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a68003ec0 tx=0x7f1a6803c000 comp rx=0 tx=0).stop 2024-02-16T10:31:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a76976640 1 -- 172.21.15.138:0/3056152907 reap_dead start 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 msgr2=0x563c2be7dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a70022580 tx=0x7f1a70049ce0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 shutdown_connections 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/3056152907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2be770d0 0x563c2be7dd00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 >> 172.21.15.138:0/3056152907 conn(0x563c2be71c50 msgr2=0x563c2be72b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 shutdown_connections 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/3056152907 wait complete. 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 msgr2=0x7f1950036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 0x7f1950036770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563c2be55080 tx=0x7f1a68003e10 comp rx=0 tx=0).stop 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 msgr2=0x563c2bcd0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x563c2be4e6b0 tx=0x7f1a7000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 shutdown_connections 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f19500342b0 0x7f1950036770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/2975431310 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bcd29a0 0x563c2bcd0e40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 >> 172.21.15.138:0/2975431310 conn(0x563c2be5ccb0 msgr2=0x563c2be5d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 shutdown_connections 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/2975431310 wait complete. 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 msgr2=0x563c2be542c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 0x563c2be542c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 msgr2=0x563c2be59880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 0x563c2be59880 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 msgr2=0x7f195c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 0x7f195c036770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0ae000 tx=0x7f1a6c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 msgr2=0x563c2be4d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x563c2be474d0 tx=0x7f1a68000f50 comp rx=0 tx=0).stop 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 shutdown_connections 2024-02-16T10:31:12.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563c2be56020 0x563c2be59880 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563c2bd60b00 0x563c2be542c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f195c0342b0 0x7f195c036770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 --2- 172.21.15.138:0/220905841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563c2bd5c5f0 0x563c2be4d5d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 >> 172.21.15.138:0/220905841 conn(0x563c2bd57ec0 msgr2=0x563c2be40ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 shutdown_connections 2024-02-16T10:31:12.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.028+0000 7f1a7965c980 1 -- 172.21.15.138:0/220905841 wait complete. 2024-02-16T10:31:12.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:31:12.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:31:12.049 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-02-16T10:31:12.129 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:12.129 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:12.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebe3e1980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600c1dde980 0x5600c1de0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebe3e1980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600c1d26b60 con 0x5600c1d4e760 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebe3e1980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5600c1cedd30 con 0x5600c1dde980 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebb6fb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600c1dde980 0x5600c1de0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebbefc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5600c1d4e760 0x5600c1ddd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37190/0 (socket says 172.21.15.138:37190) 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebb6fb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5600c1dde980 0x5600c1de0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40310/0 (socket says 172.21.15.138:40310) 2024-02-16T10:31:12.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebbefc640 1 -- 172.21.15.138:0/2462880151 learned_addr learned my addr 172.21.15.138:0/2462880151 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:12.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/2462880151 >> v1:172.21.15.107:6789/0 conn(0x5600c1d4e760 legacy=0x5600c1ddd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/2462880151 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c1de2380 con 0x5600c1dde980 2024-02-16T10:31:12.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.124+0000 7f2ebaefa640 1 -- 172.21.15.138:0/2462880151 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664725942 0 0) 0x5600c1d26b60 con 0x5600c1d4e760 2024-02-16T10:31:12.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/2462880151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dde980 0x5600c1de0d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000a480 tx=0x7f2eb001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ac07e3e3c6b758 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebaefa640 1 -- 172.21.15.138:0/2462880151 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb00ab540 con 0x5600c1dde980 2024-02-16T10:31:12.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebaefa640 1 -- 172.21.15.138:0/2462880151 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00ab6a0 con 0x5600c1dde980 2024-02-16T10:31:12.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebaefa640 1 -- 172.21.15.138:0/2462880151 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb00ab960 con 0x5600c1dde980 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2462880151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dde980 msgr2=0x5600c1de0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2462880151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dde980 0x5600c1de0d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000a480 tx=0x7f2eb001b280 comp rx=0 tx=0).stop 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2462880151 shutdown_connections 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2462880151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dde980 0x5600c1de0d70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2462880151 >> 172.21.15.138:0/2462880151 conn(0x5600c1dd4d80 msgr2=0x5600c1dd71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2462880151 shutdown_connections 2024-02-16T10:31:12.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.128+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2462880151 wait complete. 2024-02-16T10:31:12.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebe3e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebe3e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c1ceafc0 con 0x5600c1d4e760 2024-02-16T10:31:12.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebbefc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebbefc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40314/0 (socket says 172.21.15.138:40314) 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebbefc640 1 -- 172.21.15.138:0/3677455248 learned_addr learned my addr 172.21.15.138:0/3677455248 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebbefc640 1 -- 172.21.15.138:0/3677455248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0005d30 con 0x5600c1d4e760 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/3677455248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b250 tx=0x7f2eac00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811a658ed39b96a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2da9e0b640 1 -- 172.21.15.138:0/3677455248 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eac014070 con 0x5600c1d4e760 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2da9e0b640 1 -- 172.21.15.138:0/3677455248 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac00d640 con 0x5600c1d4e760 2024-02-16T10:31:12.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.144+0000 7f2da9e0b640 1 -- 172.21.15.138:0/3677455248 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eac00d960 con 0x5600c1d4e760 2024-02-16T10:31:12.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/3677455248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 msgr2=0x5600c1ec4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/3677455248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b250 tx=0x7f2eac00b710 comp rx=0 tx=0).stop 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/3677455248 shutdown_connections 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/3677455248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ec4570 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/3677455248 >> 172.21.15.138:0/3677455248 conn(0x5600c1dd4d80 msgr2=0x5600c1ec0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/3677455248 shutdown_connections 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/3677455248 wait complete. 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c1ce67a0 con 0x5600c1d4e760 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebbefc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebbefc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40320/0 (socket says 172.21.15.138:40320) 2024-02-16T10:31:12.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebbefc640 1 -- 172.21.15.138:0/1026525625 learned_addr learned my addr 172.21.15.138:0/1026525625 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebbefc640 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac001bb0 con 0x5600c1d4e760 2024-02-16T10:31:12.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2da3fff640 1 -- 172.21.15.138:0/1026525625 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eac0012c0 con 0x5600c1d4e760 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2da3fff640 1 -- 172.21.15.138:0/1026525625 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac021070 con 0x5600c1d4e760 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600c1ecba60 con 0x5600c1d4e760 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2da3fff640 1 -- 172.21.15.138:0/1026525625 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eac00fc20 con 0x5600c1d4e760 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.148+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c1ecbf10 con 0x5600c1d4e760 2024-02-16T10:31:12.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2da3fff640 1 -- 172.21.15.138:0/1026525625 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2eac01a480 con 0x5600c1d4e760 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2da3fff640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 0x7f2da4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2da3fff640 1 -- 172.21.15.138:0/1026525625 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f2eac04a170 con 0x5600c1d4e760 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 0x7f2da4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 0x5600c1ed21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1ed2700 con 0x5600c1dde980 2024-02-16T10:31:12.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 0x5600c1ed21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 0x7f2da4036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ad000 tx=0x7f2eb00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 0x5600c1ed21c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/1026525625 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2eb400a4d0 con 0x5600c1dde980 2024-02-16T10:31:12.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1ed2b10 con 0x5600c1dde980 2024-02-16T10:31:12.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/1026525625 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2eb400a4d0 con 0x5600c1dde980 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1ed43c0 con 0x5600c1dde980 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/1026525625 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f2eb400a4d0 con 0x5600c1dde980 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1ed35c0 con 0x5600c1dde980 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/1026525625 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2eb400a4d0 con 0x5600c1dde980 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 0x5600c1ed7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1ed7d90 con 0x5600c1ed3ee0 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 0x5600c1ed7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 0x5600c1ed7740 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebbefc640 1 -- 172.21.15.138:0/1026525625 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2eac016070 con 0x5600c1ed3ee0 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.152+0000 7f2ebe3e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c1c7ef20 con 0x5600c1ee5d10 2024-02-16T10:31:12.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40330/0 (socket says 172.21.15.138:40330) 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/2380211205 learned_addr learned my addr 172.21.15.138:0/2380211205 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/2380211205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c1ee6670 con 0x5600c1ee5d10 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5600c1ecc0c0 tx=0x7f2eb4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 -- 172.21.15.138:0/2380211205 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb401d070 con 0x5600c1ee5d10 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600c1ee68c0 con 0x5600c1ee5d10 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 -- 172.21.15.138:0/2380211205 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb4014450 con 0x5600c1ee5d10 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 -- 172.21.15.138:0/2380211205 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb40146f0 con 0x5600c1ee5d10 2024-02-16T10:31:12.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c1ee7410 con 0x5600c1ee5d10 2024-02-16T10:31:12.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 -- 172.21.15.138:0/2380211205 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2eb4020020 con 0x5600c1ee5d10 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 0x7f2d94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2da17fa640 1 -- 172.21.15.138:0/2380211205 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f2eb404b220 con 0x5600c1ee5d10 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 0x7f2d94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 0x7f2d94036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5600c1ed3000 tx=0x7f2eac00fd80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebe3e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c1c72790 con 0x5600c1dda4e0 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40340/0 (socket says 172.21.15.138:40340) 2024-02-16T10:31:12.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.156+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/337189353 learned_addr learned my addr 172.21.15.138:0/337189353 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/337189353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c1ddaed0 con 0x5600c1dda4e0 2024-02-16T10:31:12.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/337189353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4049560 tx=0x7f2eb4014dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e1d370707a02fd server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2d9affd640 1 -- 172.21.15.138:0/337189353 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb4040070 con 0x5600c1dda4e0 2024-02-16T10:31:12.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2d9affd640 1 -- 172.21.15.138:0/337189353 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb403b190 con 0x5600c1dda4e0 2024-02-16T10:31:12.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2d9affd640 1 -- 172.21.15.138:0/337189353 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb40149c0 con 0x5600c1dda4e0 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/337189353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 msgr2=0x5600c1dda900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/337189353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4049560 tx=0x7f2eb4014dc0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/337189353 shutdown_connections 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/337189353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1dda900 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/337189353 >> 172.21.15.138:0/337189353 conn(0x5600c1eed7f0 msgr2=0x5600c1eee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/337189353 shutdown_connections 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/337189353 wait complete. 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 Processor -- start 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- start start 2024-02-16T10:31:12.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebe3e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c1efc0b0 con 0x5600c1dda4e0 2024-02-16T10:31:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40350/0 (socket says 172.21.15.138:40350) 2024-02-16T10:31:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 learned_addr learned my addr 172.21.15.138:0/436130629 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c1ee7410 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.160+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4048480 tx=0x7f2eb40494f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 -- 172.21.15.138:0/436130629 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb4040030 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600c1efc2b0 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 -- 172.21.15.138:0/436130629 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40481f0 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 -- 172.21.15.138:0/436130629 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb4033070 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c1efc740 con 0x5600c1dda4e0 2024-02-16T10:31:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 -- 172.21.15.138:0/436130629 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2eb4022850 con 0x5600c1dda4e0 2024-02-16T10:31:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d84034210 0x7f2d840366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2d997fa640 1 -- 172.21.15.138:0/436130629 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f2eb402f040 con 0x5600c1dda4e0 2024-02-16T10:31:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d84034210 0x7f2d840366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1f072d0 0x5600c1f09790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f09ee0 con 0x5600c1f072d0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1f072d0 0x5600c1f09790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d84034210 0x7f2d840366d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00ffd0 tx=0x7f2eac033030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1f072d0 0x5600c1f09790 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 realm 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0a2d0 con 0x5600c1f072d0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0ab50 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0aeb0 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.164+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0b6b0 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebe3e1980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebe3e1980 20 searching for the correct realm 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600c1f0d560 0x5600c1f0fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f100f0 con 0x5600c1f0d560 2024-02-16T10:31:12.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600c1f0d560 0x5600c1f0fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600c1f0d560 0x5600c1f0fa20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebc6fd640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2eb4014070 0x7f2eb40437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eb4014070 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2eb4014070 0x7f2eb40437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2eb4014070 0x7f2eb40437c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebbefc640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2eac027430 0x7f2eac0485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eac027430 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2eac027430 0x7f2eac0485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2eac027430 0x7f2eac0485f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.168+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eac027430 2024-02-16T10:31:12.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eb4014070 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f0d560 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f072d0 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eac027430 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f072d0 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eb4014070 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f0d560 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.172+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f0d560 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x7f2eb4014070 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038030 con 0x5600c1f0d560 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4063040 con 0x5600c1f0d560 2024-02-16T10:31:12.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4063040 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4063040 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4063040 con 0x7f2eac027430 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4063040 con 0x5600c1f0d560 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x7f2eb4014070 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.176+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x7f2eac027430 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x5600c1f0d560 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x7f2eac027430 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x7f2eb4014070 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x5600c1f0d560 2024-02-16T10:31:12.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x7f2eac027430 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb4038040 con 0x5600c1f072d0 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2eb00da080 con 0x7f2eb4014070 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:12.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.180+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0beb0 con 0x5600c1f072d0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0c260 con 0x5600c1f072d0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0c260 con 0x7f2eb4014070 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 zone default found 2024-02-16T10:31:12.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 4 Realm: () 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 zonegroup default 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f0cb30 con 0x7f2eac027430 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f11f60 con 0x5600c1f0d560 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f12370 con 0x5600c1f0d560 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 started sync module instance, tier type = 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f113f0 con 0x7f2eb4014070 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94561253789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f11bf0 con 0x7f2eb4014070 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.184+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f12de0 con 0x5600c1f072d0 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.188+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94561253789520] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.188+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.188+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94561253791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f13190 con 0x5600c1f072d0 2024-02-16T10:31:12.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.188+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f13b40 con 0x5600c1f0d560 2024-02-16T10:31:12.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.188+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94561253791568] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94561253796096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f13b00 con 0x5600c1f0d560 2024-02-16T10:31:12.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f14500 con 0x7f2eb4014070 2024-02-16T10:31:12.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94561253802080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f14d00 con 0x7f2eb4014070 2024-02-16T10:31:12.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f15720 con 0x5600c1f072d0 2024-02-16T10:31:12.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94561253796096] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94561253802080] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94561253804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f13660 con 0x5600c1f072d0 2024-02-16T10:31:12.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.192+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f15f70 con 0x7f2eac027430 2024-02-16T10:31:12.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.196+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94561253804128] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.196+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.196+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94561253806592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f15ed0 con 0x7f2eac027430 2024-02-16T10:31:12.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.196+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f16840 con 0x7f2eac027430 2024-02-16T10:31:12.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94561253806592] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94561253808688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f16950 con 0x7f2eac027430 2024-02-16T10:31:12.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f17190 con 0x7f2eac027430 2024-02-16T10:31:12.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94561253808688] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94561253811376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f17370 con 0x7f2eac027430 2024-02-16T10:31:12.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=0 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=1 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=2 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=3 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=4 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=5 2024-02-16T10:31:12.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.200+0000 7f2ebe3e1980 20 add_watcher() i=6 2024-02-16T10:31:12.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94561253811376] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 20 add_watcher() i=7 2024-02-16T10:31:12.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:12.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f1a730 con 0x5600c1f072d0 2024-02-16T10:31:12.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94561253814880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f17b20 con 0x5600c1f072d0 2024-02-16T10:31:12.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94561253814880] v33'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:12.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.204+0000 7f2ebe3e1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:12.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 5 note: GC not initialized 2024-02-16T10:31:12.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2d70fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:12.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:12.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 20 Filter name: none 2024-02-16T10:31:12.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2cea7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:12.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f3c460 con 0x5600c1f072d0 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:12.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~370 in=370b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f41df0 con 0x5600c1f072d0 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~370] v33'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94561253971984 in=558b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f3f1a0 con 0x5600c1f072d0 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94561253804128 notify 141733920796 ret 0) v3 ==== 588+0+0 (crc 0 0 0) 0x5600c1de2380 con 0x5600c1f072d0 2024-02-16T10:31:12.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94561253804128 notifier 4654 bl.length()=546 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2d9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(64 notify.4 [notify cookie 94561253971984 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2d9affd640 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f2d80003ea0 con 0x5600c1f072d0 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== watch-notify(notify_complete (2) cookie 94561253971984 notify 141733920796 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2eb00d0780 con 0x5600c1f072d0 2024-02-16T10:31:12.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.208+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.219 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:31:12.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94561253814880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f3b3b0 con 0x5600c1f072d0 2024-02-16T10:31:12.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94561253814880] v33'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94561253789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f17260 con 0x7f2eb4014070 2024-02-16T10:31:12.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94561253789520] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebe3e1980 20 remove_watcher() i=0 2024-02-16T10:31:12.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebe3e1980 2 removed watcher, disabling cache 2024-02-16T10:31:12.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.212+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94561253791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f10f50 con 0x5600c1f072d0 2024-02-16T10:31:12.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94561253791568] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebe3e1980 20 remove_watcher() i=1 2024-02-16T10:31:12.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94561253796096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f10f50 con 0x5600c1f0d560 2024-02-16T10:31:12.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebc6fd640 1 -- 172.21.15.138:0/436130629 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94561253796096] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb4042070 con 0x5600c1f0d560 2024-02-16T10:31:12.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebe3e1980 20 remove_watcher() i=2 2024-02-16T10:31:12.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.216+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94561253802080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f12900 con 0x7f2eb4014070 2024-02-16T10:31:12.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebbefc640 1 -- 172.21.15.138:0/436130629 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94561253802080] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eac016070 con 0x7f2eb4014070 2024-02-16T10:31:12.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebe3e1980 20 remove_watcher() i=3 2024-02-16T10:31:12.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94561253804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f10f50 con 0x5600c1f072d0 2024-02-16T10:31:12.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94561253804128] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x5600c1f072d0 2024-02-16T10:31:12.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebe3e1980 20 remove_watcher() i=4 2024-02-16T10:31:12.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.220+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94561253806592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f14060 con 0x7f2eac027430 2024-02-16T10:31:12.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94561253806592] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebe3e1980 20 remove_watcher() i=5 2024-02-16T10:31:12.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94561253808688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f12900 con 0x7f2eac027430 2024-02-16T10:31:12.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94561253808688] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebe3e1980 20 remove_watcher() i=6 2024-02-16T10:31:12.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.224+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94561253811376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5600c1f14860 con 0x7f2eac027430 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94561253811376] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb00ab810 con 0x7f2eac027430 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 20 remove_watcher() i=7 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2eac027430 msgr2=0x7f2eac0485f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f2eac027430 0x7f2eac0485f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1f072d0 msgr2=0x5600c1f09790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1f072d0 0x5600c1f09790 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2eb4014070 msgr2=0x7f2eb40437c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f2eb4014070 0x7f2eb40437c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600c1f0d560 msgr2=0x5600c1f0fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5600c1f0d560 0x5600c1f0fa20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d84034210 msgr2=0x7f2d840366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d84034210 0x7f2d840366d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00ffd0 tx=0x7f2eac033030 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 msgr2=0x5600c1efbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4048480 tx=0x7f2eb40494f0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebb6fb640 1 -- 172.21.15.138:0/436130629 reap_dead start 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 shutdown_connections 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/436130629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1dda4e0 0x5600c1efbb70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 >> 172.21.15.138:0/436130629 conn(0x5600c1eed7f0 msgr2=0x5600c1eee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 shutdown_connections 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/436130629 wait complete. 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 msgr2=0x7f2d94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 0x7f2d94036770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5600c1ed3000 tx=0x7f2eac00fd80 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 msgr2=0x5600c1ee6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x5600c1ecc0c0 tx=0x7f2eb4018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:12.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 shutdown_connections 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2d940342b0 0x7f2d94036770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/2380211205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1ee5d10 0x5600c1ee6130 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 >> 172.21.15.138:0/2380211205 conn(0x5600c1edab20 msgr2=0x5600c1edb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 shutdown_connections 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/2380211205 wait complete. 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 msgr2=0x5600c1ed21c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 0x5600c1ed21c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 msgr2=0x5600c1ed7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 0x5600c1ed7740 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 msgr2=0x7f2da4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 0x7f2da4036770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ad000 tx=0x7f2eb00a5040 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 msgr2=0x5600c1ecb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac000ee0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 shutdown_connections 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5600c1ed3ee0 0x5600c1ed7740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5600c1dde980 0x5600c1ed21c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2da40342b0 0x7f2da4036770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 --2- 172.21.15.138:0/1026525625 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5600c1d4e760 0x5600c1ecb520 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.228+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 >> 172.21.15.138:0/1026525625 conn(0x5600c1dd4d80 msgr2=0x5600c1ebec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.232+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 shutdown_connections 2024-02-16T10:31:12.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.232+0000 7f2ebe3e1980 1 -- 172.21.15.138:0/1026525625 wait complete. 2024-02-16T10:31:12.249 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:31:12.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:31:12.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-02-16T10:31:12.249 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-02-16T10:31:12.328 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:12.329 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.320+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.320+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61ed964980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560c46c35760 0x560c46cc6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61ed964980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560c46c0db60 con 0x560c46cc6ba0 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61ed964980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x560c46bd4d30 con 0x560c46c35760 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eb47f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x560c46c35760 0x560c46cc6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eac7e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560c46cc6ba0 0x560c46cc8f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37198/0 (socket says 172.21.15.138:37198) 2024-02-16T10:31:12.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eac7e640 1 -- 172.21.15.138:0/3954748997 learned_addr learned my addr 172.21.15.138:0/3954748997 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:12.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eb47f640 1 -- 172.21.15.138:0/3954748997 >> v1:172.21.15.107:6789/0 conn(0x560c46cc6ba0 legacy=0x560c46cc8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eb47f640 1 -- 172.21.15.138:0/3954748997 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c46ccb6c0 con 0x560c46c35760 2024-02-16T10:31:12.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61ea47d640 1 -- 172.21.15.138:0/3954748997 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054917245 0 0) 0x560c46c0db60 con 0x560c46cc6ba0 2024-02-16T10:31:12.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.324+0000 7f61eb47f640 1 --2- 172.21.15.138:0/3954748997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46cc6660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61d400a480 tx=0x7f61d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba475d4cdd622b86 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ea47d640 1 -- 172.21.15.138:0/3954748997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40ab540 con 0x560c46c35760 2024-02-16T10:31:12.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ea47d640 1 -- 172.21.15.138:0/3954748997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d40ab6a0 con 0x560c46c35760 2024-02-16T10:31:12.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ea47d640 1 -- 172.21.15.138:0/3954748997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40ab960 con 0x560c46c35760 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 -- 172.21.15.138:0/3954748997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 msgr2=0x560c46cc6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 --2- 172.21.15.138:0/3954748997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46cc6660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61d400a480 tx=0x7f61d401b280 comp rx=0 tx=0).stop 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 -- 172.21.15.138:0/3954748997 shutdown_connections 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 --2- 172.21.15.138:0/3954748997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46cc6660 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 -- 172.21.15.138:0/3954748997 >> 172.21.15.138:0/3954748997 conn(0x560c46cbbd80 msgr2=0x560c46cbe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 -- 172.21.15.138:0/3954748997 shutdown_connections 2024-02-16T10:31:12.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.328+0000 7f61ed964980 1 -- 172.21.15.138:0/3954748997 wait complete. 2024-02-16T10:31:12.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c46bd1fc0 con 0x560c46c35760 2024-02-16T10:31:12.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61eb47f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61eb47f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40372/0 (socket says 172.21.15.138:40372) 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61eb47f640 1 -- 172.21.15.138:0/1715256479 learned_addr learned my addr 172.21.15.138:0/1715256479 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61eb47f640 1 -- 172.21.15.138:0/1715256479 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4005d30 con 0x560c46c35760 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61eb47f640 1 --2- 172.21.15.138:0/1715256479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f61d4018eb0 tx=0x7f61d4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e7776a7f065514 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f60d960a640 1 -- 172.21.15.138:0/1715256479 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d400a050 con 0x560c46c35760 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f60d960a640 1 -- 172.21.15.138:0/1715256479 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d400a1b0 con 0x560c46c35760 2024-02-16T10:31:12.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f60d960a640 1 -- 172.21.15.138:0/1715256479 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40ab810 con 0x560c46c35760 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- 172.21.15.138:0/1715256479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 msgr2=0x560c46dad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 --2- 172.21.15.138:0/1715256479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f61d4018eb0 tx=0x7f61d4003030 comp rx=0 tx=0).stop 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- 172.21.15.138:0/1715256479 shutdown_connections 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 --2- 172.21.15.138:0/1715256479 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46dad7b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- 172.21.15.138:0/1715256479 >> 172.21.15.138:0/1715256479 conn(0x560c46cbbd80 msgr2=0x560c46da9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- 172.21.15.138:0/1715256479 shutdown_connections 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- 172.21.15.138:0/1715256479 wait complete. 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.344+0000 7f61ed964980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c46bcd7a0 con 0x560c46c35760 2024-02-16T10:31:12.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eb47f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eb47f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40376/0 (socket says 172.21.15.138:40376) 2024-02-16T10:31:12.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eb47f640 1 -- 172.21.15.138:0/2041618289 learned_addr learned my addr 172.21.15.138:0/2041618289 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eb47f640 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c46ccb6c0 con 0x560c46c35760 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eb47f640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61d401b2c0 tx=0x7f61d4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 -- 172.21.15.138:0/2041618289 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d40098e0 con 0x560c46c35760 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 -- 172.21.15.138:0/2041618289 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d40c3070 con 0x560c46c35760 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c46db4aa0 con 0x560c46c35760 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 -- 172.21.15.138:0/2041618289 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d4009b70 con 0x560c46c35760 2024-02-16T10:31:12.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c46db4f50 con 0x560c46c35760 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 -- 172.21.15.138:0/2041618289 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61d40b2030 con 0x560c46c35760 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 0x7f60d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f60d7e07640 1 -- 172.21.15.138:0/2041618289 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61d40e43e0 con 0x560c46c35760 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eac7e640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 0x7f60d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 0x560c46dbb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dbb740 con 0x560c46cc6ba0 2024-02-16T10:31:12.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ebc80640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 0x560c46dbb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61eac7e640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 0x7f60d0036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61e4000f90 tx=0x7f61e4006590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.348+0000 7f61ebc80640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 0x560c46dbb200 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/2041618289 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61dc0083f0 con 0x560c46cc6ba0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dbbaa0 con 0x560c46cc6ba0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/2041618289 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61dc0083f0 con 0x560c46cc6ba0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dbd320 con 0x560c46cc6ba0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/2041618289 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f61dc0083f0 con 0x560c46cc6ba0 2024-02-16T10:31:12.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dbc520 con 0x560c46cc6ba0 2024-02-16T10:31:12.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/2041618289 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61dc0083f0 con 0x560c46cc6ba0 2024-02-16T10:31:12.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 0x560c46dc06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dc0d00 con 0x560c46dbce40 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61eb47f640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 0x560c46dc06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61eb47f640 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 0x560c46dc06a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61eb47f640 1 -- 172.21.15.138:0/2041618289 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f61d4009d60 con 0x560c46dbce40 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ed964980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c46b65f20 con 0x560c46dcec80 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40388/0 (socket says 172.21.15.138:40388) 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/1176620945 learned_addr learned my addr 172.21.15.138:0/1176620945 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.352+0000 7f61ebc80640 1 -- 172.21.15.138:0/1176620945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c46dcf5e0 con 0x560c46dcec80 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x560c46db55f0 tx=0x7f61dc00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 -- 172.21.15.138:0/1176620945 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc00f040 con 0x560c46dcec80 2024-02-16T10:31:12.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c46dcf830 con 0x560c46dcec80 2024-02-16T10:31:12.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 -- 172.21.15.138:0/1176620945 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc019550 con 0x560c46dcec80 2024-02-16T10:31:12.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c46dd0380 con 0x560c46dcec80 2024-02-16T10:31:12.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 -- 172.21.15.138:0/1176620945 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc0197f0 con 0x560c46dcec80 2024-02-16T10:31:12.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 -- 172.21.15.138:0/1176620945 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61dc019950 con 0x560c46dcec80 2024-02-16T10:31:12.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 0x7f60c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f60d5602640 1 -- 172.21.15.138:0/1176620945 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61dc04b940 con 0x560c46dcec80 2024-02-16T10:31:12.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61eb47f640 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 0x7f60c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61eb47f640 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 0x7f60c4036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61d40aa570 tx=0x7f61d40e25f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ed964980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c46b59790 con 0x560c46ddbbc0 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40390/0 (socket says 172.21.15.138:40390) 2024-02-16T10:31:12.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 -- 172.21.15.138:0/1962949613 learned_addr learned my addr 172.21.15.138:0/1962949613 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 -- 172.21.15.138:0/1962949613 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c46ddc5b0 con 0x560c46ddbbc0 2024-02-16T10:31:12.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.356+0000 7f61ebc80640 1 --2- 172.21.15.138:0/1962949613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0056e0 tx=0x7f61dc02b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b221c8dac79fd11 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60ceffd640 1 -- 172.21.15.138:0/1962949613 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc048070 con 0x560c46ddbbc0 2024-02-16T10:31:12.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60ceffd640 1 -- 172.21.15.138:0/1962949613 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc022450 con 0x560c46ddbbc0 2024-02-16T10:31:12.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60ceffd640 1 -- 172.21.15.138:0/1962949613 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc03a3c0 con 0x560c46ddbbc0 2024-02-16T10:31:12.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/1962949613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 msgr2=0x560c46ddbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 --2- 172.21.15.138:0/1962949613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0056e0 tx=0x7f61dc02b460 comp rx=0 tx=0).stop 2024-02-16T10:31:12.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/1962949613 shutdown_connections 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 --2- 172.21.15.138:0/1962949613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46ddbfe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/1962949613 >> 172.21.15.138:0/1962949613 conn(0x560c46dd6740 msgr2=0x560c46dd7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/1962949613 shutdown_connections 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/1962949613 wait complete. 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 Processor -- start 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- start start 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c46de2ea0 con 0x560c46ddbbc0 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ebc80640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40394/0 (socket says 172.21.15.138:40394) 2024-02-16T10:31:12.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 learned_addr learned my addr 172.21.15.138:0/965081202 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c46dd0380 con 0x560c46ddbbc0 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ebc80640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0056e0 tx=0x7f61dc049b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60cd7fa640 1 -- 172.21.15.138:0/965081202 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc032070 con 0x560c46ddbbc0 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560c46de30a0 con 0x560c46ddbbc0 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60cd7fa640 1 -- 172.21.15.138:0/965081202 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc0225c0 con 0x560c46ddbbc0 2024-02-16T10:31:12.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f60cd7fa640 1 -- 172.21.15.138:0/965081202 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61dc02bbb0 con 0x560c46ddbbc0 2024-02-16T10:31:12.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.360+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c46de34d0 con 0x560c46ddbbc0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f60cd7fa640 1 -- 172.21.15.138:0/965081202 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61dc007710 con 0x560c46ddbbc0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f60cd7fa640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60b4034210 0x7f60b40366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f60cd7fa640 1 -- 172.21.15.138:0/965081202 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61dc038d30 con 0x560c46ddbbc0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eb47f640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60b4034210 0x7f60b40366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46dedf90 0x560c46df0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df0ba0 con 0x560c46dedf90 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46dedf90 0x560c46df0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eb47f640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60b4034210 0x7f60b40366d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x560c46dc10c0 tx=0x7f61d40d2000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46dedf90 0x560c46df0450 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 realm 2024-02-16T10:31:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46ded3f0 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df1620 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df1ea0 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df2200 con 0x560c46dedf90 2024-02-16T10:31:12.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 20 searching for the correct realm 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560c46df42c0 0x560c46df6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ebc80640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560c46df42c0 0x560c46df6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ebc80640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560c46df42c0 0x560c46df6780 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc012070 con 0x560c46df42c0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ebc80640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61dc04bc20 0x7f61dc03a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.364+0000 7f61eb47f640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61dc04bc20 0x7f61dc03a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61dc04bc20 0x7f61dc03a5f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61d4009d60 con 0x7f61dc04bc20 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61d40f1040 0x7f61d40aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61d40f1040 0x7f61d40aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61d40f1040 0x7f61d40aa5e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.368+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc012070 con 0x560c46df42c0 2024-02-16T10:31:12.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.372+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46df42c0 2024-02-16T10:31:12.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.376+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61d40f1040 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x560c46dedf90 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df6e50 con 0x7f61dc04bc20 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:12.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df3850 con 0x560c46dedf90 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df3070 con 0x560c46dedf90 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df7290 con 0x7f61dc04bc20 2024-02-16T10:31:12.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 zone default found 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 4 Realm: () 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 zonegroup default 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df75f0 con 0x7f61d40f1040 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df93b0 con 0x560c46df42c0 2024-02-16T10:31:12.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df9740 con 0x560c46df42c0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 started sync module instance, tier type = 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:12.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.380+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df8c90 con 0x7f61dc04bc20 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94610728650736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46df9040 con 0x7f61dc04bc20 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x560c46dedf90 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94610728650736] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94610728657264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfaa30 con 0x560c46dedf90 2024-02-16T10:31:12.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.384+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfb270 con 0x560c46df42c0 2024-02-16T10:31:12.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94610728657264] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94610728658320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfae50 con 0x560c46df42c0 2024-02-16T10:31:12.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfbc70 con 0x7f61dc04bc20 2024-02-16T10:31:12.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94610728662928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfc4c0 con 0x7f61dc04bc20 2024-02-16T10:31:12.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfced0 con 0x560c46dedf90 2024-02-16T10:31:12.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.388+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94610728658320] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94610728662928] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94610728665120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfc9c0 con 0x560c46dedf90 2024-02-16T10:31:12.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfd720 con 0x7f61d40f1040 2024-02-16T10:31:12.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94610728669680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfdab0 con 0x7f61d40f1040 2024-02-16T10:31:12.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfe500 con 0x7f61d40f1040 2024-02-16T10:31:12.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.392+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94610728665120] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94610728673248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfe4c0 con 0x7f61d40f1040 2024-02-16T10:31:12.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfee30 con 0x7f61d40f1040 2024-02-16T10:31:12.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94610728669680] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94610728673248] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94610728659376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfe990 con 0x7f61d40f1040 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=0 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=1 2024-02-16T10:31:12.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=2 2024-02-16T10:31:12.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=3 2024-02-16T10:31:12.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=4 2024-02-16T10:31:12.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=5 2024-02-16T10:31:12.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.396+0000 7f61ed964980 20 add_watcher() i=6 2024-02-16T10:31:12.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94610728659376] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 add_watcher() i=7 2024-02-16T10:31:12.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:12.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46e01e60 con 0x560c46dedf90 2024-02-16T10:31:12.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94610728675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dff250 con 0x560c46dedf90 2024-02-16T10:31:12.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94610728675728] v33'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f60a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 5 note: GC not initialized 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f60a0fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 Filter name: none 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f601a7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.400+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46e23c80 con 0x560c46dedf90 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~370 out=370b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+493 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 20 rados_obj.operate() r=0 bl.length=370 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:12.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~358 in=358b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46e295f0 con 0x560c46dedf90 2024-02-16T10:31:12.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~358] v33'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94610728849648 in=546b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46e264e0 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== watch-notify(notify (1) cookie 94610728665120 notify 141733920797 ret 0) v3 ==== 576+0+0 (crc 0 0 0) 0x7f61e4014880 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f60ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94610728665120 notifier 4661 bl.length()=534 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f60ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f60ceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(64 notify.4 [notify cookie 94610728849648 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f60ceffd640 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f60b0003ea0 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== watch-notify(notify_complete (2) cookie 94610728849648 notify 141733920797 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f61e4014a10 con 0x560c46dedf90 2024-02-16T10:31:12.414 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:31:12.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f60a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.404+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94610728675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46e22c40 con 0x560c46dedf90 2024-02-16T10:31:12.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94610728675728] v33'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94610728650736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfe990 con 0x7f61dc04bc20 2024-02-16T10:31:12.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94610728650736] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61ed964980 20 remove_watcher() i=0 2024-02-16T10:31:12.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61ed964980 2 removed watcher, disabling cache 2024-02-16T10:31:12.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.408+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94610728657264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfe990 con 0x560c46dedf90 2024-02-16T10:31:12.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94610728657264] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 20 remove_watcher() i=1 2024-02-16T10:31:12.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94610728658320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa170 con 0x560c46df42c0 2024-02-16T10:31:12.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ebc80640 1 -- 172.21.15.138:0/965081202 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94610728658320] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61dc05f040 con 0x560c46df42c0 2024-02-16T10:31:12.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 20 remove_watcher() i=2 2024-02-16T10:31:12.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94610728662928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x7f61dc04bc20 2024-02-16T10:31:12.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61eb47f640 1 -- 172.21.15.138:0/965081202 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94610728662928] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61d40fc040 con 0x7f61dc04bc20 2024-02-16T10:31:12.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 20 remove_watcher() i=3 2024-02-16T10:31:12.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.412+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94610728665120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x560c46dedf90 2024-02-16T10:31:12.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94610728665120] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x560c46dedf90 2024-02-16T10:31:12.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61ed964980 20 remove_watcher() i=4 2024-02-16T10:31:12.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94610728669680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x7f61d40f1040 2024-02-16T10:31:12.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94610728669680] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61ed964980 20 remove_watcher() i=5 2024-02-16T10:31:12.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.416+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94610728673248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x7f61d40f1040 2024-02-16T10:31:12.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.420+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94610728673248] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e4003460 con 0x7f61d40f1040 2024-02-16T10:31:12.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.420+0000 7f61ed964980 20 remove_watcher() i=6 2024-02-16T10:31:12.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.420+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94610728659376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x560c46dfa610 con 0x7f61d40f1040 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94610728659376] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61e404c040 con 0x7f61d40f1040 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 20 remove_watcher() i=7 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61d40f1040 msgr2=0x7f61d40aa5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61d40f1040 0x7f61d40aa5e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46dedf90 msgr2=0x560c46df0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46dedf90 0x560c46df0450 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61dc04bc20 msgr2=0x7f61dc03a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61dc04bc20 0x7f61dc03a5f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560c46df42c0 msgr2=0x560c46df6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x560c46df42c0 0x560c46df6780 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60b4034210 msgr2=0x7f60b40366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60b4034210 0x7f60b40366d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x560c46dc10c0 tx=0x7f61d40d2000 comp rx=0 tx=0).stop 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61eac7e640 1 -- 172.21.15.138:0/965081202 reap_dead start 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 msgr2=0x560c46de2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0056e0 tx=0x7f61dc049b50 comp rx=0 tx=0).stop 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 shutdown_connections 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/965081202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46ddbbc0 0x560c46de2960 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 >> 172.21.15.138:0/965081202 conn(0x560c46dd6740 msgr2=0x560c46dd7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 shutdown_connections 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/965081202 wait complete. 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 msgr2=0x7f60c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 0x7f60c4036770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61d40aa570 tx=0x7f61d40e25f0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 msgr2=0x560c46dcf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x560c46db55f0 tx=0x7f61dc00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 shutdown_connections 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60c40342b0 0x7f60c4036770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/1176620945 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46dcec80 0x560c46dcf0a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 >> 172.21.15.138:0/1176620945 conn(0x560c46dc3a90 msgr2=0x560c46dc45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 shutdown_connections 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/1176620945 wait complete. 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 msgr2=0x560c46dbb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 0x560c46dbb200 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 msgr2=0x560c46dc06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 0x560c46dc06a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 msgr2=0x7f60d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 0x7f60d0036770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f61e4000f90 tx=0x7f61e4006590 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 msgr2=0x560c46db4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f61d401b2c0 tx=0x7f61d4018020 comp rx=0 tx=0).stop 2024-02-16T10:31:12.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 shutdown_connections 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x560c46dbce40 0x560c46dc06a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x560c46cc6ba0 0x560c46dbb200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60d00342b0 0x7f60d0036770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 --2- 172.21.15.138:0/2041618289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560c46c35760 0x560c46db4560 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 >> 172.21.15.138:0/2041618289 conn(0x560c46cbbd80 msgr2=0x560c46da7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 shutdown_connections 2024-02-16T10:31:12.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.424+0000 7f61ed964980 1 -- 172.21.15.138:0/2041618289 wait complete. 2024-02-16T10:31:12.443 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:31:12.461 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:12.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-02-16T10:31:12.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-02-16T10:31:12.461 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-02-16T10:31:12.516 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:12.516 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:12.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.508+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.508+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.508+0000 7f5792657980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559677c44710 0x559677cd3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.508+0000 7f5792657980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559677c1cb50 con 0x559677cd37d0 2024-02-16T10:31:12.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.508+0000 7f5792657980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x559677be3d30 con 0x559677c44710 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559677c44710 0x559677cd3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x559677c44710 0x559677cd3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40408/0 (socket says 172.21.15.138:40408) 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f578f971640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x559677cd37d0 0x559677cd5bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:37208/0 (socket says 172.21.15.138:37208) 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 -- 172.21.15.138:0/1120016506 learned_addr learned my addr 172.21.15.138:0/1120016506 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 -- 172.21.15.138:0/1120016506 >> v1:172.21.15.107:6789/0 conn(0x559677cd37d0 legacy=0x559677cd5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 -- 172.21.15.138:0/1120016506 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677cd8380 con 0x559677c44710 2024-02-16T10:31:12.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f5790172640 1 --2- 172.21.15.138:0/1120016506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677cd3290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f578000a5c0 tx=0x7f578001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564128444672d56 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f578f170640 1 -- 172.21.15.138:0/1120016506 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800aa470 con 0x559677c44710 2024-02-16T10:31:12.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f578f170640 1 -- 172.21.15.138:0/1120016506 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800aa5d0 con 0x559677c44710 2024-02-16T10:31:12.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.512+0000 7f578f170640 1 -- 172.21.15.138:0/1120016506 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800aa890 con 0x559677c44710 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 -- 172.21.15.138:0/1120016506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 msgr2=0x559677cd3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 --2- 172.21.15.138:0/1120016506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677cd3290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f578000a5c0 tx=0x7f578001b340 comp rx=0 tx=0).stop 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 -- 172.21.15.138:0/1120016506 shutdown_connections 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 --2- 172.21.15.138:0/1120016506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677cd3290 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 -- 172.21.15.138:0/1120016506 >> 172.21.15.138:0/1120016506 conn(0x559677ccad70 msgr2=0x559677ccd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 -- 172.21.15.138:0/1120016506 shutdown_connections 2024-02-16T10:31:12.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.516+0000 7f5792657980 1 -- 172.21.15.138:0/1120016506 wait complete. 2024-02-16T10:31:12.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.528+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.528+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.528+0000 7f5792657980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.528+0000 7f5792657980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677be0fc0 con 0x559677c44710 2024-02-16T10:31:12.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40418/0 (socket says 172.21.15.138:40418) 2024-02-16T10:31:12.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 -- 172.21.15.138:0/3367741470 learned_addr learned my addr 172.21.15.138:0/3367741470 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 -- 172.21.15.138:0/3367741470 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780005df0 con 0x559677c44710 2024-02-16T10:31:12.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 --2- 172.21.15.138:0/3367741470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5780017f50 tx=0x7f5780003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3c7a779c272d4e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f567e60c640 1 -- 172.21.15.138:0/3367741470 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800aa9c0 con 0x559677c44710 2024-02-16T10:31:12.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f567e60c640 1 -- 172.21.15.138:0/3367741470 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800aab40 con 0x559677c44710 2024-02-16T10:31:12.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f567e60c640 1 -- 172.21.15.138:0/3367741470 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800aae20 con 0x559677c44710 2024-02-16T10:31:12.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- 172.21.15.138:0/3367741470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 msgr2=0x559677dba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 --2- 172.21.15.138:0/3367741470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5780017f50 tx=0x7f5780003030 comp rx=0 tx=0).stop 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- 172.21.15.138:0/3367741470 shutdown_connections 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 --2- 172.21.15.138:0/3367741470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dba690 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- 172.21.15.138:0/3367741470 >> 172.21.15.138:0/3367741470 conn(0x559677ccad70 msgr2=0x559677db6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- 172.21.15.138:0/3367741470 shutdown_connections 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- 172.21.15.138:0/3367741470 wait complete. 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5792657980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677bdc7a0 con 0x559677c44710 2024-02-16T10:31:12.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40434/0 (socket says 172.21.15.138:40434) 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 -- 172.21.15.138:0/900310346 learned_addr learned my addr 172.21.15.138:0/900310346 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.532+0000 7f5790172640 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677cd8380 con 0x559677c44710 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790172640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5780000c10 tx=0x7f57800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 -- 172.21.15.138:0/900310346 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800be9a0 con 0x559677c44710 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 -- 172.21.15.138:0/900310346 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57800beb00 con 0x559677c44710 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559677dc19c0 con 0x559677c44710 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 -- 172.21.15.138:0/900310346 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57800beda0 con 0x559677c44710 2024-02-16T10:31:12.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559677dc1e70 con 0x559677c44710 2024-02-16T10:31:12.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 -- 172.21.15.138:0/900310346 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f57800d33f0 con 0x559677c44710 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 0x7f5678036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f567ce09640 1 -- 172.21.15.138:0/900310346 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f57800c5070 con 0x559677c44710 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f578f971640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 0x7f5678036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 0x559677dc8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dc86b0 con 0x559677cd37d0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790973640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 0x559677dc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f578f971640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 0x7f5678036770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5784000f70 tx=0x7f5784001380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790973640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 0x559677dc8170 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790973640 1 -- 172.21.15.138:0/900310346 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f578800a4d0 con 0x559677cd37d0 2024-02-16T10:31:12.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dc8ac0 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790973640 1 -- 172.21.15.138:0/900310346 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f578800a4d0 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dca370 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5790973640 1 -- 172.21.15.138:0/900310346 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f578800a4d0 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.536+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dc9570 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 -- 172.21.15.138:0/900310346 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f578800a4d0 con 0x559677cd37d0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 0x559677dcd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dcdd40 con 0x559677dc9e90 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790172640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 0x559677dcd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790172640 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 0x559677dcd6f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790172640 1 -- 172.21.15.138:0/900310346 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f57800db040 con 0x559677dc9e90 2024-02-16T10:31:12.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677b74f20 con 0x559677ddbcc0 2024-02-16T10:31:12.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40440/0 (socket says 172.21.15.138:40440) 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 -- 172.21.15.138:0/1407483958 learned_addr learned my addr 172.21.15.138:0/1407483958 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 -- 172.21.15.138:0/1407483958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677ddc620 con 0x559677ddbcc0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5790973640 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x559677dc2020 tx=0x7f5788018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5675ffb640 1 -- 172.21.15.138:0/1407483958 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578801d070 con 0x559677ddbcc0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559677ddc870 con 0x559677ddbcc0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5675ffb640 1 -- 172.21.15.138:0/1407483958 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788014450 con 0x559677ddbcc0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5675ffb640 1 -- 172.21.15.138:0/1407483958 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57880146f0 con 0x559677ddbcc0 2024-02-16T10:31:12.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.540+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559677ddd3c0 con 0x559677ddbcc0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5675ffb640 1 -- 172.21.15.138:0/1407483958 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5788020020 con 0x559677ddbcc0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5675ffb640 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 0x7f5668036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5675ffb640 1 -- 172.21.15.138:0/1407483958 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f578804b210 con 0x559677ddbcc0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790172640 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 0x7f5668036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790172640 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 0x7f5668036770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x559677dc8fb0 tx=0x7f57800df040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677b68790 con 0x559677cd0560 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40442/0 (socket says 172.21.15.138:40442) 2024-02-16T10:31:12.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790973640 1 -- 172.21.15.138:0/2271436354 learned_addr learned my addr 172.21.15.138:0/2271436354 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790973640 1 -- 172.21.15.138:0/2271436354 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677cd0f50 con 0x559677cd0560 2024-02-16T10:31:12.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5790973640 1 --2- 172.21.15.138:0/2271436354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5788049550 tx=0x7f5788014ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945e0655006db74d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f566f7fe640 1 -- 172.21.15.138:0/2271436354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5788048070 con 0x559677cd0560 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f566f7fe640 1 -- 172.21.15.138:0/2271436354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788022520 con 0x559677cd0560 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f566f7fe640 1 -- 172.21.15.138:0/2271436354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5788013c70 con 0x559677cd0560 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- 172.21.15.138:0/2271436354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 msgr2=0x559677cd0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 --2- 172.21.15.138:0/2271436354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5788049550 tx=0x7f5788014ed0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- 172.21.15.138:0/2271436354 shutdown_connections 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 --2- 172.21.15.138:0/2271436354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677cd0980 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- 172.21.15.138:0/2271436354 >> 172.21.15.138:0/2271436354 conn(0x559677de37a0 msgr2=0x559677de4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- 172.21.15.138:0/2271436354 shutdown_connections 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- 172.21.15.138:0/2271436354 wait complete. 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 Processor -- start 2024-02-16T10:31:12.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- start start 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.544+0000 7f5792657980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677df2050 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790973640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:40458/0 (socket says 172.21.15.138:40458) 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 learned_addr learned my addr 172.21.15.138:0/3813075659 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677ddd3c0 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790973640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5788014f10 tx=0x7f57880494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 -- 172.21.15.138:0/3813075659 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5788034070 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559677df2250 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 -- 172.21.15.138:0/3813075659 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788016440 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 -- 172.21.15.138:0/3813075659 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578802ce30 con 0x559677cd0560 2024-02-16T10:31:12.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559677df2680 con 0x559677cd0560 2024-02-16T10:31:12.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 -- 172.21.15.138:0/3813075659 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f5788022a40 con 0x559677cd0560 2024-02-16T10:31:12.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5660034260 0x7f5660036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f566dffb640 1 -- 172.21.15.138:0/3813075659 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f5788028060 con 0x559677cd0560 2024-02-16T10:31:12.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790172640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5660034260 0x7f5660036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677dfd260 0x559677dff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dffe70 con 0x559677dfd260 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f578f971640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677dfd260 0x559677dff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f5790172640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5660034260 0x7f5660036720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57800e2fe0 tx=0x7f57800ea000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.548+0000 7f578f971640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677dfd260 0x559677dff720 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 realm 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677dfc6c0 con 0x559677dfd260 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e008f0 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e00590 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e016b0 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 20 searching for the correct realm 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559677e03560 0x559677e05a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x559677e03560 2024-02-16T10:31:12.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790973640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559677e03560 0x559677e05a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790973640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559677e03560 0x559677e05a20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5788041020 con 0x559677e03560 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790973640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5788014850 0x7f578802d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x7f5788014850 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790172640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5788014850 0x7f578802d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790172640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5788014850 0x7f578802d430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790172640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57800fd040 0x7f5780009b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x7f57800fd040 2024-02-16T10:31:12.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.552+0000 7f578f971640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57800fd040 0x7f5780009b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57800fd040 0x7f5780009b70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x559677dfd260 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x559677dfd260 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e060f0 con 0x7f57800fd040 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f57800fd040 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.556+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f57800fd040 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.560+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677e03560 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x559677dfd260 2024-02-16T10:31:12.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f578402d040 con 0x7f5788014850 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.564+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e02010 con 0x559677dfd260 2024-02-16T10:31:12.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e02860 con 0x559677dfd260 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e02860 con 0x7f5788014850 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 zone default found 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 4 Realm: () 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:12.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 zonegroup default 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e06530 con 0x7f57800fd040 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e082f0 con 0x559677e03560 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e08680 con 0x559677e03560 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 started sync module instance, tier type = 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e07780 con 0x7f5788014850 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94104744653536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e07f80 con 0x7f5788014850 2024-02-16T10:31:12.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.568+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e090f0 con 0x559677dfd260 2024-02-16T10:31:12.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.572+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94104744653536] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.572+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.572+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94104744659952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e094a0 con 0x559677dfd260 2024-02-16T10:31:12.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.572+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e09e10 con 0x559677e03560 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.572+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94104744659952] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94104744655584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e09e10 con 0x559677e03560 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0a7d0 con 0x7f5788014850 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94104744665904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0b020 con 0x7f5788014850 2024-02-16T10:31:12.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0baa0 con 0x559677dfd260 2024-02-16T10:31:12.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94104744655584] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94104744665904] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94104744670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0ab80 con 0x559677dfd260 2024-02-16T10:31:12.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.576+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0c2f0 con 0x7f57800fd040 2024-02-16T10:31:12.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94104744670624] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94104744663408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0ab80 con 0x7f57800fd040 2024-02-16T10:31:12.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0c820 con 0x7f57800fd040 2024-02-16T10:31:12.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94104744674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0cc80 con 0x7f57800fd040 2024-02-16T10:31:12.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.580+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0d650 con 0x7f57800fd040 2024-02-16T10:31:12.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94104744663408] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94104744674048] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94104744672448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0cc80 con 0x7f57800fd040 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=0 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=1 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=2 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=3 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=4 2024-02-16T10:31:12.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=5 2024-02-16T10:31:12.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.584+0000 7f5792657980 20 add_watcher() i=6 2024-02-16T10:31:12.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94104744672448] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 20 add_watcher() i=7 2024-02-16T10:31:12.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:12.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e10640 con 0x559677dfd260 2024-02-16T10:31:12.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94104744675760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e0dae0 con 0x559677dfd260 2024-02-16T10:31:12.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94104744675760] v33'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f56467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:12.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:12.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e18b40 con 0x559677dfd260 2024-02-16T10:31:12.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.588+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.592+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e18f80 con 0x7f57800fd040 2024-02-16T10:31:12.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.592+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.592+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e19420 con 0x559677e03560 2024-02-16T10:31:12.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.592+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.592+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16b30 con 0x559677dfd260 2024-02-16T10:31:12.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16b30 con 0x7f5788014850 2024-02-16T10:31:12.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1a160 con 0x559677e03560 2024-02-16T10:31:12.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.596+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1a690 con 0x559677dfd260 2024-02-16T10:31:12.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.600+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.600+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1a690 con 0x7f57800fd040 2024-02-16T10:31:12.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.600+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'44 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.600+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1a690 con 0x7f5788014850 2024-02-16T10:31:12.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1abc0 con 0x559677e03560 2024-02-16T10:31:12.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e1b060 con 0x7f5788014850 2024-02-16T10:31:12.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.604+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e15b20 con 0x7f57800fd040 2024-02-16T10:31:12.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.608+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.608+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f5788014850 2024-02-16T10:31:12.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.608+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.608+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f57800fd040 2024-02-16T10:31:12.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.612+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'50 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.612+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677dfd260 2024-02-16T10:31:12.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.612+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.612+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'61 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f5788014850 2024-02-16T10:31:12.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.616+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677dfd260 2024-02-16T10:31:12.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.620+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.620+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677dfd260 2024-02-16T10:31:12.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.620+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.620+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'62 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f5788014850 2024-02-16T10:31:12.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.624+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.628+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f57800fd040 2024-02-16T10:31:12.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.632+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.632+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.632+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.632+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f57800fd040 2024-02-16T10:31:12.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.636+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'45 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.636+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x559677e03560 2024-02-16T10:31:12.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.636+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'63 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.636+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f57800fd040 2024-02-16T10:31:12.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'51 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e16110 con 0x7f5788014850 2024-02-16T10:31:12.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f56457e2640 20 reqs_thread_entry: start 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 20 Filter name: none 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f55b6ffd640 20 reqs_thread_entry: start 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 20 rados->read ofs=0 len=0 2024-02-16T10:31:12.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e15130 con 0x559677dfd260 2024-02-16T10:31:12.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:12.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:31:12.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.640+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154d0 con 0x7f5788014850 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.644+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.644+0000 7f56467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:12.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.644+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94104744675760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154d0 con 0x559677dfd260 2024-02-16T10:31:12.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.644+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94104744675760] v33'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.644+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94104744653536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154d0 con 0x7f5788014850 2024-02-16T10:31:12.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94104744653536] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5792657980 20 remove_watcher() i=0 2024-02-16T10:31:12.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5792657980 2 removed watcher, disabling cache 2024-02-16T10:31:12.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94104744659952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x559677dfd260 2024-02-16T10:31:12.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94104744659952] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5792657980 20 remove_watcher() i=1 2024-02-16T10:31:12.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.648+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94104744655584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x559677e03560 2024-02-16T10:31:12.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5790973640 1 -- 172.21.15.138:0/3813075659 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94104744655584] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578805f040 con 0x559677e03560 2024-02-16T10:31:12.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 20 remove_watcher() i=2 2024-02-16T10:31:12.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94104744665904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x7f5788014850 2024-02-16T10:31:12.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5790172640 1 -- 172.21.15.138:0/3813075659 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94104744665904] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f57800db040 con 0x7f5788014850 2024-02-16T10:31:12.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 20 remove_watcher() i=3 2024-02-16T10:31:12.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94104744670624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x559677dfd260 2024-02-16T10:31:12.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94104744670624] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x559677dfd260 2024-02-16T10:31:12.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 20 remove_watcher() i=4 2024-02-16T10:31:12.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.652+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94104744663408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x7f57800fd040 2024-02-16T10:31:12.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.656+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94104744663408] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.656+0000 7f5792657980 20 remove_watcher() i=5 2024-02-16T10:31:12.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.656+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94104744674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x7f57800fd040 2024-02-16T10:31:12.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94104744674048] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 20 remove_watcher() i=6 2024-02-16T10:31:12.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94104744672448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x559677e154b0 con 0x7f57800fd040 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94104744672448] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f578400f620 con 0x7f57800fd040 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 20 remove_watcher() i=7 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57800fd040 msgr2=0x7f5780009b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f57800fd040 0x7f5780009b70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677dfd260 msgr2=0x559677dff720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677dfd260 0x559677dff720 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5788014850 msgr2=0x7f578802d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f5788014850 0x7f578802d430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559677e03560 msgr2=0x559677e05a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x559677e03560 0x559677e05a20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5660034260 msgr2=0x7f5660036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5660034260 0x7f5660036720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57800e2fe0 tx=0x7f57800ea000 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f578f971640 1 -- 172.21.15.138:0/3813075659 reap_dead start 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 msgr2=0x559677df1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5788014f10 tx=0x7f57880494e0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 shutdown_connections 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/3813075659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677cd0560 0x559677df1b10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 >> 172.21.15.138:0/3813075659 conn(0x559677de37a0 msgr2=0x559677de4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 shutdown_connections 2024-02-16T10:31:12.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/3813075659 wait complete. 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 msgr2=0x7f5668036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 0x7f5668036770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x559677dc8fb0 tx=0x7f57800df040 comp rx=0 tx=0).stop 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 msgr2=0x559677ddc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x559677dc2020 tx=0x7f5788018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 shutdown_connections 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56680342b0 0x7f5668036770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/1407483958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677ddbcc0 0x559677ddc0e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 >> 172.21.15.138:0/1407483958 conn(0x559677dd0ad0 msgr2=0x559677dd15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 shutdown_connections 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/1407483958 wait complete. 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 msgr2=0x559677dc8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 0x559677dc8170 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 msgr2=0x559677dcd6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 0x559677dcd6f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 msgr2=0x7f5678036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 0x7f5678036770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5784000f70 tx=0x7f5784001380 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 msgr2=0x559677dc1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5780000c10 tx=0x7f57800180e0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 shutdown_connections 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x559677dc9e90 0x559677dcd6f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x559677cd37d0 0x559677dc8170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f56780342b0 0x7f5678036770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 --2- 172.21.15.138:0/900310346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559677c44710 0x559677dc1480 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.660+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 >> 172.21.15.138:0/900310346 conn(0x559677ccad70 msgr2=0x559677db4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.664+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 shutdown_connections 2024-02-16T10:31:12.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:12.664+0000 7f5792657980 1 -- 172.21.15.138:0/900310346 wait complete. 2024-02-16T10:31:12.680 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:31:12.701 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:12.708 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-02-16T10:31:47.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-02-16T10:31:47.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-02-16T10:31:47.710 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-02-16T10:31:47.750 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:47.750 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:47.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05f0184980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563b4efcbaf0 0x563b4efcdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05f0184980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b4ef13b50 con 0x563b4efc75e0 2024-02-16T10:31:47.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05f0184980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b4eedad30 con 0x563b4efcbaf0 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05ed49e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563b4efcbaf0 0x563b4efcdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05ed49e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563b4efcbaf0 0x563b4efcdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60890/0 (socket says 172.21.15.138:60890) 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05ed49e640 1 -- 172.21.15.138:0/3993659079 learned_addr learned my addr 172.21.15.138:0/3993659079 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05edc9f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563b4efc75e0 0x563b4efc79c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:35168/0 (socket says 172.21.15.138:35168) 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05ed49e640 1 -- 172.21.15.138:0/3993659079 >> v1:172.21.15.107:6789/0 conn(0x563b4efc75e0 legacy=0x563b4efc79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.747+0000 7f05ed49e640 1 -- 172.21.15.138:0/3993659079 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b4efcf430 con 0x563b4efcbaf0 2024-02-16T10:31:47.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05ed49e640 1 --2- 172.21.15.138:0/3993659079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efcbaf0 0x563b4efcdee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f05e400a4e0 tx=0x7f05e401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f652658d5dcc9234 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05ecc9d640 1 -- 172.21.15.138:0/3993659079 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e40aa540 con 0x563b4efcbaf0 2024-02-16T10:31:47.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05ecc9d640 1 -- 172.21.15.138:0/3993659079 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40a6070 con 0x563b4efcbaf0 2024-02-16T10:31:47.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05ecc9d640 1 -- 172.21.15.138:0/3993659079 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e40aa850 con 0x563b4efcbaf0 2024-02-16T10:31:47.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 -- 172.21.15.138:0/3993659079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efcbaf0 msgr2=0x563b4efcdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 --2- 172.21.15.138:0/3993659079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efcbaf0 0x563b4efcdee0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f05e400a4e0 tx=0x7f05e401b090 comp rx=0 tx=0).stop 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 -- 172.21.15.138:0/3993659079 shutdown_connections 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 --2- 172.21.15.138:0/3993659079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efcbaf0 0x563b4efcdee0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 -- 172.21.15.138:0/3993659079 >> 172.21.15.138:0/3993659079 conn(0x563b4efc2eb0 msgr2=0x563b4efc52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 -- 172.21.15.138:0/3993659079 shutdown_connections 2024-02-16T10:31:47.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.751+0000 7f05f0184980 1 -- 172.21.15.138:0/3993659079 wait complete. 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05f0184980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05f0184980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b4eed7fc0 con 0x563b4efc75e0 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05edc9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05edc9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60906/0 (socket says 172.21.15.138:60906) 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05edc9f640 1 -- 172.21.15.138:0/1189253096 learned_addr learned my addr 172.21.15.138:0/1189253096 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05edc9f640 1 -- 172.21.15.138:0/1189253096 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e400a1c0 con 0x563b4efc75e0 2024-02-16T10:31:47.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f05edc9f640 1 --2- 172.21.15.138:0/1189253096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05e0001d40 tx=0x7f05e000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc95dd93b3b89e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f04dbe07640 1 -- 172.21.15.138:0/1189253096 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e0014070 con 0x563b4efc75e0 2024-02-16T10:31:47.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f04dbe07640 1 -- 172.21.15.138:0/1189253096 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000f590 con 0x563b4efc75e0 2024-02-16T10:31:47.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.767+0000 7f04dbe07640 1 -- 172.21.15.138:0/1189253096 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e0007040 con 0x563b4efc75e0 2024-02-16T10:31:47.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/1189253096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 msgr2=0x563b4f0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 --2- 172.21.15.138:0/1189253096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05e0001d40 tx=0x7f05e000b610 comp rx=0 tx=0).stop 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/1189253096 shutdown_connections 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 --2- 172.21.15.138:0/1189253096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b1680 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/1189253096 >> 172.21.15.138:0/1189253096 conn(0x563b4efc2eb0 msgr2=0x563b4f0ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/1189253096 shutdown_connections 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/1189253096 wait complete. 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b4eed37a0 con 0x563b4efc75e0 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05edc9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05edc9f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60922/0 (socket says 172.21.15.138:60922) 2024-02-16T10:31:47.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05edc9f640 1 -- 172.21.15.138:0/2616639169 learned_addr learned my addr 172.21.15.138:0/2616639169 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05edc9f640 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b4ef13b50 con 0x563b4efc75e0 2024-02-16T10:31:47.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05edc9f640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b650 tx=0x7f05e0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f04da604640 1 -- 172.21.15.138:0/2616639169 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e0014030 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f04da604640 1 -- 172.21.15.138:0/2616639169 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0001530 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b4f0b8b30 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f04da604640 1 -- 172.21.15.138:0/2616639169 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e000eb10 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.771+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b4f0b8fe0 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f04da604640 1 -- 172.21.15.138:0/2616639169 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05e000ed00 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f04da604640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 0x7f04d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f04da604640 1 -- 172.21.15.138:0/2616639169 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f05e0006070 con 0x563b4efc75e0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ed49e640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 0x7f04d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 0x563b4f0bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0bf820 con 0x563b4efcbaf0 2024-02-16T10:31:47.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 0x563b4f0bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ed49e640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 0x7f04d4036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab000 tx=0x7f05e40a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 0x563b4f0bf2e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2616639169 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e80083f0 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0bc9f0 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2616639169 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05e80083f0 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0c1520 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2616639169 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f05e80083f0 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0c0720 con 0x563b4efcbaf0 2024-02-16T10:31:47.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2616639169 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05e80083f0 con 0x563b4efcbaf0 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 0x563b4f0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0c4f90 con 0x563b4f0c1040 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05edc9f640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 0x563b4f0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05edc9f640 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 0x563b4f0c48a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05edc9f640 1 -- 172.21.15.138:0/2616639169 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f05e0016070 con 0x563b4f0c1040 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.775+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05f0184980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05f0184980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b4ee6bf20 con 0x563b4f0d2ec0 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60936/0 (socket says 172.21.15.138:60936) 2024-02-16T10:31:47.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2252131510 learned_addr learned my addr 172.21.15.138:0/2252131510 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2252131510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b4f0d3820 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x563b4f0b9840 tx=0x7f05e800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 -- 172.21.15.138:0/2252131510 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e800f040 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 -- 172.21.15.138:0/2252131510 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8019550 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b4f0d3a70 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 -- 172.21.15.138:0/2252131510 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e8019810 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b4f0d45c0 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 -- 172.21.15.138:0/2252131510 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05e8019970 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 0x7f04c80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f04d37fe640 1 -- 172.21.15.138:0/2252131510 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f05e804b580 con 0x563b4f0d2ec0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05edc9f640 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 0x7f04c80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.779+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05edc9f640 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 0x7f04c80367c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x563b4f0c00a0 tx=0x7f05e0018f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b4ee5f790 con 0x563b4f0dfdd0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60938/0 (socket says 172.21.15.138:60938) 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2039893519 learned_addr learned my addr 172.21.15.138:0/2039893519 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 -- 172.21.15.138:0/2039893519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b4f0e0780 con 0x563b4f0dfdd0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/2039893519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05e8049870 tx=0x7f05e802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e0d3f567774508 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f04d17fa640 1 -- 172.21.15.138:0/2039893519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e803b580 con 0x563b4f0dfdd0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f04d17fa640 1 -- 172.21.15.138:0/2039893519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e80183b0 con 0x563b4f0dfdd0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f04d17fa640 1 -- 172.21.15.138:0/2039893519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e80153a0 con 0x563b4f0dfdd0 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- 172.21.15.138:0/2039893519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 msgr2=0x563b4f0e01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 --2- 172.21.15.138:0/2039893519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05e8049870 tx=0x7f05e802af40 comp rx=0 tx=0).stop 2024-02-16T10:31:47.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- 172.21.15.138:0/2039893519 shutdown_connections 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 --2- 172.21.15.138:0/2039893519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e01b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- 172.21.15.138:0/2039893519 >> 172.21.15.138:0/2039893519 conn(0x563b4f0da9a0 msgr2=0x563b4f0db880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- 172.21.15.138:0/2039893519 shutdown_connections 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- 172.21.15.138:0/2039893519 wait complete. 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 Processor -- start 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- start start 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05f0184980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b4f0e7060 con 0x563b4f0dfdd0 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60944/0 (socket says 172.21.15.138:60944) 2024-02-16T10:31:47.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 learned_addr learned my addr 172.21.15.138:0/860580816 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.783+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b4f0d45c0 con 0x563b4f0dfdd0 2024-02-16T10:31:47.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e6b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ab00 tx=0x7f05e80497d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 -- 172.21.15.138:0/860580816 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e8019c20 con 0x563b4f0dfdd0 2024-02-16T10:31:47.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b4f0e7260 con 0x563b4f0dfdd0 2024-02-16T10:31:47.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 -- 172.21.15.138:0/860580816 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8018520 con 0x563b4f0dfdd0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 -- 172.21.15.138:0/860580816 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05e80158a0 con 0x563b4f0dfdd0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b4f0e76f0 con 0x563b4f0dfdd0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 -- 172.21.15.138:0/860580816 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f05e8017a50 con 0x563b4f0dfdd0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b80342b0 0x7f04b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f04bf7fe640 1 -- 172.21.15.138:0/860580816 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f05e8036d70 con 0x563b4f0dfdd0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05edc9f640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b80342b0 0x7f04b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4f0f2290 0x563b4f0f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f4e80 con 0x563b4f0f2290 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ed49e640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4f0f2290 0x563b4f0f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05edc9f640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b80342b0 0x7f04b8036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e610 tx=0x7f05e0031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ed49e640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4f0f2290 0x563b4f0f4730 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 realm 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f5270 con 0x563b4f0f2290 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f5ac0 con 0x563b4f0f2290 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.787+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f5e20 con 0x563b4f0f2290 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f5760 con 0x563b4f0f2290 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 20 searching for the correct realm 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563b4f0f8070 0x563b4f0fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563b4f0f8070 0x563b4f0fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563b4f0f8070 0x563b4f0fa4c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ee4a0640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e8022070 0x7f05e80076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05edc9f640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e8022070 0x7f05e80076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05edc9f640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e8022070 0x7f05e80076c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05edc9f640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05e00417f0 0x7f05e001b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05e00417f0 0x7f05e001b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05e00417f0 0x7f05e001b830 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.791+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.795+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.799+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f8070 2024-02-16T10:31:47.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e00417f0 2024-02-16T10:31:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x563b4f0f2290 2024-02-16T10:31:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fab90 con 0x7f05e8022070 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f6c80 con 0x563b4f0f2290 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.803+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f6900 con 0x563b4f0f2290 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0f7550 con 0x7f05e8022070 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 zone default found 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 4 Realm: () 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 zonegroup default 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fb020 con 0x7f05e00417f0 2024-02-16T10:31:47.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fcea0 con 0x563b4f0f8070 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados->read ofs=0 len=0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fd200 con 0x563b4f0f8070 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 started sync module instance, tier type = 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:47.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fc470 con 0x7f05e8022070 2024-02-16T10:31:47.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94812729491408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fd560 con 0x7f05e8022070 2024-02-16T10:31:47.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.807+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fdf10 con 0x563b4f0f2290 2024-02-16T10:31:47.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.811+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94812729491408] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.811+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.811+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94812729493600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fe2c0 con 0x563b4f0f2290 2024-02-16T10:31:47.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.811+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fec30 con 0x563b4f0f8070 2024-02-16T10:31:47.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94812729501584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0febb0 con 0x563b4f0f8070 2024-02-16T10:31:47.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0ffb00 con 0x7f05e8022070 2024-02-16T10:31:47.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94812729493600] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94812729498160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0ffee0 con 0x7f05e8022070 2024-02-16T10:31:47.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f100890 con 0x563b4f0f2290 2024-02-16T10:31:47.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94812729501584] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94812729498160] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.815+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94812729505312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f1003b0 con 0x563b4f0f2290 2024-02-16T10:31:47.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.819+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f1010e0 con 0x7f05e00417f0 2024-02-16T10:31:47.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.819+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94812729505312] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.819+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.819+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94812729503712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f101070 con 0x7f05e00417f0 2024-02-16T10:31:47.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.819+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f1019e0 con 0x7f05e00417f0 2024-02-16T10:31:47.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94812729503712] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94812729511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f1019e0 con 0x7f05e00417f0 2024-02-16T10:31:47.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102350 con 0x7f05e00417f0 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94812729511136] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94812729513584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102350 con 0x7f05e00417f0 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=0 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=1 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=2 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=3 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=4 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=5 2024-02-16T10:31:47.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.823+0000 7f05f0184980 20 add_watcher() i=6 2024-02-16T10:31:47.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94812729513584] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 20 add_watcher() i=7 2024-02-16T10:31:47.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:47.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f105690 con 0x563b4f0f2290 2024-02-16T10:31:47.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94812729516064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f1028e0 con 0x563b4f0f2290 2024-02-16T10:31:47.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94812729516064] v33'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f049f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:47.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:47.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:47.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.827+0000 7f05f0184980 5 note: GC not initialized 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f049e7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 20 Filter name: none 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f040ffff640 20 reqs_thread_entry: start 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f2290 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x7f05e8022070 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f2290 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f2290 2024-02-16T10:31:47.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f2290 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f8070 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x563b4f0f8070 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.831+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f127c80 con 0x7f05e00417f0 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129600 con 0x563b4f0f2290 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129600 con 0x7f05e8022070 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129600 con 0x563b4f0f8070 2024-02-16T10:31:47.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129600 con 0x7f05e00417f0 2024-02-16T10:31:47.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e00417f0 2024-02-16T10:31:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.835+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e00417f0 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+185 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f2290 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x563b4f0f2290 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e00417f0 2024-02-16T10:31:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e8022070 2024-02-16T10:31:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e00417f0 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40aa8f0 con 0x7f05e00417f0 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f2290 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f2290 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.839+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f2290 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f2290 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x563b4f0f8070 2024-02-16T10:31:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f129560 con 0x7f05e00417f0 2024-02-16T10:31:47.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x7f05e00417f0 2024-02-16T10:31:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f049f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:47.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.843+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94812729516064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f126220 con 0x563b4f0f2290 2024-02-16T10:31:47.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94812729516064] v33'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94812729491408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102020 con 0x7f05e8022070 2024-02-16T10:31:47.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94812729491408] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05f0184980 20 remove_watcher() i=0 2024-02-16T10:31:47.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05f0184980 2 removed watcher, disabling cache 2024-02-16T10:31:47.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.847+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94812729493600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102020 con 0x563b4f0f2290 2024-02-16T10:31:47.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94812729493600] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 20 remove_watcher() i=1 2024-02-16T10:31:47.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94812729501584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102020 con 0x563b4f0f8070 2024-02-16T10:31:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05ee4a0640 1 -- 172.21.15.138:0/860580816 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94812729501584] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e8012070 con 0x563b4f0f8070 2024-02-16T10:31:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 20 remove_watcher() i=2 2024-02-16T10:31:47.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94812729498160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fe790 con 0x7f05e8022070 2024-02-16T10:31:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05edc9f640 1 -- 172.21.15.138:0/860580816 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94812729498160] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e0016070 con 0x7f05e8022070 2024-02-16T10:31:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 20 remove_watcher() i=3 2024-02-16T10:31:47.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.851+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94812729505312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102020 con 0x563b4f0f2290 2024-02-16T10:31:47.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.855+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94812729505312] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x563b4f0f2290 2024-02-16T10:31:47.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.855+0000 7f05f0184980 20 remove_watcher() i=4 2024-02-16T10:31:47.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.855+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94812729503712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fda30 con 0x7f05e00417f0 2024-02-16T10:31:47.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94812729503712] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x7f05e00417f0 2024-02-16T10:31:47.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05f0184980 20 remove_watcher() i=5 2024-02-16T10:31:47.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94812729511136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f0fe790 con 0x7f05e00417f0 2024-02-16T10:31:47.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94812729511136] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x7f05e00417f0 2024-02-16T10:31:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05f0184980 20 remove_watcher() i=6 2024-02-16T10:31:47.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.859+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94812729513584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563b4f102020 con 0x7f05e00417f0 2024-02-16T10:31:47.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94812729513584] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05e40e7040 con 0x7f05e00417f0 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 20 remove_watcher() i=7 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05e00417f0 msgr2=0x7f05e001b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f05e00417f0 0x7f05e001b830 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4f0f2290 msgr2=0x563b4f0f4730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4f0f2290 0x563b4f0f4730 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e8022070 msgr2=0x7f05e80076c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f05e8022070 0x7f05e80076c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563b4f0f8070 msgr2=0x563b4f0fa4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563b4f0f8070 0x563b4f0fa4c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b80342b0 msgr2=0x7f04b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04b80342b0 0x7f04b8036770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e610 tx=0x7f05e0031000 comp rx=0 tx=0).stop 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 msgr2=0x563b4f0e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/860580816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0dfdd0 0x563b4f0e6b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05e802ab00 tx=0x7f05e80497d0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 reap_dead start 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05ed49e640 1 -- 172.21.15.138:0/860580816 reap_dead start 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 shutdown_connections 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 >> 172.21.15.138:0/860580816 conn(0x563b4f0da9a0 msgr2=0x563b4f0db880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 shutdown_connections 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/860580816 wait complete. 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 msgr2=0x7f04c80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 0x7f04c80367c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x563b4f0c00a0 tx=0x7f05e0018f60 comp rx=0 tx=0).stop 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 msgr2=0x563b4f0d32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x563b4f0b9840 tx=0x7f05e800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 shutdown_connections 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04c8034300 0x7f04c80367c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2252131510 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4f0d2ec0 0x563b4f0d32e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 >> 172.21.15.138:0/2252131510 conn(0x563b4f0c7cd0 msgr2=0x563b4f0c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 shutdown_connections 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2252131510 wait complete. 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 msgr2=0x563b4f0bf2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 0x563b4f0bf2e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 msgr2=0x563b4f0c48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 0x563b4f0c48a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 msgr2=0x7f04d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 0x7f04d4036770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab000 tx=0x7f05e40a5000 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 msgr2=0x563b4f0b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b650 tx=0x7f05e0000ee0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 shutdown_connections 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563b4f0c1040 0x563b4f0c48a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563b4efcbaf0 0x563b4f0bf2e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f04d40342b0 0x7f04d4036770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 --2- 172.21.15.138:0/2616639169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563b4efc75e0 0x563b4f0b85f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 >> 172.21.15.138:0/2616639169 conn(0x563b4efc2eb0 msgr2=0x563b4f0abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 shutdown_connections 2024-02-16T10:31:47.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.863+0000 7f05f0184980 1 -- 172.21.15.138:0/2616639169 wait complete. 2024-02-16T10:31:47.878 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:47.879 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:47.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-02-16T10:31:47.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-02-16T10:31:47.879 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-02-16T10:31:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.951+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.951+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe562ff6980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55971e6f99f0 0x55971e6fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe562ff6980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55971e642b40 con 0x55971e6f5490 2024-02-16T10:31:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe562ff6980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55971e609d30 con 0x55971e6f99f0 2024-02-16T10:31:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55971e6f99f0 0x55971e6fbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55971e6f99f0 0x55971e6fbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60956/0 (socket says 172.21.15.138:60956) 2024-02-16T10:31:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe560b11640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55971e6f5490 0x55971e6f5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:35178/0 (socket says 172.21.15.138:35178) 2024-02-16T10:31:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 -- 172.21.15.138:0/2961414785 learned_addr learned my addr 172.21.15.138:0/2961414785 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 -- 172.21.15.138:0/2961414785 >> v1:172.21.15.107:6789/0 conn(0x55971e6f5490 legacy=0x55971e6f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 -- 172.21.15.138:0/2961414785 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971e6fd330 con 0x55971e6f99f0 2024-02-16T10:31:47.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe558310640 1 --2- 172.21.15.138:0/2961414785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f99f0 0x55971e6fbde0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe54800a5c0 tx=0x7fe54801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4da59bf6326861 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe55bfff640 1 -- 172.21.15.138:0/2961414785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5480aa470 con 0x55971e6f99f0 2024-02-16T10:31:47.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe55bfff640 1 -- 172.21.15.138:0/2961414785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480aa5d0 con 0x55971e6f99f0 2024-02-16T10:31:47.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.955+0000 7fe55bfff640 1 -- 172.21.15.138:0/2961414785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5480aa890 con 0x55971e6f99f0 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 -- 172.21.15.138:0/2961414785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f99f0 msgr2=0x55971e6fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2961414785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f99f0 0x55971e6fbde0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe54800a5c0 tx=0x7fe54801b340 comp rx=0 tx=0).stop 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 -- 172.21.15.138:0/2961414785 shutdown_connections 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2961414785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f99f0 0x55971e6fbde0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 -- 172.21.15.138:0/2961414785 >> 172.21.15.138:0/2961414785 conn(0x55971e6f0d60 msgr2=0x55971e6f3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 -- 172.21.15.138:0/2961414785 shutdown_connections 2024-02-16T10:31:47.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.959+0000 7fe562ff6980 1 -- 172.21.15.138:0/2961414785 wait complete. 2024-02-16T10:31:47.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:47.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:47.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971e606fc0 con 0x55971e6f5490 2024-02-16T10:31:47.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe560b11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe560b11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60960/0 (socket says 172.21.15.138:60960) 2024-02-16T10:31:47.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe560b11640 1 -- 172.21.15.138:0/1813538156 learned_addr learned my addr 172.21.15.138:0/1813538156 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe560b11640 1 -- 172.21.15.138:0/1813538156 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548005df0 con 0x55971e6f5490 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe560b11640 1 --2- 172.21.15.138:0/1813538156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe550001cc0 tx=0x7fe55000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00f223aa2e69631 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe44ee0d640 1 -- 172.21.15.138:0/1813538156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe550014070 con 0x55971e6f5490 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe44ee0d640 1 -- 172.21.15.138:0/1813538156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000f590 con 0x55971e6f5490 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe44ee0d640 1 -- 172.21.15.138:0/1813538156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe550007040 con 0x55971e6f5490 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- 172.21.15.138:0/1813538156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 msgr2=0x55971e669e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 --2- 172.21.15.138:0/1813538156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe550001cc0 tx=0x7fe55000b610 comp rx=0 tx=0).stop 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- 172.21.15.138:0/1813538156 shutdown_connections 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 --2- 172.21.15.138:0/1813538156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e669e10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- 172.21.15.138:0/1813538156 >> 172.21.15.138:0/1813538156 conn(0x55971e6f0d60 msgr2=0x55971e7db110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- 172.21.15.138:0/1813538156 shutdown_connections 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.975+0000 7fe562ff6980 1 -- 172.21.15.138:0/1813538156 wait complete. 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971e6027a0 con 0x55971e6f5490 2024-02-16T10:31:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe560b11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe560b11640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60976/0 (socket says 172.21.15.138:60976) 2024-02-16T10:31:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe560b11640 1 -- 172.21.15.138:0/2932835360 learned_addr learned my addr 172.21.15.138:0/2932835360 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe560b11640 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971e642b40 con 0x55971e6f5490 2024-02-16T10:31:47.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe560b11640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55971e7df320 tx=0x7fe550000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe44d60a640 1 -- 172.21.15.138:0/2932835360 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe550014030 con 0x55971e6f5490 2024-02-16T10:31:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe44d60a640 1 -- 172.21.15.138:0/2932835360 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55001c840 con 0x55971e6f5490 2024-02-16T10:31:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe44d60a640 1 -- 172.21.15.138:0/2932835360 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55001cb40 con 0x55971e6f5490 2024-02-16T10:31:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55971e7e9d30 con 0x55971e6f5490 2024-02-16T10:31:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55971e7ea1e0 con 0x55971e6f5490 2024-02-16T10:31:47.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.979+0000 7fe44d60a640 1 -- 172.21.15.138:0/2932835360 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe55001cca0 con 0x55971e6f5490 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe44d60a640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 0x7fe448036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe44d60a640 1 -- 172.21.15.138:0/2932835360 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe550006070 con 0x55971e6f5490 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe558310640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 0x7fe448036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 0x55971e7f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e7f0a20 con 0x55971e6f99f0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 0x55971e7f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe558310640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 0x7fe448036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5480ae000 tx=0x7fe5480a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 0x55971e7f04e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 -- 172.21.15.138:0/2932835360 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e6f99f0 2024-02-16T10:31:47.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e7f0e30 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 -- 172.21.15.138:0/2932835360 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e7f26e0 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 -- 172.21.15.138:0/2932835360 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e7f18e0 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe561312640 1 -- 172.21.15.138:0/2932835360 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e6f99f0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 0x55971e7f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e7f60b0 con 0x55971e7f2200 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe560b11640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 0x55971e7f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe560b11640 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 0x55971e7f5a60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe560b11640 1 -- 172.21.15.138:0/2932835360 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe550016070 con 0x55971e7f2200 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.983+0000 7fe562ff6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971e59af20 con 0x55971e804030 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60988/0 (socket says 172.21.15.138:60988) 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe561312640 1 -- 172.21.15.138:0/3444895201 learned_addr learned my addr 172.21.15.138:0/3444895201 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe561312640 1 -- 172.21.15.138:0/3444895201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971e804990 con 0x55971e804030 2024-02-16T10:31:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe561312640 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55971e7eac20 tx=0x7fe55c018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 -- 172.21.15.138:0/3444895201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c01d070 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 -- 172.21.15.138:0/3444895201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c014450 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55971e804be0 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 -- 172.21.15.138:0/3444895201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c0146f0 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55971e805730 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 -- 172.21.15.138:0/3444895201 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe55c020020 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 0x7fe438036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe4467fc640 1 -- 172.21.15.138:0/3444895201 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe55c04b180 con 0x55971e804030 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe560b11640 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 0x7fe438036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe560b11640 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 0x7fe438036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55971e7f1320 tx=0x7fe550048220 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.987+0000 7fe562ff6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971e58e790 con 0x55971e810fd0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60990/0 (socket says 172.21.15.138:60990) 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 -- 172.21.15.138:0/1602230724 learned_addr learned my addr 172.21.15.138:0/1602230724 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 -- 172.21.15.138:0/1602230724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971e8119c0 con 0x55971e810fd0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 --2- 172.21.15.138:0/1602230724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0494c0 tx=0x7fe55c0480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90aeab86b445c854 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe437fff640 1 -- 172.21.15.138:0/1602230724 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c03b050 con 0x55971e810fd0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe437fff640 1 -- 172.21.15.138:0/1602230724 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c03b1b0 con 0x55971e810fd0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe437fff640 1 -- 172.21.15.138:0/1602230724 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c012690 con 0x55971e810fd0 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- 172.21.15.138:0/1602230724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 msgr2=0x55971e8113f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 --2- 172.21.15.138:0/1602230724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0494c0 tx=0x7fe55c0480e0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- 172.21.15.138:0/1602230724 shutdown_connections 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 --2- 172.21.15.138:0/1602230724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e8113f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- 172.21.15.138:0/1602230724 >> 172.21.15.138:0/1602230724 conn(0x55971e80bb50 msgr2=0x55971e80ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- 172.21.15.138:0/1602230724 shutdown_connections 2024-02-16T10:31:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- 172.21.15.138:0/1602230724 wait complete. 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 Processor -- start 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- start start 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe562ff6980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55971e818280 con 0x55971e810fd0 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:60996/0 (socket says 172.21.15.138:60996) 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 learned_addr learned my addr 172.21.15.138:0/4043170842 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.991+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55971e805730 con 0x55971e810fd0 2024-02-16T10:31:48.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe561312640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe55c04b0f0 tx=0x7fe55c049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 -- 172.21.15.138:0/4043170842 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c033070 con 0x55971e810fd0 2024-02-16T10:31:48.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55971e818480 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 -- 172.21.15.138:0/4043170842 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c02be80 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 -- 172.21.15.138:0/4043170842 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe55c013e60 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55971e818910 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 -- 172.21.15.138:0/4043170842 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe55c049600 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe42c034210 0x7fe42c0366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe4367fc640 1 -- 172.21.15.138:0/4043170842 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe55c038d20 con 0x55971e810fd0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe560b11640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe42c034210 0x7fe42c0366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e823430 0x55971e8258c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e826010 con 0x55971e823430 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe558310640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e823430 0x55971e8258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe560b11640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe42c034210 0x7fe42c0366d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5500482b0 tx=0x7fe550033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe558310640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e823430 0x55971e8258c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 realm 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e826400 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e826c50 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.995+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e826fb0 con 0x55971e823430 2024-02-16T10:31:48.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e8268f0 con 0x55971e823430 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 20 searching for the correct realm 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55971e829200 0x55971e82b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe561312640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55971e829200 0x55971e82b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe561312640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55971e829200 0x55971e82b650 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe561312640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe55c014850 0x7fe55c054810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe560b11640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe55c014850 0x7fe55c054810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe560b11640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe55c014850 0x7fe55c054810 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe560b11640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe550018680 0x7fe550041860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe558310640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe550018680 0x7fe550041860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe558310640 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe550018680 0x7fe550041860 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:47.999+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.003+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.007+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe55c014850 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe550016070 con 0x7fe55c014850 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e829200 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x7fe550018680 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82bd20 con 0x55971e823430 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe5480dd040 con 0x7fe55c014850 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e827ce0 con 0x55971e823430 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.011+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e828090 con 0x55971e823430 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e828090 con 0x7fe55c014850 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 zone default found 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 4 Realm: () 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 zonegroup default 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e828960 con 0x7fe550018680 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82db90 con 0x55971e829200 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82def0 con 0x55971e829200 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 started sync module instance, tier type = 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82d020 con 0x7fe55c014850 2024-02-16T10:31:48.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107540310912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82e310 con 0x7fe55c014850 2024-02-16T10:31:48.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.015+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82eb10 con 0x55971e823430 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107540310912] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107540317808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82ef30 con 0x55971e823430 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82f730 con 0x55971e829200 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107540320320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82fb60 con 0x55971e829200 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.019+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e830610 con 0x7fe55c014850 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107540317808] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107540324624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e8309f0 con 0x7fe55c014850 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e831360 con 0x55971e823430 2024-02-16T10:31:48.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107540320320] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107540324624] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107540321632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82eba0 con 0x55971e823430 2024-02-16T10:31:48.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.023+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e831bb0 con 0x7fe550018680 2024-02-16T10:31:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107540321632] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107540328128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e831ae0 con 0x7fe550018680 2024-02-16T10:31:48.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e832450 con 0x7fe550018680 2024-02-16T10:31:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107540328128] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107540330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e832630 con 0x7fe550018680 2024-02-16T10:31:48.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.027+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e832e30 con 0x7fe550018680 2024-02-16T10:31:48.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107540330048] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107540333424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e832d30 con 0x7fe550018680 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=0 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=1 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=2 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=3 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=4 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=5 2024-02-16T10:31:48.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.031+0000 7fe562ff6980 20 add_watcher() i=6 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107540333424] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 20 add_watcher() i=7 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e836260 con 0x55971e823430 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107540334544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e833710 con 0x55971e823430 2024-02-16T10:31:48.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107540334544] v33'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe416fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:48.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 5 note: GC not initialized 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe415fe3640 20 reqs_thread_entry: start 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 20 Filter name: none 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe3877fe640 20 reqs_thread_entry: start 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858750 con 0x55971e823430 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x7fe55c014850 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e823430 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e829200 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.035+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e823430 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e823430 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e858b10 con 0x7fe550018680 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a430 con 0x55971e823430 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a430 con 0x7fe55c014850 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a430 con 0x55971e829200 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.039+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a430 con 0x7fe550018680 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a3e0 con 0x7fe550018680 2024-02-16T10:31:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a3e0 con 0x55971e829200 2024-02-16T10:31:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a3e0 con 0x7fe550018680 2024-02-16T10:31:48.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+185 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a3e0 con 0x55971e823430 2024-02-16T10:31:48.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x55971e823430 2024-02-16T10:31:48.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a3e0 con 0x55971e829200 2024-02-16T10:31:48.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a390 con 0x7fe550018680 2024-02-16T10:31:48.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.043+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x7fe55c014850 2024-02-16T10:31:48.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x7fe550018680 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480b0020 con 0x7fe550018680 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e823430 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e823430 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e829200 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e823430 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e823430 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e85a370 con 0x7fe550018680 2024-02-16T10:31:48.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.047+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x7fe550018680 2024-02-16T10:31:48.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe416fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107540334544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e81d870 con 0x55971e823430 2024-02-16T10:31:48.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94107540334544] v33'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107540310912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e832790 con 0x7fe55c014850 2024-02-16T10:31:48.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94107540310912] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe562ff6980 20 remove_watcher() i=0 2024-02-16T10:31:48.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe562ff6980 2 removed watcher, disabling cache 2024-02-16T10:31:48.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.051+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107540317808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82cb80 con 0x55971e823430 2024-02-16T10:31:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94107540317808] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe562ff6980 20 remove_watcher() i=1 2024-02-16T10:31:48.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107540320320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82cb80 con 0x55971e829200 2024-02-16T10:31:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe561312640 1 -- 172.21.15.138:0/4043170842 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94107540320320] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55c00a4d0 con 0x55971e829200 2024-02-16T10:31:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe562ff6980 20 remove_watcher() i=2 2024-02-16T10:31:48.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.055+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107540324624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82cb80 con 0x7fe55c014850 2024-02-16T10:31:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe560b11640 1 -- 172.21.15.138:0/4043170842 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94107540324624] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe55005f040 con 0x7fe55c014850 2024-02-16T10:31:48.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe562ff6980 20 remove_watcher() i=3 2024-02-16T10:31:48.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107540321632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e830110 con 0x55971e823430 2024-02-16T10:31:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94107540321632] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x55971e823430 2024-02-16T10:31:48.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe562ff6980 20 remove_watcher() i=4 2024-02-16T10:31:48.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.059+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107540328128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82cb80 con 0x7fe550018680 2024-02-16T10:31:48.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94107540328128] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x7fe550018680 2024-02-16T10:31:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe562ff6980 20 remove_watcher() i=5 2024-02-16T10:31:48.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107540330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e830ec0 con 0x7fe550018680 2024-02-16T10:31:48.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94107540330048] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x7fe550018680 2024-02-16T10:31:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe562ff6980 20 remove_watcher() i=6 2024-02-16T10:31:48.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.063+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107540333424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55971e82cb80 con 0x7fe550018680 2024-02-16T10:31:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94107540333424] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe5480e4040 con 0x7fe550018680 2024-02-16T10:31:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 20 remove_watcher() i=7 2024-02-16T10:31:48.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe550018680 msgr2=0x7fe550041860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fe550018680 0x7fe550041860 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e823430 msgr2=0x55971e8258c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e823430 0x55971e8258c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe55c014850 msgr2=0x7fe55c054810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fe55c014850 0x7fe55c054810 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55971e829200 msgr2=0x55971e82b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55971e829200 0x55971e82b650 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe42c034210 msgr2=0x7fe42c0366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe42c034210 0x7fe42c0366d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5500482b0 tx=0x7fe550033000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 msgr2=0x55971e817d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe558310640 1 -- 172.21.15.138:0/4043170842 reap_dead start 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe55c04b0f0 tx=0x7fe55c049450 comp rx=0 tx=0).stop 2024-02-16T10:31:48.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 shutdown_connections 2024-02-16T10:31:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/4043170842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e810fd0 0x55971e817d40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 >> 172.21.15.138:0/4043170842 conn(0x55971e80bb50 msgr2=0x55971e80ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 shutdown_connections 2024-02-16T10:31:48.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/4043170842 wait complete. 2024-02-16T10:31:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 msgr2=0x7fe438036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 0x7fe438036770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55971e7f1320 tx=0x7fe550048220 comp rx=0 tx=0).stop 2024-02-16T10:31:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 msgr2=0x55971e804450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55971e7eac20 tx=0x7fe55c018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 shutdown_connections 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4380342b0 0x7fe438036770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/3444895201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e804030 0x55971e804450 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 >> 172.21.15.138:0/3444895201 conn(0x55971e7f8e40 msgr2=0x55971e7f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 shutdown_connections 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/3444895201 wait complete. 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 msgr2=0x55971e7f04e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 0x55971e7f04e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 msgr2=0x55971e7f5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 0x55971e7f5a60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 msgr2=0x7fe448036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 0x7fe448036770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5480ae000 tx=0x7fe5480a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 msgr2=0x55971e7e97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55971e7df320 tx=0x7fe550000bd0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 shutdown_connections 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55971e7f2200 0x55971e7f5a60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55971e6f99f0 0x55971e7f04e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe4480342b0 0x7fe448036770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 --2- 172.21.15.138:0/2932835360 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55971e6f5490 0x55971e7e97f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 >> 172.21.15.138:0/2932835360 conn(0x55971e6f0d60 msgr2=0x55971e7d9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 shutdown_connections 2024-02-16T10:31:48.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.067+0000 7fe562ff6980 1 -- 172.21.15.138:0/2932835360 wait complete. 2024-02-16T10:31:48.084 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:48.085 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:48.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T10:31:48.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T10:31:48.085 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T10:31:48.166 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:48.166 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:48.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6516377980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e79793bcd0 0x55e79793e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6516377980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e797881b50 con 0x55e7979377d0 2024-02-16T10:31:48.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6516377980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e797848d30 con 0x55e79793bcd0 2024-02-16T10:31:48.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513691640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e79793bcd0 0x55e79793e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513691640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e79793bcd0 0x55e79793e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32778/0 (socket says 172.21.15.138:32778) 2024-02-16T10:31:48.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513e92640 1 --1- 172.21.15.138:0/2515435982 >> v1:172.21.15.107:6789/0 conn(0x55e7979377d0 0x55e797937bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:35188/0 (socket says 172.21.15.138:35188) 2024-02-16T10:31:48.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513691640 1 -- 172.21.15.138:0/2515435982 learned_addr learned my addr 172.21.15.138:0/2515435982 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513691640 1 -- 172.21.15.138:0/2515435982 >> v1:172.21.15.107:6789/0 conn(0x55e7979377d0 legacy=0x55e797937bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.163+0000 7f6513691640 1 -- 172.21.15.138:0/2515435982 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e79793f610 con 0x55e79793bcd0 2024-02-16T10:31:48.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6513691640 1 --2- 172.21.15.138:0/2515435982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e79793e0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00a5c0 tx=0x7f64fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede9e39075127f72 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6512e90640 1 -- 172.21.15.138:0/2515435982 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64fc0aa470 con 0x55e79793bcd0 2024-02-16T10:31:48.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6512e90640 1 -- 172.21.15.138:0/2515435982 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0aa5d0 con 0x55e79793bcd0 2024-02-16T10:31:48.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6512e90640 1 -- 172.21.15.138:0/2515435982 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64fc0aa890 con 0x55e79793bcd0 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 -- 172.21.15.138:0/2515435982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 msgr2=0x55e79793e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 --2- 172.21.15.138:0/2515435982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e79793e0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00a5c0 tx=0x7f64fc01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 -- 172.21.15.138:0/2515435982 shutdown_connections 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 --2- 172.21.15.138:0/2515435982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e79793e0c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 -- 172.21.15.138:0/2515435982 >> 172.21.15.138:0/2515435982 conn(0x55e7978aaef0 msgr2=0x55e7978ab300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 -- 172.21.15.138:0/2515435982 shutdown_connections 2024-02-16T10:31:48.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.167+0000 7f6516377980 1 -- 172.21.15.138:0/2515435982 wait complete. 2024-02-16T10:31:48.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6516377980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6516377980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e797845fc0 con 0x55e7979377d0 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6513e92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6513e92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32784/0 (socket says 172.21.15.138:32784) 2024-02-16T10:31:48.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6513e92640 1 -- 172.21.15.138:0/2949083105 learned_addr learned my addr 172.21.15.138:0/2949083105 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6513e92640 1 -- 172.21.15.138:0/2949083105 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc005df0 con 0x55e7979377d0 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.183+0000 7f6513e92640 1 --2- 172.21.15.138:0/2949083105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fc0 tx=0x7f650c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e184716376522913 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6401e0b640 1 -- 172.21.15.138:0/2949083105 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c013420 con 0x55e7979377d0 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6401e0b640 1 -- 172.21.15.138:0/2949083105 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c013580 con 0x55e7979377d0 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6401e0b640 1 -- 172.21.15.138:0/2949083105 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c013880 con 0x55e7979377d0 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/2949083105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 msgr2=0x55e797a21850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 --2- 172.21.15.138:0/2949083105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fc0 tx=0x7f650c0019b0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/2949083105 shutdown_connections 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 --2- 172.21.15.138:0/2949083105 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e7979377d0 0x55e797a21850 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/2949083105 >> 172.21.15.138:0/2949083105 conn(0x55e7978aaef0 msgr2=0x55e797a1d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/2949083105 shutdown_connections 2024-02-16T10:31:48.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/2949083105 wait complete. 2024-02-16T10:31:48.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7978417a0 con 0x55e79793bcd0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6513e92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6513e92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32786/0 (socket says 172.21.15.138:32786) 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6513e92640 1 -- 172.21.15.138:0/477263993 learned_addr learned my addr 172.21.15.138:0/477263993 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6513e92640 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e797881b50 con 0x55e79793bcd0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6513e92640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55e797a226e0 tx=0x7f650c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f63fbfff640 1 -- 172.21.15.138:0/477263993 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c006320 con 0x55e79793bcd0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e797a28f70 con 0x55e79793bcd0 2024-02-16T10:31:48.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f63fbfff640 1 -- 172.21.15.138:0/477263993 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c006840 con 0x55e79793bcd0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f63fbfff640 1 -- 172.21.15.138:0/477263993 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c004bb0 con 0x55e79793bcd0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.187+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e797a29420 con 0x55e79793bcd0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f63fbfff640 1 -- 172.21.15.138:0/477263993 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f650c004d10 con 0x55e79793bcd0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f63fbfff640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 0x7f63fc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f63fbfff640 1 -- 172.21.15.138:0/477263993 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f650c0497c0 con 0x55e79793bcd0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6513691640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 0x7f63fc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 0x55e797a2fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a2fff0 con 0x55e797a2d6c0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 0x55e797a2fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6513691640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 0x7f63fc036770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ae000 tx=0x7f64fc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 0x55e797a2fab0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 -- 172.21.15.138:0/477263993 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f65040083f0 con 0x55e797a2d6c0 2024-02-16T10:31:48.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a2cde0 con 0x55e797a2d6c0 2024-02-16T10:31:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 -- 172.21.15.138:0/477263993 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f65040083f0 con 0x55e797a2d6c0 2024-02-16T10:31:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a31d20 con 0x55e797a2d6c0 2024-02-16T10:31:48.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 -- 172.21.15.138:0/477263993 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f65040083f0 con 0x55e797a2d6c0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a30f20 con 0x55e797a2d6c0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6514693640 1 -- 172.21.15.138:0/477263993 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f65040083f0 con 0x55e797a2d6c0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 0x55e797a350a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a35790 con 0x55e797a31840 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6513e92640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 0x55e797a350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6513e92640 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 0x55e797a350a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6513e92640 1 -- 172.21.15.138:0/477263993 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f650c024070 con 0x55e797a31840 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.191+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7977d9f20 con 0x55e797a436c0 2024-02-16T10:31:48.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32796/0 (socket says 172.21.15.138:32796) 2024-02-16T10:31:48.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6514693640 1 -- 172.21.15.138:0/1388992130 learned_addr learned my addr 172.21.15.138:0/1388992130 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6514693640 1 -- 172.21.15.138:0/1388992130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e797a44020 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6514693640 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55e797a29ac0 tx=0x7f650400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 -- 172.21.15.138:0/1388992130 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650400f040 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 -- 172.21.15.138:0/1388992130 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504019550 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 -- 172.21.15.138:0/1388992130 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504019810 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e797a44270 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e797a44dc0 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 -- 172.21.15.138:0/1388992130 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6504019a00 con 0x55e797a436c0 2024-02-16T10:31:48.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 0x7f63ec036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f63f97fa640 1 -- 172.21.15.138:0/1388992130 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f650404b560 con 0x55e797a436c0 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6513e92640 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 0x7f63ec036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6513e92640 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 0x7f63ec036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e797a308a0 tx=0x7f650c047c80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.195+0000 7f6516377980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7977cd790 con 0x55e797a505e0 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32808/0 (socket says 172.21.15.138:32808) 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 -- 172.21.15.138:0/3630839062 learned_addr learned my addr 172.21.15.138:0/3630839062 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 -- 172.21.15.138:0/3630839062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e797a50fd0 con 0x55e797a505e0 2024-02-16T10:31:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- 172.21.15.138:0/3630839062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f650400efb0 tx=0x7f650402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6faca2b1a11a0e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f63f2ffd640 1 -- 172.21.15.138:0/3630839062 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504048070 con 0x55e797a505e0 2024-02-16T10:31:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f63f2ffd640 1 -- 172.21.15.138:0/3630839062 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040153a0 con 0x55e797a505e0 2024-02-16T10:31:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f63f2ffd640 1 -- 172.21.15.138:0/3630839062 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504015cc0 con 0x55e797a505e0 2024-02-16T10:31:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- 172.21.15.138:0/3630839062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 msgr2=0x55e797a50a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 --2- 172.21.15.138:0/3630839062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f650400efb0 tx=0x7f650402af40 comp rx=0 tx=0).stop 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- 172.21.15.138:0/3630839062 shutdown_connections 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 --2- 172.21.15.138:0/3630839062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a50a00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- 172.21.15.138:0/3630839062 >> 172.21.15.138:0/3630839062 conn(0x55e797a4b160 msgr2=0x55e797a4c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- 172.21.15.138:0/3630839062 shutdown_connections 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- 172.21.15.138:0/3630839062 wait complete. 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 Processor -- start 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- start start 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6516377980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e797a57830 con 0x55e797a505e0 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32816/0 (socket says 172.21.15.138:32816) 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 learned_addr learned my addr 172.21.15.138:0/3909625289 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e797a44dc0 con 0x55e797a505e0 2024-02-16T10:31:48.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.199+0000 7f6514693640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f650403e040 tx=0x7f6504049830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 -- 172.21.15.138:0/3909625289 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504018530 con 0x55e797a505e0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e797a57a30 con 0x55e797a505e0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 -- 172.21.15.138:0/3909625289 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504015510 con 0x55e797a505e0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 -- 172.21.15.138:0/3909625289 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504049b10 con 0x55e797a505e0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e797a57ec0 con 0x55e797a505e0 2024-02-16T10:31:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 -- 172.21.15.138:0/3909625289 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6504032020 con 0x55e797a505e0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63dc0342b0 0x7f63dc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f63f17fa640 1 -- 172.21.15.138:0/3909625289 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f6504037d40 con 0x55e797a505e0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513e92640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63dc0342b0 0x7f63dc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a62a10 0x55e797a64ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a655f0 con 0x55e797a62a10 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a62a10 0x55e797a64ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513e92640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63dc0342b0 0x7f63dc036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f650c010930 tx=0x7f650c049000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a62a10 0x55e797a64ea0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 realm 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a659e0 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a66230 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a66590 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.203+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a65ed0 con 0x55e797a62a10 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6516377980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6516377980 20 searching for the correct realm 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e797a687e0 0x55e797a6ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6514693640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e797a687e0 0x55e797a6ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6514693640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e797a687e0 0x55e797a6ac30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504042040 con 0x55e797a687e0 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6514693640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6504022070 0x7f6504022890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513e92640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6504022070 0x7f6504022890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513e92640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6504022070 0x7f6504022890 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513e92640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f650c03c050 0x7f650c049070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513691640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f650c03c050 0x7f650c049070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513691640 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f650c03c050 0x7f650c049070 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.207+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504042040 con 0x55e797a687e0 2024-02-16T10:31:48.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504042040 con 0x55e797a687e0 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.211+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.215+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f6504022070 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c024070 con 0x7f6504022070 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a687e0 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x7f650c03c050 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6b300 con 0x55e797a62a10 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f64fc0dd040 con 0x7f6504022070 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:48.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a672c0 con 0x55e797a62a10 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a67670 con 0x55e797a62a10 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.219+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a67670 con 0x7f6504022070 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 zone default found 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 4 Realm: () 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 zonegroup default 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a67f40 con 0x7f650c03c050 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6d1c0 con 0x55e797a687e0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6d550 con 0x55e797a687e0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 started sync module instance, tier type = 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6c650 con 0x7f6504022070 2024-02-16T10:31:48.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453170094512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6ce50 con 0x7f6504022070 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.223+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6e040 con 0x55e797a62a10 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.227+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453170094512] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.227+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.227+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453170101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6e3f0 con 0x55e797a62a10 2024-02-16T10:31:48.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.227+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6ed60 con 0x55e797a687e0 2024-02-16T10:31:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.227+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453170101024] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453170096560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6ed60 con 0x55e797a687e0 2024-02-16T10:31:48.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6f780 con 0x7f6504022070 2024-02-16T10:31:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453170107008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6ffd0 con 0x7f6504022070 2024-02-16T10:31:48.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a709f0 con 0x55e797a62a10 2024-02-16T10:31:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453170096560] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453170107008] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453170109232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6e8c0 con 0x55e797a62a10 2024-02-16T10:31:48.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.231+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a71240 con 0x7f650c03c050 2024-02-16T10:31:48.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453170109232] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453170111696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a711a0 con 0x7f650c03c050 2024-02-16T10:31:48.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a71b10 con 0x7f650c03c050 2024-02-16T10:31:48.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453170111696] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453170113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a71c20 con 0x7f650c03c050 2024-02-16T10:31:48.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.235+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a72460 con 0x7f650c03c050 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453170117664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a72ae0 con 0x7f650c03c050 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=0 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=1 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=2 2024-02-16T10:31:48.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=3 2024-02-16T10:31:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=4 2024-02-16T10:31:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=5 2024-02-16T10:31:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453170113792] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.239+0000 7f6516377980 20 add_watcher() i=6 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453170117664] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 add_watcher() i=7 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a75a00 con 0x55e797a62a10 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453170119984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a72df0 con 0x55e797a62a10 2024-02-16T10:31:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453170119984] v33'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f63c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:48.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 5 note: GC not initialized 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f63c8fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 Filter name: none 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f63427fc640 20 reqs_thread_entry: start 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a97260 con 0x55e797a62a10 2024-02-16T10:31:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.243+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a97260 con 0x7f650c03c050 2024-02-16T10:31:48.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.247+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.247+0000 7f63c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.247+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453170119984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a97260 con 0x55e797a62a10 2024-02-16T10:31:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.247+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94453170119984] v33'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.247+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453170094512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a97260 con 0x7f6504022070 2024-02-16T10:31:48.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94453170094512] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6516377980 20 remove_watcher() i=0 2024-02-16T10:31:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6516377980 2 removed watcher, disabling cache 2024-02-16T10:31:48.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453170101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6c1b0 con 0x55e797a62a10 2024-02-16T10:31:48.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94453170101024] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6516377980 20 remove_watcher() i=1 2024-02-16T10:31:48.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.251+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453170096560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6db20 con 0x55e797a687e0 2024-02-16T10:31:48.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6514693640 1 -- 172.21.15.138:0/3909625289 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94453170096560] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504060040 con 0x55e797a687e0 2024-02-16T10:31:48.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 20 remove_watcher() i=2 2024-02-16T10:31:48.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453170107008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6c1b0 con 0x7f6504022070 2024-02-16T10:31:48.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6513e92640 1 -- 172.21.15.138:0/3909625289 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94453170107008] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c05c040 con 0x7f6504022070 2024-02-16T10:31:48.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 20 remove_watcher() i=3 2024-02-16T10:31:48.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453170109232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6c9b0 con 0x55e797a62a10 2024-02-16T10:31:48.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94453170109232] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x55e797a62a10 2024-02-16T10:31:48.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 20 remove_watcher() i=4 2024-02-16T10:31:48.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.255+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453170111696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6c1b0 con 0x7f650c03c050 2024-02-16T10:31:48.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94453170111696] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6516377980 20 remove_watcher() i=5 2024-02-16T10:31:48.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453170113792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6fb30 con 0x7f650c03c050 2024-02-16T10:31:48.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94453170113792] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6516377980 20 remove_watcher() i=6 2024-02-16T10:31:48.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.259+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453170117664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e797a6fb30 con 0x7f650c03c050 2024-02-16T10:31:48.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94453170117664] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f64fc0b0020 con 0x7f650c03c050 2024-02-16T10:31:48.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 20 remove_watcher() i=7 2024-02-16T10:31:48.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f650c03c050 msgr2=0x7f650c049070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f650c03c050 0x7f650c049070 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a62a10 msgr2=0x55e797a64ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a62a10 0x55e797a64ea0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6504022070 msgr2=0x7f6504022890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6504022070 0x7f6504022890 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e797a687e0 msgr2=0x55e797a6ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e797a687e0 0x55e797a6ac30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63dc0342b0 msgr2=0x7f63dc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63dc0342b0 0x7f63dc036770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f650c010930 tx=0x7f650c049000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 msgr2=0x55e797a572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f650403e040 tx=0x7f6504049830 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6513691640 1 -- 172.21.15.138:0/3909625289 reap_dead start 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 shutdown_connections 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/3909625289 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a505e0 0x55e797a572f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 >> 172.21.15.138:0/3909625289 conn(0x55e797a4b160 msgr2=0x55e797a4c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 shutdown_connections 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/3909625289 wait complete. 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 msgr2=0x7f63ec036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 0x7f63ec036770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e797a308a0 tx=0x7f650c047c80 comp rx=0 tx=0).stop 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 msgr2=0x55e797a43ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55e797a29ac0 tx=0x7f650400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 shutdown_connections 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63ec0342b0 0x7f63ec036770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/1388992130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e797a436c0 0x55e797a43ae0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 >> 172.21.15.138:0/1388992130 conn(0x55e797a384d0 msgr2=0x55e797a38fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 shutdown_connections 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/1388992130 wait complete. 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 msgr2=0x55e797a2fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 0x55e797a2fab0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 msgr2=0x55e797a350a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 0x55e797a350a0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 msgr2=0x7f63fc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 0x7f63fc036770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ae000 tx=0x7f64fc0a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 msgr2=0x55e797a28a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55e797a226e0 tx=0x7f650c001260 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 shutdown_connections 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e797a31840 0x55e797a350a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e797a2d6c0 0x55e797a2fab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f63fc0342b0 0x7f63fc036770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 --2- 172.21.15.138:0/477263993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e79793bcd0 0x55e797a28a30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 >> 172.21.15.138:0/477263993 conn(0x55e7978aaef0 msgr2=0x55e797a1bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 shutdown_connections 2024-02-16T10:31:48.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.263+0000 7f6516377980 1 -- 172.21.15.138:0/477263993 wait complete. 2024-02-16T10:31:48.279 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:48.279 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:48.280 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T10:31:48.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-02-16T10:31:48.280 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-02-16T10:31:48.361 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:48.361 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:48.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f611b1d4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558a05bcbdc0 0x558a05bce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f611b1d4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558a05b11b60 con 0x558a05b39720 2024-02-16T10:31:48.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f611b1d4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x558a05ad8d30 con 0x558a05bcbdc0 2024-02-16T10:31:48.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f61184ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558a05bcbdc0 0x558a05bce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f61184ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x558a05bcbdc0 0x558a05bce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32824/0 (socket says 172.21.15.138:32824) 2024-02-16T10:31:48.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f61184ee640 1 -- 172.21.15.138:0/3227578889 learned_addr learned my addr 172.21.15.138:0/3227578889 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f61184ee640 1 -- 172.21.15.138:0/3227578889 >> v1:172.21.15.107:6789/0 conn(0x558a05b39720 legacy=0x558a05bca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f6117ced640 1 -- 172.21.15.138:0/3227578889 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937871419 0 0) 0x558a05b11b60 con 0x558a05b39720 2024-02-16T10:31:48.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.359+0000 7f61184ee640 1 -- 172.21.15.138:0/3227578889 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a05bcf700 con 0x558a05bcbdc0 2024-02-16T10:31:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f61184ee640 1 --2- 172.21.15.138:0/3227578889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05bcbdc0 0x558a05bce1b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f610c00a5c0 tx=0x7f610c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946b6dffe05a2fc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f6117ced640 1 -- 172.21.15.138:0/3227578889 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f610c0aa470 con 0x558a05bcbdc0 2024-02-16T10:31:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f6117ced640 1 -- 172.21.15.138:0/3227578889 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c0aa5d0 con 0x558a05bcbdc0 2024-02-16T10:31:48.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f6117ced640 1 -- 172.21.15.138:0/3227578889 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f610c0aa890 con 0x558a05bcbdc0 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 -- 172.21.15.138:0/3227578889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05bcbdc0 msgr2=0x558a05bce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 --2- 172.21.15.138:0/3227578889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05bcbdc0 0x558a05bce1b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f610c00a5c0 tx=0x7f610c01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 -- 172.21.15.138:0/3227578889 shutdown_connections 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 --2- 172.21.15.138:0/3227578889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05bcbdc0 0x558a05bce1b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 -- 172.21.15.138:0/3227578889 >> 172.21.15.138:0/3227578889 conn(0x558a05bbfd80 msgr2=0x558a05bc21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 -- 172.21.15.138:0/3227578889 shutdown_connections 2024-02-16T10:31:48.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.363+0000 7f611b1d4980 1 -- 172.21.15.138:0/3227578889 wait complete. 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f611b1d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f611b1d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a05ad5fc0 con 0x558a05b39720 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6118cef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6118cef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32838/0 (socket says 172.21.15.138:32838) 2024-02-16T10:31:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6118cef640 1 -- 172.21.15.138:0/2144590039 learned_addr learned my addr 172.21.15.138:0/2144590039 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6118cef640 1 -- 172.21.15.138:0/2144590039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c005df0 con 0x558a05b39720 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6118cef640 1 --2- 172.21.15.138:0/2144590039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f610800b200 tx=0x7f610800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af1db874d45ac7 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6006e0d640 1 -- 172.21.15.138:0/2144590039 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6108008070 con 0x558a05b39720 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6006e0d640 1 -- 172.21.15.138:0/2144590039 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800d5f0 con 0x558a05b39720 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.379+0000 7f6006e0d640 1 -- 172.21.15.138:0/2144590039 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f610800d910 con 0x558a05b39720 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2144590039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 msgr2=0x558a05cb17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2144590039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f610800b200 tx=0x7f610800b6c0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2144590039 shutdown_connections 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2144590039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb17c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2144590039 >> 172.21.15.138:0/2144590039 conn(0x558a05bbfd80 msgr2=0x558a05cad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2144590039 shutdown_connections 2024-02-16T10:31:48.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2144590039 wait complete. 2024-02-16T10:31:48.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a05ad17a0 con 0x558a05b39720 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f6118cef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f6118cef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32840/0 (socket says 172.21.15.138:32840) 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f6118cef640 1 -- 172.21.15.138:0/2277994909 learned_addr learned my addr 172.21.15.138:0/2277994909 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f6118cef640 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108001bd0 con 0x558a05b39720 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f6118cef640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f610800c010 tx=0x7f6108000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f600560a640 1 -- 172.21.15.138:0/2277994909 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6108001550 con 0x558a05b39720 2024-02-16T10:31:48.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a05cb8ef0 con 0x558a05b39720 2024-02-16T10:31:48.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f600560a640 1 -- 172.21.15.138:0/2277994909 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080012e0 con 0x558a05b39720 2024-02-16T10:31:48.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f600560a640 1 -- 172.21.15.138:0/2277994909 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6108011bb0 con 0x558a05b39720 2024-02-16T10:31:48.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a05cb93a0 con 0x558a05b39720 2024-02-16T10:31:48.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.383+0000 7f600560a640 1 -- 172.21.15.138:0/2277994909 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f610801e410 con 0x558a05b39720 2024-02-16T10:31:48.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f600560a640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 0x7f6000036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f600560a640 1 -- 172.21.15.138:0/2277994909 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61080496f0 con 0x558a05b39720 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61184ee640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 0x7f6000036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 0x558a05cbf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cbfb90 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 0x558a05cbf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61184ee640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 0x7f6000036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f610c0ae000 tx=0x7f610c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 0x558a05cbf650 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 -- 172.21.15.138:0/2277994909 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cbff80 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 -- 172.21.15.138:0/2277994909 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cc1830 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 -- 172.21.15.138:0/2277994909 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cc0970 con 0x558a05bcbdc0 2024-02-16T10:31:48.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 -- 172.21.15.138:0/2277994909 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05bcbdc0 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 0x558a05cc4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cc51c0 con 0x558a05cc1290 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f6118cef640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 0x558a05cc4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f6118cef640 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 0x558a05cc4bb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f6118cef640 1 -- 172.21.15.138:0/2277994909 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6108024070 con 0x558a05cc1290 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f611b1d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a05a69f20 con 0x558a05cd3090 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.387+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32854/0 (socket says 172.21.15.138:32854) 2024-02-16T10:31:48.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 -- 172.21.15.138:0/1422449701 learned_addr learned my addr 172.21.15.138:0/1422449701 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 -- 172.21.15.138:0/1422449701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a05cd39f0 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x558a05cb9a40 tx=0x7f61100188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 -- 172.21.15.138:0/1422449701 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611001d070 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a05cd3c40 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 -- 172.21.15.138:0/1422449701 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110014580 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 -- 172.21.15.138:0/1422449701 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6110014860 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a05cd4790 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 -- 172.21.15.138:0/1422449701 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6110020020 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 0x7f5ff0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f5ffe7fc640 1 -- 172.21.15.138:0/1422449701 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f611004b230 con 0x558a05cd3090 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f6118cef640 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 0x7f5ff0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f6118cef640 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 0x7f5ff0036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x558a05cc03b0 tx=0x7f61080479c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f611b1d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a05a5d790 con 0x558a05cdffe0 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32870/0 (socket says 172.21.15.138:32870) 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.391+0000 7f61194f0640 1 -- 172.21.15.138:0/636200300 learned_addr learned my addr 172.21.15.138:0/636200300 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 -- 172.21.15.138:0/636200300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a05ce09b0 con 0x558a05cdffe0 2024-02-16T10:31:48.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 --2- 172.21.15.138:0/636200300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6110049570 tx=0x7f611002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f97689d9c4e8053 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5feffff640 1 -- 172.21.15.138:0/636200300 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f611003f030 con 0x558a05cdffe0 2024-02-16T10:31:48.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5feffff640 1 -- 172.21.15.138:0/636200300 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110016440 con 0x558a05cdffe0 2024-02-16T10:31:48.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5feffff640 1 -- 172.21.15.138:0/636200300 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61100149c0 con 0x558a05cdffe0 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/636200300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 msgr2=0x558a05ce03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 --2- 172.21.15.138:0/636200300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6110049570 tx=0x7f611002bf40 comp rx=0 tx=0).stop 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/636200300 shutdown_connections 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 --2- 172.21.15.138:0/636200300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce03e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/636200300 >> 172.21.15.138:0/636200300 conn(0x558a05cdabb0 msgr2=0x558a05cdba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/636200300 shutdown_connections 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/636200300 wait complete. 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 Processor -- start 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- start start 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a05ce7250 con 0x558a05cdffe0 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:32884/0 (socket says 172.21.15.138:32884) 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 learned_addr learned my addr 172.21.15.138:0/742641077 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a05cd4790 con 0x558a05cdffe0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f61194f0640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce6d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6110040040 tx=0x7f6110049500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5fee7fc640 1 -- 172.21.15.138:0/742641077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6110032070 con 0x558a05cdffe0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a05ce7450 con 0x558a05cdffe0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5fee7fc640 1 -- 172.21.15.138:0/742641077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611002b940 con 0x558a05cdffe0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f5fee7fc640 1 -- 172.21.15.138:0/742641077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6110013850 con 0x558a05cdffe0 2024-02-16T10:31:48.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.395+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a05ce7880 con 0x558a05cdffe0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f5fee7fc640 1 -- 172.21.15.138:0/742641077 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f6110042070 con 0x558a05cdffe0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f5fee7fc640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5fe40342b0 0x7f5fe4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f5fee7fc640 1 -- 172.21.15.138:0/742641077 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f6110040070 con 0x558a05cdffe0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f6118cef640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5fe40342b0 0x7f5fe4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05cf2430 0x558a05cf48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5040 con 0x558a05cf2430 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05cf2430 0x558a05cf48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f6118cef640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5fe40342b0 0x7f5fe4036770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f610801ef90 tx=0x7f6108035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05cf2430 0x558a05cf48f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 realm 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5430 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5c80 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5fe0 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 20 searching for the correct realm 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558a05cf8230 0x558a05cfa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfad50 con 0x558a05cf8230 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.399+0000 7f61194f0640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558a05cf8230 0x558a05cfa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61194f0640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558a05cf8230 0x558a05cfa680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61194f0640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6110056040 0x7f6110007900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfad50 con 0x7f6110056040 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f6118cef640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6110056040 0x7f6110007900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f6118cef640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6110056040 0x7f6110007900 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f6118cef640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6108027020 0x7f6108046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfad50 con 0x7f6108027020 2024-02-16T10:31:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6108027020 0x7f6108046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6108027020 0x7f6108046130 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.403+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6110056040 2024-02-16T10:31:48.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6110056040 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6110056040 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.407+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6110056040 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.411+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6110056040 2024-02-16T10:31:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf8230 2024-02-16T10:31:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x7f6108027020 2024-02-16T10:31:48.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f610c0dd040 con 0x7f6110056040 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf5920 con 0x558a05cf2430 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf6d10 con 0x558a05cf2430 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf6d10 con 0x7f6110056040 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 zone default found 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 4 Realm: () 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 zonegroup default 2024-02-16T10:31:48.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf7620 con 0x7f6108027020 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cf7620 con 0x558a05cf8230 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.415+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfcc30 con 0x558a05cf8230 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 20 started sync module instance, tier type = 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:48.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfc050 con 0x7f6110056040 2024-02-16T10:31:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051291347888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfc850 con 0x7f6110056040 2024-02-16T10:31:48.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfd790 con 0x558a05cf2430 2024-02-16T10:31:48.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051291347888] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051291353712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfdb40 con 0x558a05cf2430 2024-02-16T10:31:48.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.419+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfe4f0 con 0x558a05cf8230 2024-02-16T10:31:48.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051291353712] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051291349936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfe4b0 con 0x558a05cf8230 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cfeeb0 con 0x7f6110056040 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051291359760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cff700 con 0x7f6110056040 2024-02-16T10:31:48.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.423+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d000f0 con 0x558a05cf2430 2024-02-16T10:31:48.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051291349936] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051291359760] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051291364304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cff260 con 0x558a05cf2430 2024-02-16T10:31:48.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d00940 con 0x7f6108027020 2024-02-16T10:31:48.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051291364304] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051291357200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05cff260 con 0x7f6108027020 2024-02-16T10:31:48.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.427+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d00e70 con 0x7f6108027020 2024-02-16T10:31:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051291357200] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051291367760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d00e30 con 0x7f6108027020 2024-02-16T10:31:48.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d01840 con 0x7f6108027020 2024-02-16T10:31:48.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051291367760] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051291366080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d01800 con 0x7f6108027020 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=0 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=1 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=2 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=3 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=4 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=5 2024-02-16T10:31:48.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.431+0000 7f611b1d4980 20 add_watcher() i=6 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051291366080] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 20 add_watcher() i=7 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d04c80 con 0x558a05cf2430 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051291370800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d04c80 con 0x558a05cf2430 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051291370800] v33'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f5fcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.435+0000 7f611b1d4980 5 note: GC not initialized 2024-02-16T10:31:48.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f5fcdfe3640 20 reqs_thread_entry: start 2024-02-16T10:31:48.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:48.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 20 Filter name: none 2024-02-16T10:31:48.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f5f3f7fe640 20 reqs_thread_entry: start 2024-02-16T10:31:48.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x558a05cf2430 2024-02-16T10:31:48.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6108027020 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f5fcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.439+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051291370800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x558a05cf2430 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94051291370800] v33'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051291347888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6110056040 2024-02-16T10:31:48.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94051291347888] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 20 remove_watcher() i=0 2024-02-16T10:31:48.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 2 removed watcher, disabling cache 2024-02-16T10:31:48.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051291353712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x558a05cf2430 2024-02-16T10:31:48.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94051291353712] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 20 remove_watcher() i=1 2024-02-16T10:31:48.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.443+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051291349936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x558a05cf8230 2024-02-16T10:31:48.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f61194f0640 1 -- 172.21.15.138:0/742641077 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94051291349936] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f611000a4d0 con 0x558a05cf8230 2024-02-16T10:31:48.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f611b1d4980 20 remove_watcher() i=2 2024-02-16T10:31:48.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051291359760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6110056040 2024-02-16T10:31:48.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f6118cef640 1 -- 172.21.15.138:0/742641077 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94051291359760] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6108024070 con 0x7f6110056040 2024-02-16T10:31:48.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f611b1d4980 20 remove_watcher() i=3 2024-02-16T10:31:48.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.447+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051291364304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x558a05cf2430 2024-02-16T10:31:48.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94051291364304] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x558a05cf2430 2024-02-16T10:31:48.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f611b1d4980 20 remove_watcher() i=4 2024-02-16T10:31:48.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051291357200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6108027020 2024-02-16T10:31:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94051291357200] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f611b1d4980 20 remove_watcher() i=5 2024-02-16T10:31:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.451+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051291367760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6108027020 2024-02-16T10:31:48.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94051291367760] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 20 remove_watcher() i=6 2024-02-16T10:31:48.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051291366080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558a05d26660 con 0x7f6108027020 2024-02-16T10:31:48.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94051291366080] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f610c0b0020 con 0x7f6108027020 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 20 remove_watcher() i=7 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6108027020 msgr2=0x7f6108046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f6108027020 0x7f6108046130 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05cf2430 msgr2=0x558a05cf48f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05cf2430 0x558a05cf48f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6110056040 msgr2=0x7f6110007900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f6110056040 0x7f6110007900 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558a05cf8230 msgr2=0x558a05cfa680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x558a05cf8230 0x558a05cfa680 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5fe40342b0 msgr2=0x7f5fe4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5fe40342b0 0x7f5fe4036770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f610801ef90 tx=0x7f6108035000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 msgr2=0x558a05ce6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/742641077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cdffe0 0x558a05ce6d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6110040040 tx=0x7f6110049500 comp rx=0 tx=0).stop 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 reap_dead start 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f61184ee640 1 -- 172.21.15.138:0/742641077 reap_dead start 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 shutdown_connections 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 >> 172.21.15.138:0/742641077 conn(0x558a05cdabb0 msgr2=0x558a05cdba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 shutdown_connections 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/742641077 wait complete. 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 msgr2=0x7f5ff0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 0x7f5ff0036770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x558a05cc03b0 tx=0x7f61080479c0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 msgr2=0x558a05cd34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x558a05cb9a40 tx=0x7f61100188f0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 shutdown_connections 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5ff00342b0 0x7f5ff0036770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 --2- 172.21.15.138:0/1422449701 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05cd3090 0x558a05cd34b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 >> 172.21.15.138:0/1422449701 conn(0x558a05cc7ea0 msgr2=0x558a05cc89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 shutdown_connections 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.455+0000 7f611b1d4980 1 -- 172.21.15.138:0/1422449701 wait complete. 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 msgr2=0x558a05cbf650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 0x558a05cbf650 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 msgr2=0x558a05cc4bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 0x558a05cc4bb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 msgr2=0x7f6000036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 0x7f6000036770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f610c0ae000 tx=0x7f610c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 msgr2=0x558a05cb89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f610800c010 tx=0x7f6108000ee0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 shutdown_connections 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x558a05cc1290 0x558a05cc4bb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x558a05bcbdc0 0x558a05cbf650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60000342b0 0x7f6000036770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 --2- 172.21.15.138:0/2277994909 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a05b39720 0x558a05cb89b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 >> 172.21.15.138:0/2277994909 conn(0x558a05bbfd80 msgr2=0x558a05cabd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 shutdown_connections 2024-02-16T10:31:48.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.459+0000 7f611b1d4980 1 -- 172.21.15.138:0/2277994909 wait complete. 2024-02-16T10:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:48.473 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:48.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T10:31:48.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-02-16T10:31:48.473 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-02-16T10:31:48.550 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:48.551 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5286a3c980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e58194af60 0x55e5819d92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5286a3c980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e581922b60 con 0x55e5819d9820 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5286a3c980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e5818e9d30 con 0x55e58194af60 2024-02-16T10:31:48.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5284557640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e58194af60 0x55e5819d92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5283d56640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55e5819d9820 0x55e5819dbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42656/0 (socket says 172.21.15.138:42656) 2024-02-16T10:31:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5283d56640 1 -- 172.21.15.138:0/3575291629 learned_addr learned my addr 172.21.15.138:0/3575291629 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5284557640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55e58194af60 0x55e5819d92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55078/0 (socket says 172.21.15.138:55078) 2024-02-16T10:31:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5284557640 1 -- 172.21.15.138:0/3575291629 >> v1:172.21.15.107:6789/0 conn(0x55e5819d9820 legacy=0x55e5819dbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.547+0000 7f5284557640 1 -- 172.21.15.138:0/3575291629 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5819de370 con 0x55e58194af60 2024-02-16T10:31:48.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5284557640 1 --2- 172.21.15.138:0/3575291629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d92e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f527400a420 tx=0x7f527401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4b771577c23267 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5283555640 1 -- 172.21.15.138:0/3575291629 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740aa530 con 0x55e58194af60 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5283555640 1 -- 172.21.15.138:0/3575291629 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740a6050 con 0x55e58194af60 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5283555640 1 -- 172.21.15.138:0/3575291629 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740aa800 con 0x55e58194af60 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 -- 172.21.15.138:0/3575291629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 msgr2=0x55e5819d92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3575291629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d92e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f527400a420 tx=0x7f527401afd0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 -- 172.21.15.138:0/3575291629 shutdown_connections 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3575291629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d92e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 -- 172.21.15.138:0/3575291629 >> 172.21.15.138:0/3575291629 conn(0x55e5819d0dc0 msgr2=0x55e5819d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 -- 172.21.15.138:0/3575291629 shutdown_connections 2024-02-16T10:31:48.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.551+0000 7f5286a3c980 1 -- 172.21.15.138:0/3575291629 wait complete. 2024-02-16T10:31:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5286a3c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5286a3c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5818e6fc0 con 0x55e58194af60 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5284557640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5284557640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55090/0 (socket says 172.21.15.138:55090) 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5284557640 1 -- 172.21.15.138:0/4257414149 learned_addr learned my addr 172.21.15.138:0/4257414149 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5284557640 1 -- 172.21.15.138:0/4257414149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527400a100 con 0x55e58194af60 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f5284557640 1 --2- 172.21.15.138:0/4257414149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52740ad040 tx=0x7f52740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3e0fbcebfea241 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f517260c640 1 -- 172.21.15.138:0/4257414149 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740aa630 con 0x55e58194af60 2024-02-16T10:31:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f517260c640 1 -- 172.21.15.138:0/4257414149 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740aa790 con 0x55e58194af60 2024-02-16T10:31:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.567+0000 7f517260c640 1 -- 172.21.15.138:0/4257414149 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740aaa30 con 0x55e58194af60 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/4257414149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 msgr2=0x55e5819d6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 --2- 172.21.15.138:0/4257414149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52740ad040 tx=0x7f52740033b0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/4257414149 shutdown_connections 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 --2- 172.21.15.138:0/4257414149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e5819d6a40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/4257414149 >> 172.21.15.138:0/4257414149 conn(0x55e5819d0dc0 msgr2=0x55e581abc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/4257414149 shutdown_connections 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/4257414149 wait complete. 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5818e27a0 con 0x55e58194af60 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5284557640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5284557640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55098/0 (socket says 172.21.15.138:55098) 2024-02-16T10:31:48.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5284557640 1 -- 172.21.15.138:0/3630756680 learned_addr learned my addr 172.21.15.138:0/3630756680 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5284557640 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5819de370 con 0x55e58194af60 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5284557640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f527401b870 tx=0x7f5274019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5170e09640 1 -- 172.21.15.138:0/3630756680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740b6b60 con 0x55e58194af60 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5170e09640 1 -- 172.21.15.138:0/3630756680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740b6cc0 con 0x55e58194af60 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e581ac9b40 con 0x55e58194af60 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5170e09640 1 -- 172.21.15.138:0/3630756680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740c0450 con 0x55e58194af60 2024-02-16T10:31:48.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.571+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e581ac9ff0 con 0x55e58194af60 2024-02-16T10:31:48.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5170e09640 1 -- 172.21.15.138:0/3630756680 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f52740c0680 con 0x55e58194af60 2024-02-16T10:31:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5170e09640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 0x7f516c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5170e09640 1 -- 172.21.15.138:0/3630756680 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f52740e43c0 con 0x55e58194af60 2024-02-16T10:31:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5283d56640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 0x7f516c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 0x55e581ad0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581ad0790 con 0x55e5819d9820 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 0x55e581ad0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5283d56640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 0x7f516c036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f526c001da0 tx=0x7f526c001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 0x55e581ad0250 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 -- 172.21.15.138:0/3630756680 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f527c0083f0 con 0x55e5819d9820 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581acd960 con 0x55e5819d9820 2024-02-16T10:31:48.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 -- 172.21.15.138:0/3630756680 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f527c0083f0 con 0x55e5819d9820 2024-02-16T10:31:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581ad24e0 con 0x55e5819d9820 2024-02-16T10:31:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 -- 172.21.15.138:0/3630756680 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f527c0083f0 con 0x55e5819d9820 2024-02-16T10:31:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581ad16e0 con 0x55e5819d9820 2024-02-16T10:31:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284d58640 1 -- 172.21.15.138:0/3630756680 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f527c0083f0 con 0x55e5819d9820 2024-02-16T10:31:48.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 0x55e581ad5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581ad5eb0 con 0x55e581ad2000 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284557640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 0x55e581ad5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284557640 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 0x55e581ad5860 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5284557640 1 -- 172.21.15.138:0/3630756680 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f52740b1040 con 0x55e581ad2000 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.575+0000 7f5286a3c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e58187af20 con 0x55e581ae3db0 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55104/0 (socket says 172.21.15.138:55104) 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 -- 172.21.15.138:0/3584342021 learned_addr learned my addr 172.21.15.138:0/3584342021 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 -- 172.21.15.138:0/3584342021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e581ae4710 con 0x55e581ae3db0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55e581aca1a0 tx=0x7f527c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 -- 172.21.15.138:0/3584342021 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c00f040 con 0x55e581ae3db0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e581ae4960 con 0x55e581ae3db0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 -- 172.21.15.138:0/3584342021 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c019550 con 0x55e581ae3db0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 -- 172.21.15.138:0/3584342021 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c0197f0 con 0x55e581ae3db0 2024-02-16T10:31:48.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e581ae54b0 con 0x55e581ae3db0 2024-02-16T10:31:48.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 -- 172.21.15.138:0/3584342021 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f527c0199a0 con 0x55e581ae3db0 2024-02-16T10:31:48.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 0x7f515c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5169ffb640 1 -- 172.21.15.138:0/3584342021 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f527c04b5f0 con 0x55e581ae3db0 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284557640 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 0x7f515c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284557640 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 0x7f515c036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55e581ad1120 tx=0x7f52740e4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5286a3c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e58186e790 con 0x55e581af0d90 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55118/0 (socket says 172.21.15.138:55118) 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.579+0000 7f5284d58640 1 -- 172.21.15.138:0/2413107854 learned_addr learned my addr 172.21.15.138:0/2413107854 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 -- 172.21.15.138:0/2413107854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e581af1780 con 0x55e581af0d90 2024-02-16T10:31:48.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 --2- 172.21.15.138:0/2413107854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f527c019970 tx=0x7f527c02af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf3da4b476119c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f51637fe640 1 -- 172.21.15.138:0/2413107854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c048070 con 0x55e581af0d90 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f51637fe640 1 -- 172.21.15.138:0/2413107854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c0184e0 con 0x55e581af0d90 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f51637fe640 1 -- 172.21.15.138:0/2413107854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c0154d0 con 0x55e581af0d90 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/2413107854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 msgr2=0x55e581af11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 --2- 172.21.15.138:0/2413107854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f527c019970 tx=0x7f527c02af40 comp rx=0 tx=0).stop 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/2413107854 shutdown_connections 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 --2- 172.21.15.138:0/2413107854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af11b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/2413107854 >> 172.21.15.138:0/2413107854 conn(0x55e581aeb910 msgr2=0x55e581aec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/2413107854 shutdown_connections 2024-02-16T10:31:48.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/2413107854 wait complete. 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 Processor -- start 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- start start 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e581af8010 con 0x55e581af0d90 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55132/0 (socket says 172.21.15.138:55132) 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 learned_addr learned my addr 172.21.15.138:0/1906221833 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e581ae54b0 con 0x55e581af0d90 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5284d58640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af7ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f527c0497d0 tx=0x7f527c049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5161ffb640 1 -- 172.21.15.138:0/1906221833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c017c60 con 0x55e581af0d90 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e581af8210 con 0x55e581af0d90 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5161ffb640 1 -- 172.21.15.138:0/1906221833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c017dc0 con 0x55e581af0d90 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5161ffb640 1 -- 172.21.15.138:0/1906221833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f527c048070 con 0x55e581af0d90 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.583+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e581af8640 con 0x55e581af0d90 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5161ffb640 1 -- 172.21.15.138:0/1906221833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f527c0481d0 con 0x55e581af0d90 2024-02-16T10:31:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5161ffb640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f51540342b0 0x7f5154036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5161ffb640 1 -- 172.21.15.138:0/1906221833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f527c02dd60 con 0x55e581af0d90 2024-02-16T10:31:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5284557640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f51540342b0 0x7f5154036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e581b031d0 0x55e581b05670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b05dc0 con 0x55e581b031d0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e581b031d0 0x55e581b05670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5284557640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f51540342b0 0x7f5154036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f52740e4330 tx=0x7f52740dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e581b031d0 0x55e581b05670 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 realm 2024-02-16T10:31:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b026f0 con 0x55e581b031d0 2024-02-16T10:31:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b06840 con 0x55e581b031d0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b06d00 con 0x55e581b031d0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b075a0 con 0x55e581b031d0 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 20 searching for the correct realm 2024-02-16T10:31:48.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e581b092c0 0x55e581b0b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b092c0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5284d58640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e581b092c0 0x55e581b0b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.587+0000 7f5284d58640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e581b092c0 0x55e581b0b6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284d58640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f527c022070 0x7f527c044070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x7f527c022070 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284557640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f527c022070 0x7f527c044070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284557640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f527c022070 0x7f527c044070 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284557640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f52740f2040 0x7f52740a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x7f52740f2040 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f52740f2040 0x7f52740a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f52740f2040 0x7f52740a97f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b031d0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b031d0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b031d0 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.591+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x7f52740f2040 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x7f527c022070 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b092c0 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x55e581b031d0 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bbf0 con 0x7f52740f2040 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b031d0 2024-02-16T10:31:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f527c022070 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f527c022070 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.595+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b031d0 2024-02-16T10:31:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b031d0 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f52740f2040 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f527c022070 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b031d0 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f52740f2040 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.599+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f52740f2040 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f527c022070 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b092c0 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f52740f2040 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x55e581b031d0 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f526c02e040 con 0x7f527c022070 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:48.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b07f00 con 0x55e581b031d0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b07b80 con 0x55e581b031d0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b087d0 con 0x7f527c022070 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 zone default found 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 4 Realm: () 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:48.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 zonegroup default 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0bfe0 con 0x7f52740f2040 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.603+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0de60 con 0x55e581b092c0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0e1c0 con 0x55e581b092c0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 20 started sync module instance, tier type = 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0d430 con 0x7f527c022070 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94444211720080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0e1c0 con 0x7f527c022070 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0eb90 con 0x55e581b031d0 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94444211720080] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94444211725968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0ef40 con 0x55e581b031d0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.607+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0f8f0 con 0x55e581b092c0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94444211725968] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94444211722208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0f8b0 con 0x55e581b092c0 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b102b0 con 0x7f527c022070 2024-02-16T10:31:48.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94444211731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b10b00 con 0x7f527c022070 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.611+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b11520 con 0x55e581b031d0 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94444211722208] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94444211731984] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94444211734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b0f410 con 0x55e581b031d0 2024-02-16T10:31:48.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b11d70 con 0x7f52740f2040 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.615+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94444211734112] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94444211736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b11d20 con 0x7f52740f2040 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b12730 con 0x7f52740f2040 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94444211736576] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94444211739024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b12730 con 0x7f52740f2040 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.619+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b130a0 con 0x7f52740f2040 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94444211743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b134c0 con 0x7f52740f2040 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=0 2024-02-16T10:31:48.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=1 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=2 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=3 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=4 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=5 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94444211739024] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=6 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94444211743744] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 20 add_watcher() i=7 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b12310 con 0x55e581b031d0 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.623+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94444211741408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b13990 con 0x55e581b031d0 2024-02-16T10:31:48.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94444211741408] v33'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f513a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 5 note: GC not initialized 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f51397e2640 20 reqs_thread_entry: start 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 Filter name: none 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f50aaffd640 20 reqs_thread_entry: start 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x55e581b031d0 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f52740f2040 2024-02-16T10:31:48.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f513a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.627+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94444211741408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x55e581b031d0 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94444211741408] v33'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94444211720080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f527c022070 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94444211720080] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5286a3c980 20 remove_watcher() i=0 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5286a3c980 2 removed watcher, disabling cache 2024-02-16T10:31:48.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.631+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94444211725968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x55e581b031d0 2024-02-16T10:31:48.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94444211725968] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 20 remove_watcher() i=1 2024-02-16T10:31:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94444211722208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x55e581b092c0 2024-02-16T10:31:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5284d58640 1 -- 172.21.15.138:0/1906221833 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94444211722208] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f527c012070 con 0x55e581b092c0 2024-02-16T10:31:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 20 remove_watcher() i=2 2024-02-16T10:31:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94444211731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f527c022070 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5284557640 1 -- 172.21.15.138:0/1906221833 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94444211731984] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f52740b1040 con 0x7f527c022070 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 20 remove_watcher() i=3 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.635+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94444211734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x55e581b031d0 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94444211734112] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x55e581b031d0 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5286a3c980 20 remove_watcher() i=4 2024-02-16T10:31:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94444211736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f52740f2040 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94444211736576] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5286a3c980 20 remove_watcher() i=5 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.639+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94444211739024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f52740f2040 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.643+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94444211739024] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.643+0000 7f5286a3c980 20 remove_watcher() i=6 2024-02-16T10:31:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.643+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94444211743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e581b37ee0 con 0x7f52740f2040 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94444211743744] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f526c00e640 con 0x7f52740f2040 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 20 remove_watcher() i=7 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f52740f2040 msgr2=0x7f52740a97f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f52740f2040 0x7f52740a97f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e581b031d0 msgr2=0x55e581b05670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e581b031d0 0x55e581b05670 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f527c022070 msgr2=0x7f527c044070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f527c022070 0x7f527c044070 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e581b092c0 msgr2=0x55e581b0b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55e581b092c0 0x55e581b0b6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f51540342b0 msgr2=0x7f5154036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f51540342b0 0x7f5154036770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f52740e4330 tx=0x7f52740dc000 comp rx=0 tx=0).stop 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 msgr2=0x55e581af7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/1906221833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581af0d90 0x55e581af7ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f527c0497d0 tx=0x7f527c049800 comp rx=0 tx=0).stop 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 reap_dead start 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5283d56640 1 -- 172.21.15.138:0/1906221833 reap_dead start 2024-02-16T10:31:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 shutdown_connections 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 >> 172.21.15.138:0/1906221833 conn(0x55e581aeb910 msgr2=0x55e581aec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 shutdown_connections 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/1906221833 wait complete. 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 msgr2=0x7f515c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 0x7f515c036770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55e581ad1120 tx=0x7f52740e4040 comp rx=0 tx=0).stop 2024-02-16T10:31:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 msgr2=0x55e581ae41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55e581aca1a0 tx=0x7f527c00e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 shutdown_connections 2024-02-16T10:31:48.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f515c0342b0 0x7f515c036770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3584342021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e581ae3db0 0x55e581ae41d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 >> 172.21.15.138:0/3584342021 conn(0x55e581ad8bc0 msgr2=0x55e581ad96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 shutdown_connections 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3584342021 wait complete. 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 msgr2=0x55e581ad0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 0x55e581ad0250 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 msgr2=0x55e581ad5860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 0x55e581ad5860 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 msgr2=0x7f516c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 0x7f516c036770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f526c001da0 tx=0x7f526c001300 comp rx=0 tx=0).stop 2024-02-16T10:31:48.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 msgr2=0x55e581ac9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f527401b870 tx=0x7f5274019810 comp rx=0 tx=0).stop 2024-02-16T10:31:48.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 shutdown_connections 2024-02-16T10:31:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55e581ad2000 0x55e581ad5860 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55e5819d9820 0x55e581ad0250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f516c0342b0 0x7f516c036770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 --2- 172.21.15.138:0/3630756680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e58194af60 0x55e581ac9600 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 >> 172.21.15.138:0/3630756680 conn(0x55e5819d0dc0 msgr2=0x55e581abad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 shutdown_connections 2024-02-16T10:31:48.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.647+0000 7f5286a3c980 1 -- 172.21.15.138:0/3630756680 wait complete. 2024-02-16T10:31:48.691 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:48.692 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:48.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T10:31:48.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-02-16T10:31:48.693 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-02-16T10:31:48.777 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:48.777 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1ffe3a980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563a480854b0 0x563a48085890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1ffe3a980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563a47fd2b60 con 0x563a48085dd0 2024-02-16T10:31:48.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1ffe3a980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a47f99d30 con 0x563a480854b0 2024-02-16T10:31:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1fd955640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x563a480854b0 0x563a48085890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1fd154640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x563a48085dd0 0x563a480867e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42658/0 (socket says 172.21.15.138:42658) 2024-02-16T10:31:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1fd154640 1 -- 172.21.15.138:0/496470863 learned_addr learned my addr 172.21.15.138:0/496470863 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1fd955640 1 -- 172.21.15.138:0/496470863 >> v1:172.21.15.107:6789/0 conn(0x563a48085dd0 legacy=0x563a480867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.775+0000 7ff1fd955640 1 -- 172.21.15.138:0/496470863 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a48087010 con 0x563a480854b0 2024-02-16T10:31:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1fd955640 1 --2- 172.21.15.138:0/496470863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a48085890 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a480 tx=0x7ff1f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753516ef8c16f033 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1fc953640 1 -- 172.21.15.138:0/496470863 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f00ab540 con 0x563a480854b0 2024-02-16T10:31:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1fc953640 1 -- 172.21.15.138:0/496470863 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00ab6a0 con 0x563a480854b0 2024-02-16T10:31:48.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1fc953640 1 -- 172.21.15.138:0/496470863 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f00ab960 con 0x563a480854b0 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/496470863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 msgr2=0x563a48085890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/496470863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a48085890 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000a480 tx=0x7ff1f001b280 comp rx=0 tx=0).stop 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/496470863 shutdown_connections 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/496470863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a48085890 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/496470863 >> 172.21.15.138:0/496470863 conn(0x563a48080d80 msgr2=0x563a480831a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/496470863 shutdown_connections 2024-02-16T10:31:48.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.779+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/496470863 wait complete. 2024-02-16T10:31:48.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a47f96fc0 con 0x563a480854b0 2024-02-16T10:31:48.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1fd955640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1fd955640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55154/0 (socket says 172.21.15.138:55154) 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1fd955640 1 -- 172.21.15.138:0/1758975274 learned_addr learned my addr 172.21.15.138:0/1758975274 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1fd955640 1 -- 172.21.15.138:0/1758975274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0005d30 con 0x563a480854b0 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1fd955640 1 --2- 172.21.15.138:0/1758975274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0018eb0 tx=0x7ff1f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e93a11da23be58 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff0ebe07640 1 -- 172.21.15.138:0/1758975274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f000a050 con 0x563a480854b0 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff0ebe07640 1 -- 172.21.15.138:0/1758975274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f000a1b0 con 0x563a480854b0 2024-02-16T10:31:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff0ebe07640 1 -- 172.21.15.138:0/1758975274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f00ab810 con 0x563a480854b0 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/1758975274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 msgr2=0x563a4816fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/1758975274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0018eb0 tx=0x7ff1f0003030 comp rx=0 tx=0).stop 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/1758975274 shutdown_connections 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/1758975274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a4816fc20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/1758975274 >> 172.21.15.138:0/1758975274 conn(0x563a48080d80 msgr2=0x563a4816b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/1758975274 shutdown_connections 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/1758975274 wait complete. 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.795+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a47f927a0 con 0x563a480854b0 2024-02-16T10:31:48.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd955640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd955640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55164/0 (socket says 172.21.15.138:55164) 2024-02-16T10:31:48.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd955640 1 -- 172.21.15.138:0/2432360695 learned_addr learned my addr 172.21.15.138:0/2432360695 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd955640 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a48087010 con 0x563a480854b0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd955640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001b2c0 tx=0x7ff1f0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 -- 172.21.15.138:0/2432360695 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f00ab510 con 0x563a480854b0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 -- 172.21.15.138:0/2432360695 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00c3070 con 0x563a480854b0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 -- 172.21.15.138:0/2432360695 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f0009930 con 0x563a480854b0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a48176f10 con 0x563a480854b0 2024-02-16T10:31:48.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a481773c0 con 0x563a480854b0 2024-02-16T10:31:48.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 -- 172.21.15.138:0/2432360695 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1f00b2030 con 0x563a480854b0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 0x7ff0e4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff0ea604640 1 -- 172.21.15.138:0/2432360695 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ff1f00e43b0 con 0x563a480854b0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd154640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 0x7ff0e4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 0x563a4817d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a4817dc00 con 0x563a48085dd0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fe156640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 0x563a4817d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fd154640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 0x7ff0e4036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80012f0 tx=0x7ff1e8006700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.799+0000 7ff1fe156640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 0x563a4817d6c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/2432360695 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1f80083f0 con 0x563a48085dd0 2024-02-16T10:31:48.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a4817dfa0 con 0x563a48085dd0 2024-02-16T10:31:48.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/2432360695 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1f80083f0 con 0x563a48085dd0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a4817f850 con 0x563a48085dd0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/2432360695 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ff1f80083f0 con 0x563a48085dd0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a4817ea50 con 0x563a48085dd0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/2432360695 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1f80083f0 con 0x563a48085dd0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 0x563a48182bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481831e0 con 0x563a4817f370 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fd955640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 0x563a48182bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fd955640 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 0x563a48182bd0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fd955640 1 -- 172.21.15.138:0/2432360695 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff1f00e40b0 con 0x563a4817f370 2024-02-16T10:31:48.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1ffe3a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a47f2af20 con 0x563a48192230 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55174/0 (socket says 172.21.15.138:55174) 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/705129268 learned_addr learned my addr 172.21.15.138:0/705129268 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.803+0000 7ff1fe156640 1 -- 172.21.15.138:0/705129268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a48192b90 con 0x563a48192230 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fe156640 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x563a48177c20 tx=0x7ff1f800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 -- 172.21.15.138:0/705129268 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f800f040 con 0x563a48192230 2024-02-16T10:31:48.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 -- 172.21.15.138:0/705129268 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8019550 con 0x563a48192230 2024-02-16T10:31:48.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 -- 172.21.15.138:0/705129268 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f8019810 con 0x563a48192230 2024-02-16T10:31:48.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a48192de0 con 0x563a48192230 2024-02-16T10:31:48.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a48193930 con 0x563a48192230 2024-02-16T10:31:48.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 -- 172.21.15.138:0/705129268 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1f8019970 con 0x563a48192230 2024-02-16T10:31:48.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 0x7ff0d80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff0e37fe640 1 -- 172.21.15.138:0/705129268 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ff1f804b580 con 0x563a48192230 2024-02-16T10:31:48.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fd955640 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 0x7ff0d80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fd955640 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 0x7ff0d80367c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x563a4817e490 tx=0x7ff1f00bfef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1ffe3a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a47f1e790 con 0x563a481866b0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55190/0 (socket says 172.21.15.138:55190) 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fe156640 1 -- 172.21.15.138:0/483349798 learned_addr learned my addr 172.21.15.138:0/483349798 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.807+0000 7ff1fe156640 1 -- 172.21.15.138:0/483349798 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a481870a0 con 0x563a481866b0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 --2- 172.21.15.138:0/483349798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8049870 tx=0x7ff1f802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f758a9ae5e7927cb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0e17fa640 1 -- 172.21.15.138:0/483349798 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f803b580 con 0x563a481866b0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0e17fa640 1 -- 172.21.15.138:0/483349798 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80183b0 con 0x563a481866b0 2024-02-16T10:31:48.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0e17fa640 1 -- 172.21.15.138:0/483349798 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f80153a0 con 0x563a481866b0 2024-02-16T10:31:48.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/483349798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 msgr2=0x563a48186ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/483349798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8049870 tx=0x7ff1f802af40 comp rx=0 tx=0).stop 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/483349798 shutdown_connections 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/483349798 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a48186ad0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/483349798 >> 172.21.15.138:0/483349798 conn(0x563a48199d30 msgr2=0x563a4819ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/483349798 shutdown_connections 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/483349798 wait complete. 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 Processor -- start 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- start start 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a481a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a481a85e0 con 0x563a481866b0 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a481a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a481a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55206/0 (socket says 172.21.15.138:55206) 2024-02-16T10:31:48.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 learned_addr learned my addr 172.21.15.138:0/396553697 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a48193930 con 0x563a481866b0 2024-02-16T10:31:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1fe156640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a481a80a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800bfd0 tx=0x7ff1f80497d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0cf7fe640 1 -- 172.21.15.138:0/396553697 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f8019c20 con 0x563a481866b0 2024-02-16T10:31:48.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a481a87e0 con 0x563a481866b0 2024-02-16T10:31:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0cf7fe640 1 -- 172.21.15.138:0/396553697 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8018520 con 0x563a481866b0 2024-02-16T10:31:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff0cf7fe640 1 -- 172.21.15.138:0/396553697 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1f8015860 con 0x563a481866b0 2024-02-16T10:31:48.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.811+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a481a8c70 con 0x563a481866b0 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff0cf7fe640 1 -- 172.21.15.138:0/396553697 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ff1f8017a50 con 0x563a481866b0 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff0cf7fe640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0c8034300 0x7ff0c80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff0cf7fe640 1 -- 172.21.15.138:0/396553697 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ff1f8036d20 con 0x563a481866b0 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a481b3810 0x563a481b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b6400 con 0x563a481b3810 2024-02-16T10:31:48.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a481b3810 0x563a481b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a481b3810 0x563a481b5cb0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 realm 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b2d30 con 0x563a481b3810 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b6e80 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b7340 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b6b00 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 20 searching for the correct realm 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563a481b9680 0x563a481bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b9680 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fe156640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563a481b9680 0x563a481bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.815+0000 7ff1fe156640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563a481b9680 0x563a481bbad0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fe156640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff1f8022070 0x7ff1f803b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x7ff1f8022070 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd955640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff1f8022070 0x7ff1f803b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd955640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff1f8022070 0x7ff1f803b770 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd955640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1f00ab030 0x7ff1f00bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x7ff1f00ab030 2024-02-16T10:31:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1f00ab030 0x7ff1f00bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1f00ab030 0x7ff1f00bd3d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.819+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x7ff1f00ab030 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x7ff1f8022070 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b9680 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x563a481b3810 2024-02-16T10:31:48.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc1a0 con 0x7ff1f00ab030 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b3810 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f8022070 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f8022070 2024-02-16T10:31:48.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.823+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b3810 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b3810 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f00ab030 2024-02-16T10:31:48.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f8022070 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b3810 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f00ab030 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f00ab030 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.827+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f8022070 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b9680 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f00ab030 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x563a481b3810 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff1e8031040 con 0x7ff1f8022070 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b8270 con 0x563a481b3810 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b7ef0 con 0x563a481b3810 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481b8b40 con 0x7ff1f8022070 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 zone default found 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 4 Realm: () 2024-02-16T10:31:48.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 zonegroup default 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bc5e0 con 0x7ff1f00ab030 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481be460 con 0x563a481b9680 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.831+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481be7c0 con 0x563a481b9680 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 20 started sync module instance, tier type = 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bda30 con 0x7ff1f8022070 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94808317875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481beb20 con 0x7ff1f8022070 2024-02-16T10:31:48.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bf4f0 con 0x563a481b3810 2024-02-16T10:31:48.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94808317875600] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00e40b0 con 0x7ff1f8022070 2024-02-16T10:31:48.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94808317882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bf4b0 con 0x563a481b3810 2024-02-16T10:31:48.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.835+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bfed0 con 0x563a481b9680 2024-02-16T10:31:48.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94808317884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481bfed0 con 0x563a481b9680 2024-02-16T10:31:48.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c0db0 con 0x7ff1f8022070 2024-02-16T10:31:48.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94808317882352] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00fc040 con 0x7ff1f8022070 2024-02-16T10:31:48.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94808317888656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c0d70 con 0x7ff1f8022070 2024-02-16T10:31:48.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.839+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c1790 con 0x563a481b3810 2024-02-16T10:31:48.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94808317884944] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94808317888656] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00fc040 con 0x7ff1f8022070 2024-02-16T10:31:48.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94808317877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c1790 con 0x563a481b3810 2024-02-16T10:31:48.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c1fe0 con 0x7ff1f00ab030 2024-02-16T10:31:48.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94808317877792] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94808317891280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c1c30 con 0x7ff1f00ab030 2024-02-16T10:31:48.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.843+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c25a0 con 0x7ff1f00ab030 2024-02-16T10:31:48.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd955640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0c8034300 0x7ff0c80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd955640 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0c8034300 0x7ff0c80367c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00aa520 tx=0x7ff1f00f6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94808317891280] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94808317892768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c25a0 con 0x7ff1f00ab030 2024-02-16T10:31:48.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c2e20 con 0x7ff1f00ab030 2024-02-16T10:31:48.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94808317896688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c32c0 con 0x7ff1f00ab030 2024-02-16T10:31:48.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=0 2024-02-16T10:31:48.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=1 2024-02-16T10:31:48.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=2 2024-02-16T10:31:48.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=3 2024-02-16T10:31:48.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=4 2024-02-16T10:31:48.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=5 2024-02-16T10:31:48.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94808317892768] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.847+0000 7ff1ffe3a980 20 add_watcher() i=6 2024-02-16T10:31:48.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94808317896688] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 20 add_watcher() i=7 2024-02-16T10:31:48.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:48.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c2100 con 0x563a481b3810 2024-02-16T10:31:48.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94808317898208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481c2100 con 0x563a481b3810 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94808317898208] v33'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff0af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff1ffe3a980 5 note: GC not initialized 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.851+0000 7ff0ae7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 20 Filter name: none 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff01ffff640 20 reqs_thread_entry: start 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 20 rados->read ofs=0 len=0 2024-02-16T10:31:48.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x563a481b3810 2024-02-16T10:31:48.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:48.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f00ab030 2024-02-16T10:31:48.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff0af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:48.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.855+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94808317898208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x563a481b3810 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94808317898208] v33'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94808317875600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f8022070 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94808317875600] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00fc040 con 0x7ff1f8022070 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 20 remove_watcher() i=0 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 2 removed watcher, disabling cache 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94808317882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x563a481b3810 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94808317882352] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 20 remove_watcher() i=1 2024-02-16T10:31:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.859+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94808317884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x563a481b9680 2024-02-16T10:31:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1fe156640 1 -- 172.21.15.138:0/396553697 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94808317884944] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f8012070 con 0x563a481b9680 2024-02-16T10:31:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1ffe3a980 20 remove_watcher() i=2 2024-02-16T10:31:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94808317888656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f8022070 2024-02-16T10:31:48.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1fd955640 1 -- 172.21.15.138:0/396553697 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94808317888656] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1f00fc040 con 0x7ff1f8022070 2024-02-16T10:31:48.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1ffe3a980 20 remove_watcher() i=3 2024-02-16T10:31:48.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.863+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94808317877792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x563a481b3810 2024-02-16T10:31:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94808317877792] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x563a481b3810 2024-02-16T10:31:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1ffe3a980 20 remove_watcher() i=4 2024-02-16T10:31:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94808317891280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f00ab030 2024-02-16T10:31:48.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94808317891280] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1ffe3a980 20 remove_watcher() i=5 2024-02-16T10:31:48.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.867+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94808317892768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f00ab030 2024-02-16T10:31:48.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94808317892768] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 20 remove_watcher() i=6 2024-02-16T10:31:48.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94808317896688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563a481e7db0 con 0x7ff1f00ab030 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94808317896688] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e8004530 con 0x7ff1f00ab030 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 20 remove_watcher() i=7 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1f00ab030 msgr2=0x7ff1f00bd3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ff1f00ab030 0x7ff1f00bd3d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a481b3810 msgr2=0x563a481b5cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a481b3810 0x563a481b5cb0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff1f8022070 msgr2=0x7ff1f803b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ff1f8022070 0x7ff1f803b770 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563a481b9680 msgr2=0x563a481bbad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x563a481b9680 0x563a481bbad0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0c8034300 msgr2=0x7ff0c80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0c8034300 0x7ff0c80367c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00aa520 tx=0x7ff1f00f6040 comp rx=0 tx=0).stop 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 msgr2=0x563a481a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/396553697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a481866b0 0x563a481a80a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800bfd0 tx=0x7ff1f80497d0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 reap_dead start 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1fd154640 1 -- 172.21.15.138:0/396553697 reap_dead start 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 shutdown_connections 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 >> 172.21.15.138:0/396553697 conn(0x563a48199d30 msgr2=0x563a4819ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 shutdown_connections 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/396553697 wait complete. 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 msgr2=0x7ff0d80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 0x7ff0d80367c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x563a4817e490 tx=0x7ff1f00bfef0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 msgr2=0x563a48192650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.871+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x563a48177c20 tx=0x7ff1f800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 shutdown_connections 2024-02-16T10:31:48.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0d8034300 0x7ff0d80367c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/705129268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a48192230 0x563a48192650 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 >> 172.21.15.138:0/705129268 conn(0x563a481878a0 msgr2=0x563a48189c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 shutdown_connections 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/705129268 wait complete. 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 msgr2=0x563a4817d6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 0x563a4817d6c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 msgr2=0x563a48182bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 0x563a48182bd0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 msgr2=0x7ff0e4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 0x7ff0e4036770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80012f0 tx=0x7ff1e8006700 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 msgr2=0x563a481769d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff1f001b2c0 tx=0x7ff1f0018020 comp rx=0 tx=0).stop 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 shutdown_connections 2024-02-16T10:31:48.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x563a4817f370 0x563a48182bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x563a48085dd0 0x563a4817d6c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff0e40342b0 0x7ff0e4036770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 --2- 172.21.15.138:0/2432360695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x563a480854b0 0x563a481769d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 >> 172.21.15.138:0/2432360695 conn(0x563a48080d80 msgr2=0x563a4816a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 shutdown_connections 2024-02-16T10:31:48.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.875+0000 7ff1ffe3a980 1 -- 172.21.15.138:0/2432360695 wait complete. 2024-02-16T10:31:48.888 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:48.889 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:48.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T10:31:48.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-02-16T10:31:48.889 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-02-16T10:31:48.968 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:48.968 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.963+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.963+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.963+0000 7f31095f4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f57cffbdc0 0x55f57cffe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.963+0000 7f31095f4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f57cf41b60 con 0x55f57cf69720 2024-02-16T10:31:48.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.963+0000 7f31095f4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f57cf08d30 con 0x55f57cffbdc0 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310690e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f57cffbdc0 0x55f57cffe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310710f640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f57cf69720 0x55f57cffa6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42664/0 (socket says 172.21.15.138:42664) 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310710f640 1 -- 172.21.15.138:0/2888189985 learned_addr learned my addr 172.21.15.138:0/2888189985 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310690e640 1 -- 172.21.15.138:0/2888189985 >> v1:172.21.15.107:6789/0 conn(0x55f57cf69720 legacy=0x55f57cffa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310610d640 1 -- 172.21.15.138:0/2888189985 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511031072 0 0) 0x55f57cf41b60 con 0x55f57cf69720 2024-02-16T10:31:48.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310690e640 1 -- 172.21.15.138:0/2888189985 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57cfff700 con 0x55f57cffbdc0 2024-02-16T10:31:48.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310690e640 1 --2- 172.21.15.138:0/2888189985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cffbdc0 0x55f57cffe1b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f30f000a480 tx=0x7f30f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0fd3933fdb78da server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310610d640 1 -- 172.21.15.138:0/2888189985 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f00ab540 con 0x55f57cffbdc0 2024-02-16T10:31:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310610d640 1 -- 172.21.15.138:0/2888189985 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00ab6a0 con 0x55f57cffbdc0 2024-02-16T10:31:48.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.967+0000 7f310610d640 1 -- 172.21.15.138:0/2888189985 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f00ab960 con 0x55f57cffbdc0 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 -- 172.21.15.138:0/2888189985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cffbdc0 msgr2=0x55f57cffe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 --2- 172.21.15.138:0/2888189985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cffbdc0 0x55f57cffe1b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f30f000a480 tx=0x7f30f001b280 comp rx=0 tx=0).stop 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 -- 172.21.15.138:0/2888189985 shutdown_connections 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 --2- 172.21.15.138:0/2888189985 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cffbdc0 0x55f57cffe1b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 -- 172.21.15.138:0/2888189985 >> 172.21.15.138:0/2888189985 conn(0x55f57cfefd80 msgr2=0x55f57cff21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 -- 172.21.15.138:0/2888189985 shutdown_connections 2024-02-16T10:31:48.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.971+0000 7f31095f4980 1 -- 172.21.15.138:0/2888189985 wait complete. 2024-02-16T10:31:48.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.983+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:48.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.983+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.983+0000 7f31095f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.983+0000 7f31095f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cf05fc0 con 0x55f57cf69720 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.983+0000 7f310710f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55218/0 (socket says 172.21.15.138:55218) 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 -- 172.21.15.138:0/3575952282 learned_addr learned my addr 172.21.15.138:0/3575952282 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 -- 172.21.15.138:0/3575952282 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0005d30 con 0x55f57cf69720 2024-02-16T10:31:48.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 --2- 172.21.15.138:0/3575952282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f310000b250 tx=0x7f310000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8341195640caa709 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f2ff560a640 1 -- 172.21.15.138:0/3575952282 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3100014070 con 0x55f57cf69720 2024-02-16T10:31:48.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f2ff560a640 1 -- 172.21.15.138:0/3575952282 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000d640 con 0x55f57cf69720 2024-02-16T10:31:48.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f2ff560a640 1 -- 172.21.15.138:0/3575952282 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310000d960 con 0x55f57cf69720 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- 172.21.15.138:0/3575952282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 msgr2=0x55f57d0e1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 --2- 172.21.15.138:0/3575952282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f310000b250 tx=0x7f310000b710 comp rx=0 tx=0).stop 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- 172.21.15.138:0/3575952282 shutdown_connections 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 --2- 172.21.15.138:0/3575952282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e1880 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- 172.21.15.138:0/3575952282 >> 172.21.15.138:0/3575952282 conn(0x55f57cfefd80 msgr2=0x55f57d0dd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- 172.21.15.138:0/3575952282 shutdown_connections 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- 172.21.15.138:0/3575952282 wait complete. 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f31095f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cf017a0 con 0x55f57cf69720 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55230/0 (socket says 172.21.15.138:55230) 2024-02-16T10:31:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 -- 172.21.15.138:0/3518912015 learned_addr learned my addr 172.21.15.138:0/3518912015 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100001bb0 con 0x55f57cf69720 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.987+0000 7f310710f640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3100000c10 tx=0x7f3100000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 -- 172.21.15.138:0/3518912015 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31000012c0 con 0x55f57cf69720 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 -- 172.21.15.138:0/3518912015 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3100021070 con 0x55f57cf69720 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 -- 172.21.15.138:0/3518912015 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f310000fc20 con 0x55f57cf69720 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f57d0e8ec0 con 0x55f57cf69720 2024-02-16T10:31:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57d0e9370 con 0x55f57cf69720 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 -- 172.21.15.138:0/3518912015 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f310001a480 con 0x55f57cf69720 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 0x7f2fec0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f2ff3e07640 1 -- 172.21.15.138:0/3518912015 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f310004a230 con 0x55f57cf69720 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f310690e640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 0x7f2fec0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 0x55f57d0ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:48.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d0efb60 con 0x55f57cffbdc0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f3107910640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 0x55f57d0ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f310690e640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 0x7f2fec0367c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ad000 tx=0x7f30f00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f3107910640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 0x55f57d0ef620 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f3107910640 1 -- 172.21.15.138:0/3518912015 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57cffbdc0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d0ecd00 con 0x55f57cffbdc0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f3107910640 1 -- 172.21.15.138:0/3518912015 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57cffbdc0 2024-02-16T10:31:48.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.991+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d0f1540 con 0x55f57cffbdc0 2024-02-16T10:31:48.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 -- 172.21.15.138:0/3518912015 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57cffbdc0 2024-02-16T10:31:48.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d0f03a0 con 0x55f57cffbdc0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 -- 172.21.15.138:0/3518912015 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57cffbdc0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 0x55f57d0f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d0f52e0 con 0x55f57d0f29b0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f310710f640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 0x55f57d0f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f310710f640 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 0x55f57d0f4da0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f310710f640 1 -- 172.21.15.138:0/3518912015 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3100016070 con 0x55f57d0f29b0 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57ce99f20 con 0x55f57d103120 2024-02-16T10:31:49.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55244/0 (socket says 172.21.15.138:55244) 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 -- 172.21.15.138:0/3919600085 learned_addr learned my addr 172.21.15.138:0/3919600085 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 -- 172.21.15.138:0/3919600085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57d103a80 con 0x55f57d103120 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f3107910640 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55f57d0e9520 tx=0x7f30f8018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f2ff1602640 1 -- 172.21.15.138:0/3919600085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f801d070 con 0x55f57d103120 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f2ff1602640 1 -- 172.21.15.138:0/3919600085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f8014450 con 0x55f57d103120 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f57d103cd0 con 0x55f57d103120 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f2ff1602640 1 -- 172.21.15.138:0/3919600085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f80146f0 con 0x55f57d103120 2024-02-16T10:31:49.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.995+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57d104820 con 0x55f57d103120 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2ff1602640 1 -- 172.21.15.138:0/3919600085 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f30f8020020 con 0x55f57d103120 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2ff1602640 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 0x7f2fe00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2ff1602640 1 -- 172.21.15.138:0/3919600085 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f30f804b280 con 0x55f57d103120 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f310710f640 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 0x7f2fe00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f310710f640 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 0x7f2fe00367c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f57d0f0f50 tx=0x7f310000fd80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f31095f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f31095f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57ce8d790 con 0x55f57d1100c0 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55252/0 (socket says 172.21.15.138:55252) 2024-02-16T10:31:49.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f3107910640 1 -- 172.21.15.138:0/679856816 learned_addr learned my addr 172.21.15.138:0/679856816 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f3107910640 1 -- 172.21.15.138:0/679856816 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57d110ab0 con 0x55f57d1100c0 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f3107910640 1 --2- 172.21.15.138:0/679856816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f30f8049500 tx=0x7f30f80480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2950d0214bddba37 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2feaffd640 1 -- 172.21.15.138:0/679856816 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f802b350 con 0x55f57d1100c0 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2feaffd640 1 -- 172.21.15.138:0/679856816 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f802b4b0 con 0x55f57d1100c0 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:48.999+0000 7f2feaffd640 1 -- 172.21.15.138:0/679856816 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f8012560 con 0x55f57d1100c0 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/679856816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 msgr2=0x55f57d1104e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 --2- 172.21.15.138:0/679856816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f30f8049500 tx=0x7f30f80480e0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/679856816 shutdown_connections 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 --2- 172.21.15.138:0/679856816 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d1104e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/679856816 >> 172.21.15.138:0/679856816 conn(0x55f57d10ac40 msgr2=0x55f57d10bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/679856816 shutdown_connections 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/679856816 wait complete. 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 Processor -- start 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- start start 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57d117350 con 0x55f57d1100c0 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f3107910640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55266/0 (socket says 172.21.15.138:55266) 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 learned_addr learned my addr 172.21.15.138:0/2552307679 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57d104820 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f3107910640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f30f80483d0 tx=0x7f30f8049490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 -- 172.21.15.138:0/2552307679 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f8032070 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f57d117550 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 -- 172.21.15.138:0/2552307679 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f802be80 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 -- 172.21.15.138:0/2552307679 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30f802b350 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57d117980 con 0x55f57d1100c0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 -- 172.21.15.138:0/2552307679 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f30f8049640 con 0x55f57d1100c0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fd0034260 0x7f2fd0036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f2fe97fa640 1 -- 172.21.15.138:0/2552307679 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f30f804ce20 con 0x55f57d1100c0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.003+0000 7f310710f640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fd0034260 0x7f2fd0036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57d122530 0x55f57d1249f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d125140 con 0x55f57d122530 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57d122530 0x55f57d1249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fd0034260 0x7f2fd0036720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f310000b750 tx=0x7f3100033030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57d122530 0x55f57d1249f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 realm 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d125530 con 0x55f57d122530 2024-02-16T10:31:49.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d125d80 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1260e0 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d125a20 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:49.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 20 searching for the correct realm 2024-02-16T10:31:49.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f57d128330 0x55f57d12a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f3107910640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f57d128330 0x55f57d12a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f3107910640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f57d128330 0x55f57d12a780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57d128330 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f3107910640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f30f8044030 0x7f30f802d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f30f8044030 0x7f30f802d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f30f8044030 0x7f30f802d480 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3100027430 0x7f31000485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.007+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3100027430 0x7f31000485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3100027430 0x7f31000485f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57d128330 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.011+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57d128330 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f800a4d0 con 0x55f57d128330 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.015+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f30f8044030 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d128330 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x7f3100027430 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.019+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ae50 con 0x55f57d122530 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f30f00da080 con 0x7f30f8044030 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d126f10 con 0x55f57d122530 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d126b90 con 0x55f57d122530 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1277e0 con 0x7f30f8044030 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 zone default found 2024-02-16T10:31:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 4 Realm: () 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 zonegroup default 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12b2e0 con 0x7f3100027430 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12d160 con 0x55f57d128330 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12d4c0 con 0x55f57d128330 2024-02-16T10:31:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 started sync module instance, tier type = 2024-02-16T10:31:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.023+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12c6e0 con 0x7f30f8044030 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512853729856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12d4c0 con 0x7f30f8044030 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12de70 con 0x55f57d122530 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512853729856] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512853731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12e220 con 0x55f57d122530 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.027+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12ebd0 con 0x55f57d128330 2024-02-16T10:31:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512853731984] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512853735824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12eb90 con 0x55f57d128330 2024-02-16T10:31:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12f590 con 0x7f30f8044030 2024-02-16T10:31:49.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512853741808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12fde0 con 0x7f30f8044030 2024-02-16T10:31:49.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1307b0 con 0x55f57d122530 2024-02-16T10:31:49.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512853735824] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.031+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512853741808] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512853743936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d12e6f0 con 0x55f57d122530 2024-02-16T10:31:49.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d131000 con 0x7f3100027430 2024-02-16T10:31:49.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512853743936] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512853746352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d130f60 con 0x7f3100027430 2024-02-16T10:31:49.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.035+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1318d0 con 0x7f3100027430 2024-02-16T10:31:49.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512853746352] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512853748416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d131ab0 con 0x7f3100027430 2024-02-16T10:31:49.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1322b0 con 0x7f3100027430 2024-02-16T10:31:49.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512853748416] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.039+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512853751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1321b0 con 0x7f3100027430 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=0 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=1 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=2 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=3 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=4 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=5 2024-02-16T10:31:49.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=6 2024-02-16T10:31:49.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512853751792] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 add_watcher() i=7 2024-02-16T10:31:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1356e0 con 0x55f57d122530 2024-02-16T10:31:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512853752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d132b90 con 0x55f57d122530 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512853752912] v33'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f2fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.043+0000 7f31095f4980 5 note: GC not initialized 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f2fbcfe1640 20 reqs_thread_entry: start 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 20 Filter name: none 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f2f367fc640 20 reqs_thread_entry: start 2024-02-16T10:31:49.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x55f57d122530 2024-02-16T10:31:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:31:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f3100027430 2024-02-16T10:31:49.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1378 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f2fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.047+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512853752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x55f57d122530 2024-02-16T10:31:49.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94512853752912] v33'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512853729856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f30f8044030 2024-02-16T10:31:49.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94512853729856] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 20 remove_watcher() i=0 2024-02-16T10:31:49.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 2 removed watcher, disabling cache 2024-02-16T10:31:49.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512853731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x55f57d122530 2024-02-16T10:31:49.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94512853731984] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 20 remove_watcher() i=1 2024-02-16T10:31:49.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.051+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512853735824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x55f57d128330 2024-02-16T10:31:49.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f3107910640 1 -- 172.21.15.138:0/2552307679 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94512853735824] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f8060040 con 0x55f57d128330 2024-02-16T10:31:49.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f31095f4980 20 remove_watcher() i=2 2024-02-16T10:31:49.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512853741808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f30f8044030 2024-02-16T10:31:49.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f310710f640 1 -- 172.21.15.138:0/2552307679 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94512853741808] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3100016070 con 0x7f30f8044030 2024-02-16T10:31:49.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f31095f4980 20 remove_watcher() i=3 2024-02-16T10:31:49.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.055+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512853743936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x55f57d122530 2024-02-16T10:31:49.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94512853743936] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x55f57d122530 2024-02-16T10:31:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f31095f4980 20 remove_watcher() i=4 2024-02-16T10:31:49.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512853746352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f3100027430 2024-02-16T10:31:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94512853746352] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f31095f4980 20 remove_watcher() i=5 2024-02-16T10:31:49.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.059+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512853748416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f3100027430 2024-02-16T10:31:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94512853748416] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 20 remove_watcher() i=6 2024-02-16T10:31:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512853751792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f57d1570b0 con 0x7f3100027430 2024-02-16T10:31:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94512853751792] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f30f00ab810 con 0x7f3100027430 2024-02-16T10:31:49.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 20 remove_watcher() i=7 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3100027430 msgr2=0x7f31000485f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f3100027430 0x7f31000485f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57d122530 msgr2=0x55f57d1249f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57d122530 0x55f57d1249f0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f30f8044030 msgr2=0x7f30f802d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f30f8044030 0x7f30f802d480 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f57d128330 msgr2=0x55f57d12a780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f57d128330 0x55f57d12a780 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fd0034260 msgr2=0x7f2fd0036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fd0034260 0x7f2fd0036720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f310000b750 tx=0x7f3100033030 comp rx=0 tx=0).stop 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 msgr2=0x55f57d116e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f310690e640 1 -- 172.21.15.138:0/2552307679 reap_dead start 2024-02-16T10:31:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f30f80483d0 tx=0x7f30f8049490 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 shutdown_connections 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 --2- 172.21.15.138:0/2552307679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d1100c0 0x55f57d116e10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 >> 172.21.15.138:0/2552307679 conn(0x55f57d10ac40 msgr2=0x55f57d10bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 shutdown_connections 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.063+0000 7f31095f4980 1 -- 172.21.15.138:0/2552307679 wait complete. 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 msgr2=0x7f2fe00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 0x7f2fe00367c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f57d0f0f50 tx=0x7f310000fd80 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 msgr2=0x55f57d103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55f57d0e9520 tx=0x7f30f8018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 shutdown_connections 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fe0034300 0x7f2fe00367c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3919600085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57d103120 0x55f57d103540 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 >> 172.21.15.138:0/3919600085 conn(0x55f57d0f7f30 msgr2=0x55f57d0f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 shutdown_connections 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3919600085 wait complete. 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 msgr2=0x55f57d0ef620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 0x55f57d0ef620 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 msgr2=0x55f57d0f4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 0x55f57d0f4da0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 msgr2=0x7f2fec0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 0x7f2fec0367c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ad000 tx=0x7f30f00a5040 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 msgr2=0x55f57d0e8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3100000c10 tx=0x7f3100000ee0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 shutdown_connections 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f57d0f29b0 0x55f57d0f4da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f57cffbdc0 0x55f57d0ef620 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2fec034300 0x7f2fec0367c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 --2- 172.21.15.138:0/3518912015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f57cf69720 0x55f57d0e8980 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 >> 172.21.15.138:0/3518912015 conn(0x55f57cfefd80 msgr2=0x55f57d0dbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 shutdown_connections 2024-02-16T10:31:49.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.067+0000 7f31095f4980 1 -- 172.21.15.138:0/3518912015 wait complete. 2024-02-16T10:31:49.081 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-02-16T10:00:00.000000Z","epoch":1708077600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-02-16T10:31:49.081 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-02-16T10:00:00.000000Z', 'epoch': 1708077600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-02-16T10:31:49.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T10:31:49.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-02-16T10:31:49.082 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-02-16T10:31:49.167 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:49.167 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:49.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7378c52980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55efc44f1b30 0x55efc44f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7378c52980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55efc4439af0 con 0x55efc44ed620 2024-02-16T10:31:49.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7378c52980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55efc4400d30 con 0x55efc44f1b30 2024-02-16T10:31:49.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7375f6c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55efc44f1b30 0x55efc44f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7375f6c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55efc44f1b30 0x55efc44f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55276/0 (socket says 172.21.15.138:55276) 2024-02-16T10:31:49.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7375f6c640 1 -- 172.21.15.138:0/2326636936 learned_addr learned my addr 172.21.15.138:0/2326636936 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f737676d640 1 --1- 172.21.15.138:0/2326636936 >> v1:172.21.15.107:6789/0 conn(0x55efc44ed620 0x55efc44eda00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42676/0 (socket says 172.21.15.138:42676) 2024-02-16T10:31:49.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7375f6c640 1 -- 172.21.15.138:0/2326636936 >> v1:172.21.15.107:6789/0 conn(0x55efc44ed620 legacy=0x55efc44eda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.163+0000 7f7375f6c640 1 -- 172.21.15.138:0/2326636936 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efc44f5470 con 0x55efc44f1b30 2024-02-16T10:31:49.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7375f6c640 1 --2- 172.21.15.138:0/2326636936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44f1b30 0x55efc44f3f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f736c00a5c0 tx=0x7f736c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715b69f30ba5b5c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f737576b640 1 -- 172.21.15.138:0/2326636936 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f736c0aa470 con 0x55efc44f1b30 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f737576b640 1 -- 172.21.15.138:0/2326636936 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0aa5d0 con 0x55efc44f1b30 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f737576b640 1 -- 172.21.15.138:0/2326636936 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f736c0aa890 con 0x55efc44f1b30 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 -- 172.21.15.138:0/2326636936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44f1b30 msgr2=0x55efc44f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 --2- 172.21.15.138:0/2326636936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44f1b30 0x55efc44f3f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f736c00a5c0 tx=0x7f736c01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:49.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 -- 172.21.15.138:0/2326636936 shutdown_connections 2024-02-16T10:31:49.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 --2- 172.21.15.138:0/2326636936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44f1b30 0x55efc44f3f20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 -- 172.21.15.138:0/2326636936 >> 172.21.15.138:0/2326636936 conn(0x55efc44e8ef0 msgr2=0x55efc44eb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 -- 172.21.15.138:0/2326636936 shutdown_connections 2024-02-16T10:31:49.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.167+0000 7f7378c52980 1 -- 172.21.15.138:0/2326636936 wait complete. 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f7378c52980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f7378c52980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efc43fdfc0 con 0x55efc44ed620 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f737676d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f737676d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55292/0 (socket says 172.21.15.138:55292) 2024-02-16T10:31:49.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f737676d640 1 -- 172.21.15.138:0/2412725738 learned_addr learned my addr 172.21.15.138:0/2412725738 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.183+0000 7f737676d640 1 -- 172.21.15.138:0/2412725738 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c005df0 con 0x55efc44ed620 2024-02-16T10:31:49.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 --2- 172.21.15.138:0/2412725738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7368001d40 tx=0x7f736800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85541b93946ec771 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7264608640 1 -- 172.21.15.138:0/2412725738 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7368014070 con 0x55efc44ed620 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7264608640 1 -- 172.21.15.138:0/2412725738 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736800f590 con 0x55efc44ed620 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7264608640 1 -- 172.21.15.138:0/2412725738 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7368007040 con 0x55efc44ed620 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/2412725738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 msgr2=0x55efc45d7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 --2- 172.21.15.138:0/2412725738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7368001d40 tx=0x7f736800b610 comp rx=0 tx=0).stop 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/2412725738 shutdown_connections 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 --2- 172.21.15.138:0/2412725738 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45d7730 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/2412725738 >> 172.21.15.138:0/2412725738 conn(0x55efc44e8ef0 msgr2=0x55efc45d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/2412725738 shutdown_connections 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/2412725738 wait complete. 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efc43f97a0 con 0x55efc44ed620 2024-02-16T10:31:49.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55302/0 (socket says 172.21.15.138:55302) 2024-02-16T10:31:49.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 -- 172.21.15.138:0/158239710 learned_addr learned my addr 172.21.15.138:0/158239710 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efc4439af0 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f737676d640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f736800b650 tx=0x7f7368000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7262e05640 1 -- 172.21.15.138:0/158239710 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7368014030 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55efc45debe0 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7262e05640 1 -- 172.21.15.138:0/158239710 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368001530 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7262e05640 1 -- 172.21.15.138:0/158239710 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f736800eb10 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.187+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efc45df090 con 0x55efc44ed620 2024-02-16T10:31:49.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7262e05640 1 -- 172.21.15.138:0/158239710 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f736800ed00 con 0x55efc44ed620 2024-02-16T10:31:49.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7262e05640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 0x7f725c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7262e05640 1 -- 172.21.15.138:0/158239710 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7368006070 con 0x55efc44ed620 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7375f6c640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 0x7f725c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 0x55efc45e5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc45e58d0 con 0x55efc44f1b30 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 0x55efc45e5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7375f6c640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 0x7f725c036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f736c0ae000 tx=0x7f736c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 0x55efc45e5390 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 -- 172.21.15.138:0/158239710 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc44f1b30 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc45e2aa0 con 0x55efc44f1b30 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 -- 172.21.15.138:0/158239710 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc44f1b30 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc45e75d0 con 0x55efc44f1b30 2024-02-16T10:31:49.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 -- 172.21.15.138:0/158239710 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc44f1b30 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc45e67d0 con 0x55efc44f1b30 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7376f6e640 1 -- 172.21.15.138:0/158239710 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc44f1b30 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 0x55efc45ea950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc45eb040 con 0x55efc45e70f0 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f737676d640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 0x55efc45ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f737676d640 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 0x55efc45ea950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.191+0000 7f737676d640 1 -- 172.21.15.138:0/158239710 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7368016070 con 0x55efc45e70f0 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efc4391f20 con 0x55efc45f8f70 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55310/0 (socket says 172.21.15.138:55310) 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7376f6e640 1 -- 172.21.15.138:0/2653708756 learned_addr learned my addr 172.21.15.138:0/2653708756 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7376f6e640 1 -- 172.21.15.138:0/2653708756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efc45f98d0 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7376f6e640 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55efc45df5a0 tx=0x7f73700188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 -- 172.21.15.138:0/2653708756 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f737001d070 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55efc45f9b20 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 -- 172.21.15.138:0/2653708756 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370014580 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 -- 172.21.15.138:0/2653708756 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7370014860 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efc45fa670 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 -- 172.21.15.138:0/2653708756 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7370020020 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 0x7f7250036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f725bfff640 1 -- 172.21.15.138:0/2653708756 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f737004b310 con 0x55efc45f8f70 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f737676d640 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 0x7f7250036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f737676d640 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 0x7f7250036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55efc45e6150 tx=0x7f7368018f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.195+0000 7f7378c52980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efc4385790 con 0x55efc44631b0 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55314/0 (socket says 172.21.15.138:55314) 2024-02-16T10:31:49.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 -- 172.21.15.138:0/644080948 learned_addr learned my addr 172.21.15.138:0/644080948 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 -- 172.21.15.138:0/644080948 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efc4463b60 con 0x55efc44631b0 2024-02-16T10:31:49.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- 172.21.15.138:0/644080948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7370049590 tx=0x7f737002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304aa1a7264be41b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7259ffb640 1 -- 172.21.15.138:0/644080948 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7370048070 con 0x55efc44631b0 2024-02-16T10:31:49.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7259ffb640 1 -- 172.21.15.138:0/644080948 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737003b050 con 0x55efc44631b0 2024-02-16T10:31:49.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7259ffb640 1 -- 172.21.15.138:0/644080948 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f737003b1c0 con 0x55efc44631b0 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- 172.21.15.138:0/644080948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 msgr2=0x55efc4463590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 --2- 172.21.15.138:0/644080948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7370049590 tx=0x7f737002bf40 comp rx=0 tx=0).stop 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- 172.21.15.138:0/644080948 shutdown_connections 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 --2- 172.21.15.138:0/644080948 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc4463590 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- 172.21.15.138:0/644080948 >> 172.21.15.138:0/644080948 conn(0x55efc4600a70 msgr2=0x55efc4601950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- 172.21.15.138:0/644080948 shutdown_connections 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- 172.21.15.138:0/644080948 wait complete. 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 Processor -- start 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- start start 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7378c52980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efc460f320 con 0x55efc44631b0 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55324/0 (socket says 172.21.15.138:55324) 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 learned_addr learned my addr 172.21.15.138:0/3406598091 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efc45fa670 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.199+0000 7f7376f6e640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7370048410 tx=0x7f7370049520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 -- 172.21.15.138:0/3406598091 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7370016440 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55efc460f520 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 -- 172.21.15.138:0/3406598091 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73700165a0 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 -- 172.21.15.138:0/3406598091 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7370014b10 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efc460f950 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 -- 172.21.15.138:0/3406598091 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f73700123a0 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7240034260 0x7f7240036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7247fff640 1 -- 172.21.15.138:0/3406598091 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7370039d10 con 0x55efc44631b0 2024-02-16T10:31:49.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f737676d640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7240034260 0x7f7240036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc461a4d0 0x55efc461c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461d0e0 con 0x55efc461a4d0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7375f6c640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc461a4d0 0x55efc461c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f737676d640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7240034260 0x7f7240036720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7368047f90 tx=0x7f7368031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7375f6c640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc461a4d0 0x55efc461c990 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 realm 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461d4d0 con 0x55efc461a4d0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461dd50 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.203+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461e0b0 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461e8b0 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 20 searching for the correct realm 2024-02-16T10:31:49.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55efc4620740 0x55efc4622b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4623220 con 0x55efc4620740 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7376f6e640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55efc4620740 0x55efc4622b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7376f6e640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55efc4620740 0x55efc4622b50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7376f6e640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7370038020 0x7f737004b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f737676d640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7370038020 0x7f737004b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f737676d640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7370038020 0x7f737004b790 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f737676d640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f73680417a0 0x7f736801b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f73680417a0 0x7f736801b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f73680417a0 0x7f736801b850 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.207+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.211+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.215+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f7370038020 2024-02-16T10:31:49.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc4620740 2024-02-16T10:31:49.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x7f73680417a0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7370053040 con 0x55efc461a4d0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f736c0dd040 con 0x7f7370038020 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461f0b0 con 0x55efc461a4d0 2024-02-16T10:31:49.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461f460 con 0x55efc461a4d0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc461f460 con 0x7f7370038020 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 zone default found 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 4 Realm: () 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 zonegroup default 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.219+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4623660 con 0x7f73680417a0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4625040 con 0x55efc4620740 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4625440 con 0x55efc4620740 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 started sync module instance, tier type = 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc46244d0 con 0x7f7370038020 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488280318000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624cd0 con 0x7f7370038020 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.223+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4625ed0 con 0x55efc461a4d0 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488280318000] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488280324560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4626280 con 0x55efc461a4d0 2024-02-16T10:31:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4626bf0 con 0x55efc4620740 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488280324560] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488280320048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4626bf0 con 0x55efc4620740 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.227+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4627610 con 0x7f7370038020 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488280330512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4627e90 con 0x7f7370038020 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4628890 con 0x55efc461a4d0 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488280320048] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488280330512] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488280332784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4626750 con 0x55efc461a4d0 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.231+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc46290e0 con 0x7f73680417a0 2024-02-16T10:31:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488280332784] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488280335248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4629090 con 0x7f73680417a0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4629aa0 con 0x7f73680417a0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488280335248] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488280337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4629aa0 con 0x7f73680417a0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.235+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc462a2e0 con 0x7f73680417a0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488280337392] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488280339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc462a4c0 con 0x7f73680417a0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=0 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=1 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=2 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=3 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=4 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=5 2024-02-16T10:31:49.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=6 2024-02-16T10:31:49.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488280339968] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 20 add_watcher() i=7 2024-02-16T10:31:49.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.239+0000 7f7378c52980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:49.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc462d880 con 0x55efc461a4d0 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488280343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc462ac70 con 0x55efc461a4d0 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488280343472] v33'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f722cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 5 note: GC not initialized 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f71a77fe640 20 reqs_thread_entry: start 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 Filter name: none 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f71a57fa640 20 reqs_thread_entry: start 2024-02-16T10:31:49.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464f670 con 0x7f73680417a0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464f670 con 0x55efc461a4d0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T10:31:49.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-02-16T10:31:49.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.243+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464e370 con 0x7f73680417a0 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~347] v33'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7378c52980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7378c52980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7378c52980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94488280491824 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464e370 con 0x7f73680417a0 2024-02-16T10:31:49.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== watch-notify(notify (1) cookie 94488280339968 notify 141733920791 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f736c0b9070 con 0x7f73680417a0 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94488280339968 notifier 4724 bl.length()=523 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(65 notify.7 [notify cookie 94488280491824 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7259ffb640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f723c003ea0 con 0x7f73680417a0 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.247+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== watch-notify(notify_complete (2) cookie 94488280491824 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55efc44f5470 con 0x7f73680417a0 2024-02-16T10:31:49.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464e320 con 0x55efc461a4d0 2024-02-16T10:31:49.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7378c52980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:31:49.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7378c52980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:31:49.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7378c52980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:31:49.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94488280489600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464e2a0 con 0x7f73680417a0 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== watch-notify(notify (1) cookie 94488280335248 notify 141733920792 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55efc44f5470 con 0x7f73680417a0 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94488280335248 notifier 4724 bl.length()=177 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(68 notify.5 [notify cookie 94488280489600 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7259ffb640 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f723c003ea0 con 0x7f73680417a0 2024-02-16T10:31:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== watch-notify(notify_complete (2) cookie 94488280489600 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f736c0de450 con 0x7f73680417a0 2024-02-16T10:31:49.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.251+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.257 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:31:49.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f722cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488280343472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc464e290 con 0x55efc461a4d0 2024-02-16T10:31:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94488280343472] v33'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488280318000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc462a3b0 con 0x7f7370038020 2024-02-16T10:31:49.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94488280318000] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7378c52980 20 remove_watcher() i=0 2024-02-16T10:31:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7378c52980 2 removed watcher, disabling cache 2024-02-16T10:31:49.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.255+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488280324560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624030 con 0x55efc461a4d0 2024-02-16T10:31:49.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94488280324560] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7378c52980 20 remove_watcher() i=1 2024-02-16T10:31:49.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488280320048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624030 con 0x55efc4620740 2024-02-16T10:31:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7376f6e640 1 -- 172.21.15.138:0/3406598091 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94488280320048] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f737000a4d0 con 0x55efc4620740 2024-02-16T10:31:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7378c52980 20 remove_watcher() i=2 2024-02-16T10:31:49.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.259+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488280330512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624830 con 0x7f7370038020 2024-02-16T10:31:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f737676d640 1 -- 172.21.15.138:0/3406598091 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94488280330512] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7368016070 con 0x7f7370038020 2024-02-16T10:31:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f7378c52980 20 remove_watcher() i=3 2024-02-16T10:31:49.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488280332784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624030 con 0x55efc461a4d0 2024-02-16T10:31:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94488280332784] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x55efc461a4d0 2024-02-16T10:31:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f7378c52980 20 remove_watcher() i=4 2024-02-16T10:31:49.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.263+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488280335248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624830 con 0x7f73680417a0 2024-02-16T10:31:49.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94488280335248] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7378c52980 20 remove_watcher() i=5 2024-02-16T10:31:49.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488280337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624030 con 0x7f73680417a0 2024-02-16T10:31:49.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94488280337392] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7378c52980 20 remove_watcher() i=6 2024-02-16T10:31:49.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.267+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488280339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55efc4624830 con 0x7f73680417a0 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94488280339968] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f736c0b0020 con 0x7f73680417a0 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 20 remove_watcher() i=7 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f73680417a0 msgr2=0x7f736801b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f73680417a0 0x7f736801b850 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc461a4d0 msgr2=0x55efc461c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc461a4d0 0x55efc461c990 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7370038020 msgr2=0x7f737004b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7370038020 0x7f737004b790 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55efc4620740 msgr2=0x55efc4622b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55efc4620740 0x55efc4622b50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7240034260 msgr2=0x7f7240036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7240034260 0x7f7240036720 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7368047f90 tx=0x7f7368031000 comp rx=0 tx=0).stop 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 msgr2=0x55efc460ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7370048410 tx=0x7f7370049520 comp rx=0 tx=0).stop 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7375f6c640 1 -- 172.21.15.138:0/3406598091 reap_dead start 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 shutdown_connections 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/3406598091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44631b0 0x55efc460ede0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 >> 172.21.15.138:0/3406598091 conn(0x55efc4600a70 msgr2=0x55efc4601950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 shutdown_connections 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/3406598091 wait complete. 2024-02-16T10:31:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 msgr2=0x7f7250036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 0x7f7250036770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55efc45e6150 tx=0x7f7368018f60 comp rx=0 tx=0).stop 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 msgr2=0x55efc45f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55efc45df5a0 tx=0x7f73700188f0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 shutdown_connections 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f72500342b0 0x7f7250036770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/2653708756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc45f8f70 0x55efc45f9390 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 >> 172.21.15.138:0/2653708756 conn(0x55efc45edd80 msgr2=0x55efc45ee890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 shutdown_connections 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/2653708756 wait complete. 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 msgr2=0x55efc45e5390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 0x55efc45e5390 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 msgr2=0x55efc45ea950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 0x55efc45ea950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 msgr2=0x7f725c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 0x7f725c036770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f736c0ae000 tx=0x7f736c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 msgr2=0x55efc45de6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f736800b650 tx=0x7f7368000ee0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 shutdown_connections 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55efc45e70f0 0x55efc45ea950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55efc44f1b30 0x55efc45e5390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f725c0342b0 0x7f725c036770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 --2- 172.21.15.138:0/158239710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55efc44ed620 0x55efc45de6a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 >> 172.21.15.138:0/158239710 conn(0x55efc44e8ef0 msgr2=0x55efc45d1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 shutdown_connections 2024-02-16T10:31:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.271+0000 7f7378c52980 1 -- 172.21.15.138:0/158239710 wait complete. 2024-02-16T10:31:49.287 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:31:49.308 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:49.316 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-02-16T10:31:49.316 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T10:31:49.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-02-16T10:31:49.316 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-02-16T10:31:49.350 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:49.350 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dc1ad4980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f3d8a167e0 0x55f3d8a16bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dc1ad4980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f3d8960b60 con 0x55f3d8a17100 2024-02-16T10:31:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dc1ad4980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f3d8927d30 con 0x55f3d8a167e0 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbf5ef640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f3d8a167e0 0x55f3d8a16bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbf5ef640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f3d8a167e0 0x55f3d8a16bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55332/0 (socket says 172.21.15.138:55332) 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbedee640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f3d8a17100 0x55f3d8a17ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42678/0 (socket says 172.21.15.138:42678) 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3761997455 learned_addr learned my addr 172.21.15.138:0/3761997455 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3761997455 >> v1:172.21.15.107:6789/0 conn(0x55f3d8a17100 legacy=0x55f3d8a17ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3761997455 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d8a182e0 con 0x55f3d8a167e0 2024-02-16T10:31:49.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.347+0000 7f7dbe5ed640 1 -- 172.21.15.138:0/3761997455 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234069619 0 0) 0x55f3d8960b60 con 0x55f3d8a17100 2024-02-16T10:31:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/3761997455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8a16bc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7db000a5c0 tx=0x7f7db001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5bdcfd08a45d0b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dbe5ed640 1 -- 172.21.15.138:0/3761997455 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00aa470 con 0x55f3d8a167e0 2024-02-16T10:31:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dbe5ed640 1 -- 172.21.15.138:0/3761997455 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00aa5d0 con 0x55f3d8a167e0 2024-02-16T10:31:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dbe5ed640 1 -- 172.21.15.138:0/3761997455 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00aa890 con 0x55f3d8a167e0 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3761997455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 msgr2=0x55f3d8a16bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3761997455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8a16bc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7db000a5c0 tx=0x7f7db001b340 comp rx=0 tx=0).stop 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3761997455 shutdown_connections 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3761997455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8a16bc0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3761997455 >> 172.21.15.138:0/3761997455 conn(0x55f3d8989f00 msgr2=0x55f3d898a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3761997455 shutdown_connections 2024-02-16T10:31:49.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.351+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3761997455 wait complete. 2024-02-16T10:31:49.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dc1ad4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dc1ad4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d8924fc0 con 0x55f3d8a167e0 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dbf5ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dbf5ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55342/0 (socket says 172.21.15.138:55342) 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1562692929 learned_addr learned my addr 172.21.15.138:0/1562692929 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1562692929 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db0005df0 con 0x55f3d8a167e0 2024-02-16T10:31:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1562692929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7db001b380 tx=0x7f7db0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8393cf0babaf0e55 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7cad60a640 1 -- 172.21.15.138:0/1562692929 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00aa930 con 0x55f3d8a167e0 2024-02-16T10:31:49.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7cad60a640 1 -- 172.21.15.138:0/1562692929 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00aaa90 con 0x55f3d8a167e0 2024-02-16T10:31:49.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.367+0000 7f7cad60a640 1 -- 172.21.15.138:0/1562692929 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00aad30 con 0x55f3d8a167e0 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1562692929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 msgr2=0x55f3d8b00c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1562692929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7db001b380 tx=0x7f7db0003030 comp rx=0 tx=0).stop 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1562692929 shutdown_connections 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1562692929 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a167e0 0x55f3d8b00c30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1562692929 >> 172.21.15.138:0/1562692929 conn(0x55f3d8989f00 msgr2=0x55f3d8afc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1562692929 shutdown_connections 2024-02-16T10:31:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1562692929 wait complete. 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d89207a0 con 0x55f3d8a17100 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dbf5ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dbf5ef640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55346/0 (socket says 172.21.15.138:55346) 2024-02-16T10:31:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3824425749 learned_addr learned my addr 172.21.15.138:0/3824425749 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d8a182e0 con 0x55f3d8a17100 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7db00aa5a0 tx=0x7f7db00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7cabe07640 1 -- 172.21.15.138:0/3824425749 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00bd620 con 0x55f3d8a17100 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7cabe07640 1 -- 172.21.15.138:0/3824425749 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00bd780 con 0x55f3d8a17100 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3d8b08250 con 0x55f3d8a17100 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7cabe07640 1 -- 172.21.15.138:0/3824425749 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db00bda60 con 0x55f3d8a17100 2024-02-16T10:31:49.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.371+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3d8b08700 con 0x55f3d8a17100 2024-02-16T10:31:49.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7cabe07640 1 -- 172.21.15.138:0/3824425749 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7db00bb070 con 0x55f3d8a17100 2024-02-16T10:31:49.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7cabe07640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 0x7f7ca4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7cabe07640 1 -- 172.21.15.138:0/3824425749 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7db00e3dd0 con 0x55f3d8a17100 2024-02-16T10:31:49.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbedee640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 0x7f7ca4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 0x55f3d8b0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b0f280 con 0x55f3d8b0c950 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 0x55f3d8b0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbedee640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 0x7f7ca4036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7db4000c10 tx=0x7f7db40013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 0x55f3d8b0ed40 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3824425749 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b0c950 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b0c060 con 0x55f3d8b0c950 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3824425749 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b0c950 2024-02-16T10:31:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b10f80 con 0x55f3d8b0c950 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3824425749 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b0c950 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b10180 con 0x55f3d8b0c950 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3824425749 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b0c950 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 0x55f3d8b14300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b148d0 con 0x55f3d8b10aa0 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 0x55f3d8b14300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 0x55f3d8b14300 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/3824425749 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7db00d5040 con 0x55f3d8b10aa0 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.375+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d88b8f20 con 0x55f3d8b22870 2024-02-16T10:31:49.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55352/0 (socket says 172.21.15.138:55352) 2024-02-16T10:31:49.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/4235842205 learned_addr learned my addr 172.21.15.138:0/4235842205 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/4235842205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d8b231d0 con 0x55f3d8b22870 2024-02-16T10:31:49.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55f3d8b08bc0 tx=0x7f7db8018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 -- 172.21.15.138:0/4235842205 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db801d070 con 0x55f3d8b22870 2024-02-16T10:31:49.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 -- 172.21.15.138:0/4235842205 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8014450 con 0x55f3d8b22870 2024-02-16T10:31:49.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3d8b23420 con 0x55f3d8b22870 2024-02-16T10:31:49.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 -- 172.21.15.138:0/4235842205 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db80146f0 con 0x55f3d8b22870 2024-02-16T10:31:49.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3d8b23f70 con 0x55f3d8b22870 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 -- 172.21.15.138:0/4235842205 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7db8020020 con 0x55f3d8b22870 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 0x7f7c98036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7ca9602640 1 -- 172.21.15.138:0/4235842205 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7db804b280 con 0x55f3d8b22870 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 0x7f7c98036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.379+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 0x7f7c98036770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55f3d8b0fc20 tx=0x7f7db0006390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d88ac790 con 0x55f3d8b2f810 2024-02-16T10:31:49.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55362/0 (socket says 172.21.15.138:55362) 2024-02-16T10:31:49.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3789635277 learned_addr learned my addr 172.21.15.138:0/3789635277 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/3789635277 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d8b30200 con 0x55f3d8b2f810 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/3789635277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7db8049500 tx=0x7f7db8049640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be9ff84ef66a262 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7ca2ffd640 1 -- 172.21.15.138:0/3789635277 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db803b110 con 0x55f3d8b2f810 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7ca2ffd640 1 -- 172.21.15.138:0/3789635277 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db803b270 con 0x55f3d8b2f810 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7ca2ffd640 1 -- 172.21.15.138:0/3789635277 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db802b4a0 con 0x55f3d8b2f810 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3789635277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 msgr2=0x55f3d8b2fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3789635277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7db8049500 tx=0x7f7db8049640 comp rx=0 tx=0).stop 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3789635277 shutdown_connections 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3789635277 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b2fc30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3789635277 >> 172.21.15.138:0/3789635277 conn(0x55f3d8b2a390 msgr2=0x55f3d8b2b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3789635277 shutdown_connections 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3789635277 wait complete. 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 Processor -- start 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- start start 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dc1ad4980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3d8b36c40 con 0x55f3d8b2f810 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55366/0 (socket says 172.21.15.138:55366) 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 learned_addr learned my addr 172.21.15.138:0/1564847630 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:49.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3d8b23f70 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.383+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7db8012f90 tx=0x7f7db8049490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 -- 172.21.15.138:0/1564847630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db8033070 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3d8b36e40 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 -- 172.21.15.138:0/1564847630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db802b740 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 -- 172.21.15.138:0/1564847630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7db8016440 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3d8b372d0 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 -- 172.21.15.138:0/1564847630 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f7db8049b20 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c880342b0 0x7f7c88036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7ca17fa640 1 -- 172.21.15.138:0/1564847630 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f7db8002ef0 con 0x55f3d8b2f810 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c880342b0 0x7f7c88036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b41de0 0x55f3d8b442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b449f0 con 0x55f3d8b41de0 2024-02-16T10:31:49.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b41de0 0x55f3d8b442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c880342b0 0x7f7c88036770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7db00bcff0 tx=0x7f7db00bdf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b41de0 0x55f3d8b442a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 realm 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b41240 con 0x55f3d8b41de0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b45470 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b45110 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.387+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46230 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 20 searching for the correct realm 2024-02-16T10:31:49.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f3d8b48130 0x55f3d8b4a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x55f3d8b48130 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f3d8b48130 0x55f3d8b4a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f3d8b48130 0x55f3d8b4a5f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b48130 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbfdf0640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7db8014850 0x7f7db80470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x7f7db8014850 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7db8014850 0x7f7db80470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7db8014850 0x7f7db80470d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbf5ef640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f7db00ec040 0x7f7db00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x7f7db00ec040 2024-02-16T10:31:49.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f7db00ec040 0x7f7db00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f7db00ec040 0x7f7db00cf950 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x55f3d8b41de0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.391+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x55f3d8b41de0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x55f3d8b41de0 2024-02-16T10:31:49.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4acc0 con 0x7f7db00ec040 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b48130 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db00ec040 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.395+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db00ec040 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db00ec040 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.399+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db00ec040 2024-02-16T10:31:49.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b48130 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db00ec040 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x55f3d8b41de0 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7db402d040 con 0x7f7db8014850 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:49.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x55f3d8b41de0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46de0 con 0x55f3d8b41de0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:49.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46de0 con 0x7f7db8014850 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 zone default found 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 4 Realm: () 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 zonegroup default 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.403+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4b100 con 0x7f7db00ec040 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4ce90 con 0x55f3d8b48130 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4d1f0 con 0x55f3d8b48130 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 started sync module instance, tier type = 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:49.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4c320 con 0x7f7db8014850 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505801137792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4cb20 con 0x7f7db8014850 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4dc50 con 0x55f3d8b41de0 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.407+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94505801137792] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505801144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4dbd0 con 0x55f3d8b41de0 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4e980 con 0x55f3d8b48130 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94505801144240] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505801146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4e8c0 con 0x55f3d8b48130 2024-02-16T10:31:49.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.411+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4f340 con 0x7f7db8014850 2024-02-16T10:31:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505801150112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b4f2c0 con 0x7f7db8014850 2024-02-16T10:31:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b50220 con 0x55f3d8b41de0 2024-02-16T10:31:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94505801146368] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94505801150112] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505801152240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b501e0 con 0x55f3d8b41de0 2024-02-16T10:31:49.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.415+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b50a70 con 0x7f7db00ec040 2024-02-16T10:31:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94505801152240] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505801153792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b50680 con 0x7f7db00ec040 2024-02-16T10:31:49.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b50ff0 con 0x7f7db00ec040 2024-02-16T10:31:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94505801153792] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505801155040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b51100 con 0x7f7db00ec040 2024-02-16T10:31:49.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.419+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b51900 con 0x7f7db00ec040 2024-02-16T10:31:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94505801155040] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505801158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b517c0 con 0x7f7db00ec040 2024-02-16T10:31:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=0 2024-02-16T10:31:49.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=1 2024-02-16T10:31:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=2 2024-02-16T10:31:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=3 2024-02-16T10:31:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=4 2024-02-16T10:31:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=5 2024-02-16T10:31:49.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=6 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94505801158208] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 20 add_watcher() i=7 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b54d20 con 0x55f3d8b41de0 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.423+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505801159264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b52160 con 0x55f3d8b41de0 2024-02-16T10:31:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94505801159264] v33'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:49.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 5 note: GC not initialized 2024-02-16T10:31:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7c74fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 Filter name: none 2024-02-16T10:31:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7bee7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:49.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b76bf0 con 0x7f7db00ec040 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(62 bar [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-02-16T10:31:49.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-02-16T10:31:49.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:49.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.427+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7a760 con 0x7f7db8014850 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v33'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94505801323792 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7b2a0 con 0x7f7db00ec040 2024-02-16T10:31:49.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== watch-notify(notify (1) cookie 94505801153792 notify 141733920794 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7f7db4037040 con 0x7f7db00ec040 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94505801153792 notifier 4731 bl.length()=357 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7ca2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7ca2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7ca2ffd640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7c84003ea0 con 0x7f7db00ec040 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(64 notify.5 [notify cookie 94505801323792 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== watch-notify(notify_complete (2) cookie 94505801323792 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7db40127f0 con 0x7f7db00ec040 2024-02-16T10:31:49.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7b1a0 con 0x55f3d8b41de0 2024-02-16T10:31:49.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 : miss 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.431+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 8.18 8:1f5ef835:root::.bucket.meta.myfoo6%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b78ad0 con 0x55f3d8b41de0 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv16 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=353 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 info.flags=0x17 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 to cache LRU end 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 2024-02-16T10:31:49.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 8.18 8:1f5ef835:root::.bucket.meta.myfoo6%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b82120 con 0x55f3d8b41de0 2024-02-16T10:31:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v33'18 uv18 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 info.flags=0x17 2024-02-16T10:31:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 to cache LRU end 2024-02-16T10:31:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T10:31:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9, ofs0, ns] 2024-02-16T10:31:49.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94505801322304 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7c6a0 con 0x7f7db00ec040 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== watch-notify(notify (1) cookie 94505801158208 notify 141733920795 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7f7db4047040 con 0x7f7db00ec040 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 94505801158208 notifier 4731 bl.length()=721 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 info.flags=0x17 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7ca27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 to cache LRU end 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7ca27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(69 notify.7 [notify cookie 94505801322304 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7ca27fc640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7bf4003530 con 0x7f7db00ec040 2024-02-16T10:31:49.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== watch-notify(notify_complete (2) cookie 94505801322304 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7db40127f0 con 0x7f7db00ec040 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 20 handle_bi_update(): bucket=:myfoo6[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9]): orig_sources= new_sources= 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 20 handle_bi_update(): bucket=:myfoo6[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9]): potential sources added=[] removed=[] 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 20 handle_bi_update(): bucket=:myfoo6[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9]): orig_dests= new_dests= 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 20 handle_bi_update(): bucket=:myfoo6[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9]): potential dests added=[] removed=[] 2024-02-16T10:31:49.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.435+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b78f40 con 0x55f3d8b41de0 2024-02-16T10:31:49.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(71 bud.buckets [call] v33'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-02-16T10:31:49.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 20 rados->read ofs=0 len=0 2024-02-16T10:31:49.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv17 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 20 rados_obj.operate() r=0 bl.length=166 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:49.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-02-16T10:31:49.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:73 4.3c 4:3c04b9b9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(73 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:74 4.f 4:f37df8ef:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(74 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 4.7 4:e01a095c:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x7f7db00ec040 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(75 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.2 [call out=85b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.439+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:76 4.1a 4:59825896:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x7f7db8014850 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(76 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.3 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 4.25 4:a635ef7f:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b48130 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(77 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:78 4.3c 4:3f2e92af:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(78 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 4.10 4:08f7ce26:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b48130 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(79 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.6 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:80 4.19 4:9b083779:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b48130 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(80 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 4.36 4:6c105ab7:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(81 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 4.1f 4:fbeeba9b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b48130 2024-02-16T10:31:49.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(82 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9 [call out=377b] v0'0 uv21 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 10 cls_bucket_list_unordered: got thirteen 2024-02-16T10:31:49.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:83 4.20 4:05f656a2:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b41de0 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(83 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 get_obj_state: octx=0x7f7db00b3dd0 obj=myfoo6:thirteen state=0x55f3d8b7b828 s->prefetch_data=0 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 3.3bs0 3:dd46dd3f:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80990 con 0x55f3d8b48130 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(84 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 10 manifest: total_size = 8 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.6336609273848449644 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.acl 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.content_type 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.etag 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.idtag 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.manifest 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-02-16T10:31:49.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 get_obj_state: octx=0x7f7db00b3dd0 obj=myfoo6:thirteen state=0x55f3d8b7b828 s->prefetch_data=0 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 : hit (requested=0x17, cached=0x17) 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.443+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 4.1f 4:fbeeba9b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b85c90 con 0x55f3d8b48130 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.447+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(85 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9 [stat,call,call] v33'22 uv22 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.447+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 3.3bs0 3:dd46dd3f:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b83dd0 con 0x55f3d8b48130 2024-02-16T10:31:49.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.447+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(86 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v33'6 uv6 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.447+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 4.1f 4:fbeeba9b:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b85380 con 0x55f3d8b48130 2024-02-16T10:31:49.454 INFO:teuthology.orchestra.run.smithi138.stderr:1 objects processed in :myfoo6[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9]). Next marker thirteen 2024-02-16T10:31:49.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b85380 con 0x7f7db8014850 2024-02-16T10:31:49.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~347] v33'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:31:49.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:49.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:31:49.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94505801355168 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b85380 con 0x7f7db00ec040 2024-02-16T10:31:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(87 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.9.9 [stat,call,call] v33'23 uv23 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7ca27fc640 20 handle_completion(): completion ok for obj=thirteen 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== watch-notify(notify (1) cookie 94505801153792 notify 141733920796 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x7f7db40127f0 con 0x7f7db00ec040 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94505801153792 notifier 4731 bl.length()=523 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7ca2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7ca2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7ca2ffd640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7c84003ea0 con 0x7f7db00ec040 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(89 notify.5 [notify cookie 94505801355168 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== watch-notify(notify_complete (2) cookie 94505801355168 notify 141733920796 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7db4041450 con 0x7f7db00ec040 2024-02-16T10:31:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.451+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7ae70 con 0x55f3d8b41de0 2024-02-16T10:31:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94505801366320 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b85340 con 0x7f7db00ec040 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== watch-notify(notify (1) cookie 94505801153792 notify 141733920797 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f7db4041450 con 0x7f7db00ec040 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94505801153792 notifier 4731 bl.length()=177 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-02-16T10:31:49.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(92 notify.5 [notify cookie 94505801366320 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7bf4003890 con 0x7f7db00ec040 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== watch-notify(notify_complete (2) cookie 94505801366320 notify 141733920797 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7db40415e0 con 0x7f7db00ec040 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 removing user index: bar 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 removing default.rgw.meta+users.uid+bar from cache 2024-02-16T10:31:49.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-02-16T10:31:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94505801366320 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b80f00 con 0x7f7db00ec040 2024-02-16T10:31:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== watch-notify(notify (1) cookie 94505801158208 notify 141733920798 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f7db40415e0 con 0x7f7db00ec040 2024-02-16T10:31:49.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 94505801158208 notifier 4731 bl.length()=152 2024-02-16T10:31:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7ca27fc640 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7bf4003890 con 0x7f7db00ec040 2024-02-16T10:31:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.455+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(94 notify.7 [notify cookie 94505801366320 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== watch-notify(notify_complete (2) cookie 94505801366320 notify 141733920798 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7db4041770 con 0x7f7db00ec040 2024-02-16T10:31:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b7ae70 con 0x7f7db00ec040 2024-02-16T10:31:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(96 bar [delete] v33'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.464 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:31:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:49.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.459+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505801159264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b68d20 con 0x55f3d8b41de0 2024-02-16T10:31:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94505801159264] v33'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505801137792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b68d20 con 0x7f7db8014850 2024-02-16T10:31:49.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94505801137792] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dc1ad4980 20 remove_watcher() i=0 2024-02-16T10:31:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dc1ad4980 2 removed watcher, disabling cache 2024-02-16T10:31:49.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.463+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505801144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x55f3d8b41de0 2024-02-16T10:31:49.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94505801144240] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dc1ad4980 20 remove_watcher() i=1 2024-02-16T10:31:49.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505801146368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x55f3d8b48130 2024-02-16T10:31:49.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dbfdf0640 1 -- 172.21.15.138:0/1564847630 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94505801146368] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db8060040 con 0x55f3d8b48130 2024-02-16T10:31:49.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dc1ad4980 20 remove_watcher() i=2 2024-02-16T10:31:49.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.467+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505801150112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x7f7db8014850 2024-02-16T10:31:49.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dbf5ef640 1 -- 172.21.15.138:0/1564847630 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94505801150112] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db00d5040 con 0x7f7db8014850 2024-02-16T10:31:49.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dc1ad4980 20 remove_watcher() i=3 2024-02-16T10:31:49.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505801152240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x55f3d8b41de0 2024-02-16T10:31:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94505801152240] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x55f3d8b41de0 2024-02-16T10:31:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dc1ad4980 20 remove_watcher() i=4 2024-02-16T10:31:49.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.471+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505801153792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x7f7db00ec040 2024-02-16T10:31:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94505801153792] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dc1ad4980 20 remove_watcher() i=5 2024-02-16T10:31:49.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505801155040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x7f7db00ec040 2024-02-16T10:31:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94505801155040] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dc1ad4980 20 remove_watcher() i=6 2024-02-16T10:31:49.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505801158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f3d8b46a30 con 0x7f7db00ec040 2024-02-16T10:31:49.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94505801158208] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7db400c040 con 0x7f7db00ec040 2024-02-16T10:31:49.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.475+0000 7f7dc1ad4980 20 remove_watcher() i=7 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f7db00ec040 msgr2=0x7f7db00cf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f7db00ec040 0x7f7db00cf950 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b41de0 msgr2=0x55f3d8b442a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b41de0 0x55f3d8b442a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7db8014850 msgr2=0x7f7db80470d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f7db8014850 0x7f7db80470d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f3d8b48130 msgr2=0x55f3d8b4a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f3d8b48130 0x55f3d8b4a5f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c880342b0 msgr2=0x7f7c88036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c880342b0 0x7f7c88036770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7db00bcff0 tx=0x7f7db00bdf90 comp rx=0 tx=0).stop 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 msgr2=0x55f3d8b36700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dbedee640 1 -- 172.21.15.138:0/1564847630 reap_dead start 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7db8012f90 tx=0x7f7db8049490 comp rx=0 tx=0).stop 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 shutdown_connections 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/1564847630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b2f810 0x55f3d8b36700 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 >> 172.21.15.138:0/1564847630 conn(0x55f3d8b2a390 msgr2=0x55f3d8b2b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 shutdown_connections 2024-02-16T10:31:49.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/1564847630 wait complete. 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 msgr2=0x7f7c98036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 0x7f7c98036770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55f3d8b0fc20 tx=0x7f7db0006390 comp rx=0 tx=0).stop 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 msgr2=0x55f3d8b22c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55f3d8b08bc0 tx=0x7f7db8018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 shutdown_connections 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7c980342b0 0x7f7c98036770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/4235842205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8b22870 0x55f3d8b22c90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 >> 172.21.15.138:0/4235842205 conn(0x55f3d8b17680 msgr2=0x55f3d8b18190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 shutdown_connections 2024-02-16T10:31:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/4235842205 wait complete. 2024-02-16T10:31:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 msgr2=0x55f3d8b0ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 0x55f3d8b0ed40 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 msgr2=0x55f3d8b14300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 0x55f3d8b14300 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 msgr2=0x7f7ca4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 0x7f7ca4036770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7db4000c10 tx=0x7f7db40013c0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 msgr2=0x55f3d8b07d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:49.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7db00aa5a0 tx=0x7f7db00180e0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 shutdown_connections 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f3d8b10aa0 0x55f3d8b14300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f3d8b0c950 0x55f3d8b0ed40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f7ca40342b0 0x7f7ca4036770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 --2- 172.21.15.138:0/3824425749 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f3d8a17100 0x55f3d8b07d10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 >> 172.21.15.138:0/3824425749 conn(0x55f3d8989f00 msgr2=0x55f3d8afb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 shutdown_connections 2024-02-16T10:31:49.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:49.479+0000 7f7dc1ad4980 1 -- 172.21.15.138:0/3824425749 wait complete. 2024-02-16T10:31:49.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:31:54.507 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:54.508 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:31:54.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T10:31:54.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-02-16T10:31:54.508 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-02-16T10:31:54.556 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:54.556 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:54.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f4022b86980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f67d2f29b0 0x55f67d2f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f4022b86980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f67d23aaf0 con 0x55f67d262790 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f4022b86980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f67d201d30 con 0x55f67d2f29b0 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f401fea0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f67d2f29b0 0x55f67d2f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f40206a1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f67d262790 0x55f67d2f1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42684/0 (socket says 172.21.15.138:42684) 2024-02-16T10:31:54.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.551+0000 7f40206a1640 1 -- 172.21.15.138:0/3389178313 learned_addr learned my addr 172.21.15.138:0/3389178313 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:54.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401f69f640 1 -- 172.21.15.138:0/3389178313 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078965765 0 0) 0x55f67d23aaf0 con 0x55f67d262790 2024-02-16T10:31:54.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401f69f640 1 -- 172.21.15.138:0/3389178313 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4008001e20 con 0x55f67d262790 2024-02-16T10:31:54.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401fea0640 1 -- 172.21.15.138:0/3389178313 >> v1:172.21.15.107:6789/0 conn(0x55f67d262790 legacy=0x55f67d2f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401fea0640 1 -- 172.21.15.138:0/3389178313 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f67d2f63b0 con 0x55f67d2f29b0 2024-02-16T10:31:54.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401fea0640 1 --2- 172.21.15.138:0/3389178313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2f29b0 0x55f67d2f4da0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f401400a480 tx=0x7f401401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3493bf61cda5318f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401f69f640 1 -- 172.21.15.138:0/3389178313 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40140ab540 con 0x55f67d2f29b0 2024-02-16T10:31:54.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401f69f640 1 -- 172.21.15.138:0/3389178313 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40140ab6a0 con 0x55f67d2f29b0 2024-02-16T10:31:54.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f401f69f640 1 -- 172.21.15.138:0/3389178313 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40140ab940 con 0x55f67d2f29b0 2024-02-16T10:31:54.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f4022b86980 1 -- 172.21.15.138:0/3389178313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2f29b0 msgr2=0x55f67d2f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f4022b86980 1 --2- 172.21.15.138:0/3389178313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2f29b0 0x55f67d2f4da0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f401400a480 tx=0x7f401401b280 comp rx=0 tx=0).stop 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f4022b86980 1 -- 172.21.15.138:0/3389178313 shutdown_connections 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f4022b86980 1 --2- 172.21.15.138:0/3389178313 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2f29b0 0x55f67d2f4da0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.555+0000 7f4022b86980 1 -- 172.21.15.138:0/3389178313 >> 172.21.15.138:0/3389178313 conn(0x55f67d2e8db0 msgr2=0x55f67d2eb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.559+0000 7f4022b86980 1 -- 172.21.15.138:0/3389178313 shutdown_connections 2024-02-16T10:31:54.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.559+0000 7f4022b86980 1 -- 172.21.15.138:0/3389178313 wait complete. 2024-02-16T10:31:54.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.571+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.571+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.571+0000 7f4022b86980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.571+0000 7f4022b86980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67d1fefc0 con 0x55f67d262790 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55382/0 (socket says 172.21.15.138:55382) 2024-02-16T10:31:54.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 -- 172.21.15.138:0/318606875 learned_addr learned my addr 172.21.15.138:0/318606875 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 -- 172.21.15.138:0/318606875 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014005d30 con 0x55f67d262790 2024-02-16T10:31:54.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- 172.21.15.138:0/318606875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4010006e30 tx=0x7f4010001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0fd484ec53dadb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f3f0e60c640 1 -- 172.21.15.138:0/318606875 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4010004530 con 0x55f67d262790 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f3f0e60c640 1 -- 172.21.15.138:0/318606875 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4010004690 con 0x55f67d262790 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f3f0e60c640 1 -- 172.21.15.138:0/318606875 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40100049f0 con 0x55f67d262790 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- 172.21.15.138:0/318606875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 msgr2=0x55f67d3d8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 --2- 172.21.15.138:0/318606875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4010006e30 tx=0x7f4010001a30 comp rx=0 tx=0).stop 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- 172.21.15.138:0/318606875 shutdown_connections 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 --2- 172.21.15.138:0/318606875 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3d8600 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- 172.21.15.138:0/318606875 >> 172.21.15.138:0/318606875 conn(0x55f67d2e8db0 msgr2=0x55f67d3d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- 172.21.15.138:0/318606875 shutdown_connections 2024-02-16T10:31:54.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- 172.21.15.138:0/318606875 wait complete. 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f4022b86980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67d1fa7a0 con 0x55f67d262790 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55386/0 (socket says 172.21.15.138:55386) 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 -- 172.21.15.138:0/3993145271 learned_addr learned my addr 172.21.15.138:0/3993145271 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008001e20 con 0x55f67d262790 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.575+0000 7f40206a1640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4010001a70 tx=0x7f4010000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 -- 172.21.15.138:0/3993145271 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4010013760 con 0x55f67d262790 2024-02-16T10:31:54.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 -- 172.21.15.138:0/3993145271 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40100138c0 con 0x55f67d262790 2024-02-16T10:31:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f67d3dfaf0 con 0x55f67d262790 2024-02-16T10:31:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 -- 172.21.15.138:0/3993145271 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4010013b60 con 0x55f67d262790 2024-02-16T10:31:54.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f67d3dffa0 con 0x55f67d262790 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 -- 172.21.15.138:0/3993145271 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4010028460 con 0x55f67d262790 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 0x7f3f08036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f3f0ce09640 1 -- 172.21.15.138:0/3993145271 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4010049690 con 0x55f67d262790 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f401fea0640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 0x7f3f08036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 0x55f67d3e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d3e6790 con 0x55f67d2f29b0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 0x55f67d3e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f401fea0640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 0x7f3f08036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40140ad000 tx=0x7f40140a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 0x55f67d3e6250 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 -- 172.21.15.138:0/3993145271 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40180083f0 con 0x55f67d2f29b0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d3e6b80 con 0x55f67d2f29b0 2024-02-16T10:31:54.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 -- 172.21.15.138:0/3993145271 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40180083f0 con 0x55f67d2f29b0 2024-02-16T10:31:54.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d3e8430 con 0x55f67d2f29b0 2024-02-16T10:31:54.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 -- 172.21.15.138:0/3993145271 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f40180083f0 con 0x55f67d2f29b0 2024-02-16T10:31:54.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d3e7570 con 0x55f67d2f29b0 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4020ea2640 1 -- 172.21.15.138:0/3993145271 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40180083f0 con 0x55f67d2f29b0 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 0x55f67d3eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.579+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d3ebdc0 con 0x55f67d3e7e90 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f40206a1640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 0x55f67d3eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f40206a1640 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 0x55f67d3eb7b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f40206a1640 1 -- 172.21.15.138:0/3993145271 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4010024020 con 0x55f67d3e7e90 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67d192f20 con 0x55f67d2eedf0 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55400/0 (socket says 172.21.15.138:55400) 2024-02-16T10:31:54.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4020ea2640 1 -- 172.21.15.138:0/92571553 learned_addr learned my addr 172.21.15.138:0/92571553 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4020ea2640 1 -- 172.21.15.138:0/92571553 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f67d2ed7d0 con 0x55f67d2eedf0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4020ea2640 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55f67d3e0640 tx=0x7f401800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f3f05ffb640 1 -- 172.21.15.138:0/92571553 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f401800f040 con 0x55f67d2eedf0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f3f05ffb640 1 -- 172.21.15.138:0/92571553 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018019550 con 0x55f67d2eedf0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f67d2eda20 con 0x55f67d2eedf0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f3f05ffb640 1 -- 172.21.15.138:0/92571553 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4018019810 con 0x55f67d2eedf0 2024-02-16T10:31:54.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.583+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f67d2edeb0 con 0x55f67d2eedf0 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3f05ffb640 1 -- 172.21.15.138:0/92571553 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4018019970 con 0x55f67d2eedf0 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3f05ffb640 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 0x7f3ef80367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3f05ffb640 1 -- 172.21.15.138:0/92571553 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f401804b700 con 0x55f67d2eedf0 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f40206a1640 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 0x7f3ef80367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f40206a1640 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 0x7f3ef80367c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55f67d3e6fb0 tx=0x7f401001d5a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67d186790 con 0x55f67d408fd0 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55408/0 (socket says 172.21.15.138:55408) 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 -- 172.21.15.138:0/1185808443 learned_addr learned my addr 172.21.15.138:0/1185808443 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 -- 172.21.15.138:0/1185808443 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f67d4099c0 con 0x55f67d408fd0 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 --2- 172.21.15.138:0/1185808443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f401800efb0 tx=0x7f401802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85fc7b1aee3900 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3eff7fe640 1 -- 172.21.15.138:0/1185808443 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40180153a0 con 0x55f67d408fd0 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3eff7fe640 1 -- 172.21.15.138:0/1185808443 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018015500 con 0x55f67d408fd0 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f3eff7fe640 1 -- 172.21.15.138:0/1185808443 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4018015df0 con 0x55f67d408fd0 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- 172.21.15.138:0/1185808443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 msgr2=0x55f67d4093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 --2- 172.21.15.138:0/1185808443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f401800efb0 tx=0x7f401802af40 comp rx=0 tx=0).stop 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- 172.21.15.138:0/1185808443 shutdown_connections 2024-02-16T10:31:54.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 --2- 172.21.15.138:0/1185808443 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d4093f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- 172.21.15.138:0/1185808443 >> 172.21.15.138:0/1185808443 conn(0x55f67d403b50 msgr2=0x55f67d404a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- 172.21.15.138:0/1185808443 shutdown_connections 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- 172.21.15.138:0/1185808443 wait complete. 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 Processor -- start 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- start start 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4022b86980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f67d410270 con 0x55f67d408fd0 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.587+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4020ea2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55420/0 (socket says 172.21.15.138:55420) 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 learned_addr learned my addr 172.21.15.138:0/1839489582 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f67d2edeb0 con 0x55f67d408fd0 2024-02-16T10:31:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4020ea2640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f401800efb0 tx=0x7f4018049950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 -- 172.21.15.138:0/1839489582 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4018031070 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 -- 172.21.15.138:0/1839489582 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401802a710 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f67d410470 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 -- 172.21.15.138:0/1839489582 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4018017ee0 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f67d410900 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 -- 172.21.15.138:0/1839489582 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4018034020 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef0034300 0x7f3ef00367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f3efdffb640 1 -- 172.21.15.138:0/1839489582 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4018038d30 con 0x55f67d408fd0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f40206a1640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef0034300 0x7f3ef00367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d41b470 0x55f67d41d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d41e080 con 0x55f67d41b470 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f401fea0640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d41b470 0x55f67d41d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f40206a1640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef0034300 0x7f3ef00367c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4010006570 tx=0x7f4010045000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f401fea0640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d41b470 0x55f67d41d930 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 20 realm 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.591+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d41e470 con 0x55f67d41b470 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:54.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d41ecf0 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d41f050 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d41f850 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 20 searching for the correct realm 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f67d421700 0x55f67d423bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4020ea2640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f67d421700 0x55f67d423bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4020ea2640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f67d421700 0x55f67d423bc0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4020ea2640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4018022070 0x7f4018022850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f40206a1640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4018022070 0x7f4018022850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f40206a1640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4018022070 0x7f4018022850 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f40206a1640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f4010055040 0x7f4010028710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f4010055040 0x7f4010028710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.595+0000 7f401fea0640 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f4010055040 0x7f4010028710 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.599+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.603+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4018022070 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d421700 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x7f4010055040 2024-02-16T10:31:54.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d424290 con 0x55f67d41b470 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.607+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f40140db080 con 0x7f4018022070 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d420180 con 0x55f67d41b470 2024-02-16T10:31:54.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4209d0 con 0x55f67d41b470 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4209d0 con 0x7f4018022070 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 zone default found 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 4 Realm: () 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:54.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 zonegroup default 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4246d0 con 0x7f4010055040 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d426460 con 0x55f67d421700 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d426810 con 0x55f67d421700 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 started sync module instance, tier type = 2024-02-16T10:31:54.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:54.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.611+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4258f0 con 0x7f4018022070 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94517151814736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4260f0 con 0x7f4018022070 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4272c0 con 0x55f67d41b470 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94517151814736] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94517151821216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d427670 con 0x55f67d41b470 2024-02-16T10:31:54.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.615+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d427fe0 con 0x55f67d421700 2024-02-16T10:31:54.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94517151821216] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94517151816784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d427fe0 con 0x55f67d421700 2024-02-16T10:31:54.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4289e0 con 0x7f4018022070 2024-02-16T10:31:54.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94517151827200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d429230 con 0x7f4018022070 2024-02-16T10:31:54.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d429c30 con 0x55f67d41b470 2024-02-16T10:31:54.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94517151816784] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.619+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94517151827200] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94517151829392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d427b40 con 0x55f67d41b470 2024-02-16T10:31:54.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42a480 con 0x7f4010055040 2024-02-16T10:31:54.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94517151829392] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94517151831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42a3e0 con 0x7f4010055040 2024-02-16T10:31:54.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.623+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42ad50 con 0x7f4010055040 2024-02-16T10:31:54.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94517151831856] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94517151833920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42ad50 con 0x7f4010055040 2024-02-16T10:31:54.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42b6c0 con 0x7f4010055040 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94517151838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42bae0 con 0x7f4010055040 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=0 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=1 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=2 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=3 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=4 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=5 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94517151833920] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.627+0000 7f4022b86980 20 add_watcher() i=6 2024-02-16T10:31:54.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94517151838752] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 add_watcher() i=7 2024-02-16T10:31:54.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:54.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42bae0 con 0x55f67d41b470 2024-02-16T10:31:54.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94517151839808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42ba60 con 0x55f67d41b470 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94517151839808] v33'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f3ed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 5 note: GC not initialized 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f3ed57e2640 20 reqs_thread_entry: start 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 Filter name: none 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f3e46ffd640 20 reqs_thread_entry: start 2024-02-16T10:31:54.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:31:54.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.631+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d450a60 con 0x7f4010055040 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d450a60 con 0x7f4010055040 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-02-16T10:31:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:31:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:31:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-02-16T10:31:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~347 in=347b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d44f3e0 con 0x7f4010055040 2024-02-16T10:31:54.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~347] v33'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94517151990976 in=535b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d44fda0 con 0x7f4010055040 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== watch-notify(notify (1) cookie 94517151831856 notify 141733920799 ret 0) v3 ==== 565+0+0 (crc 0 0 0) 0x55f67d2f63b0 con 0x7f4010055040 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(65 notify.5 [notify cookie 94517151990976 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f3eff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94517151831856 notifier 4738 bl.length()=523 2024-02-16T10:31:54.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f3eff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-02-16T10:31:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f3eff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:31:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.635+0000 7f3eff7fe640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3ee4003ea0 con 0x7f4010055040 2024-02-16T10:31:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== watch-notify(notify_complete (2) cookie 94517151990976 notify 141733920799 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f40140c2860 con 0x7f4010055040 2024-02-16T10:31:54.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d4504c0 con 0x7f4010055040 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'10 uv10 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4022b86980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4022b86980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4022b86980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94517151990976 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d44fde0 con 0x55f67d421700 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== watch-notify(notify (1) cookie 94517151816784 notify 141733920774 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55f67d410900 con 0x55f67d421700 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f3eff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94517151816784 notifier 4738 bl.length()=177 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f3eff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-02-16T10:31:54.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f3eff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-02-16T10:31:54.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(68 notify.2 [notify cookie 94517151990976 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.639+0000 7f3eff7fe640 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3ee4003ea0 con 0x55f67d421700 2024-02-16T10:31:54.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== watch-notify(notify_complete (2) cookie 94517151990976 notify 141733920774 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f67d410470 con 0x55f67d421700 2024-02-16T10:31:54.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.646 INFO:teuthology.orchestra.run.smithi138.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-02-16T10:31:54.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f3ed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:54.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94517151839808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d44f780 con 0x55f67d41b470 2024-02-16T10:31:54.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94517151839808] v33'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94517151814736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d42b640 con 0x7f4018022070 2024-02-16T10:31:54.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94517151814736] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4022b86980 20 remove_watcher() i=0 2024-02-16T10:31:54.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4022b86980 2 removed watcher, disabling cache 2024-02-16T10:31:54.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.643+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94517151821216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425450 con 0x55f67d41b470 2024-02-16T10:31:54.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94517151821216] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f4022b86980 20 remove_watcher() i=1 2024-02-16T10:31:54.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94517151816784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425450 con 0x55f67d421700 2024-02-16T10:31:54.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f4020ea2640 1 -- 172.21.15.138:0/1839489582 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94517151816784] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4018012070 con 0x55f67d421700 2024-02-16T10:31:54.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f4022b86980 20 remove_watcher() i=2 2024-02-16T10:31:54.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.647+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94517151827200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425c50 con 0x7f4018022070 2024-02-16T10:31:54.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f40206a1640 1 -- 172.21.15.138:0/1839489582 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94517151827200] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4010024020 con 0x7f4018022070 2024-02-16T10:31:54.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f4022b86980 20 remove_watcher() i=3 2024-02-16T10:31:54.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94517151829392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425450 con 0x55f67d41b470 2024-02-16T10:31:54.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94517151829392] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x55f67d41b470 2024-02-16T10:31:54.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f4022b86980 20 remove_watcher() i=4 2024-02-16T10:31:54.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.651+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94517151831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425c50 con 0x7f4010055040 2024-02-16T10:31:54.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94517151831856] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f4022b86980 20 remove_watcher() i=5 2024-02-16T10:31:54.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94517151833920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425450 con 0x7f4010055040 2024-02-16T10:31:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94517151833920] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f4022b86980 20 remove_watcher() i=6 2024-02-16T10:31:54.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.655+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94517151838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f67d425c50 con 0x7f4010055040 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94517151838752] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40140be040 con 0x7f4010055040 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 20 remove_watcher() i=7 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f4010055040 msgr2=0x7f4010028710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f4010055040 0x7f4010028710 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d41b470 msgr2=0x55f67d41d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d41b470 0x55f67d41d930 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4018022070 msgr2=0x7f4018022850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f4018022070 0x7f4018022850 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f67d421700 msgr2=0x55f67d423bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f67d421700 0x55f67d423bc0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef0034300 msgr2=0x7f3ef00367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef0034300 0x7f3ef00367c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4010006570 tx=0x7f4010045000 comp rx=0 tx=0).stop 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 msgr2=0x55f67d40fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f401fea0640 1 -- 172.21.15.138:0/1839489582 reap_dead start 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f401800efb0 tx=0x7f4018049950 comp rx=0 tx=0).stop 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 shutdown_connections 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/1839489582 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d408fd0 0x55f67d40fd30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 >> 172.21.15.138:0/1839489582 conn(0x55f67d403b50 msgr2=0x55f67d404a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 shutdown_connections 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/1839489582 wait complete. 2024-02-16T10:31:54.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 msgr2=0x7f3ef80367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 0x7f3ef80367c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55f67d3e6fb0 tx=0x7f401001d5a0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 msgr2=0x55f67d2ed290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55f67d3e0640 tx=0x7f401800e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 shutdown_connections 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3ef8034300 0x7f3ef80367c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/92571553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d2eedf0 0x55f67d2ed290 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 >> 172.21.15.138:0/92571553 conn(0x55f67d3eeb00 msgr2=0x55f67d3ef610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 shutdown_connections 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/92571553 wait complete. 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 msgr2=0x55f67d3e6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 0x55f67d3e6250 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 msgr2=0x55f67d3eb7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 0x55f67d3eb7b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 msgr2=0x7f3f08036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 0x7f3f08036770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f40140ad000 tx=0x7f40140a5040 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 msgr2=0x55f67d3df5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.659+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4010001a70 tx=0x7f4010000f50 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 shutdown_connections 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f67d3e7e90 0x55f67d3eb7b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f67d2f29b0 0x55f67d3e6250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3f080342b0 0x7f3f08036770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 --2- 172.21.15.138:0/3993145271 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f67d262790 0x55f67d3df5b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 >> 172.21.15.138:0/3993145271 conn(0x55f67d2e8db0 msgr2=0x55f67d3d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 shutdown_connections 2024-02-16T10:31:54.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.663+0000 7f4022b86980 1 -- 172.21.15.138:0/3993145271 wait complete. 2024-02-16T10:31:54.676 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-02-16T10:31:54.694 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:54.702 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-02-16T10:31:54.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T10:31:54.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-02-16T10:31:54.702 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-02-16T10:31:54.735 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:54.735 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:54.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21eefde980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ec677b8d40 0x55ec6784c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21eefde980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ec6778fb60 con 0x55ec677ba030 2024-02-16T10:31:54.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21eefde980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ec67756d30 con 0x55ec677b8d40 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ec2f8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ec677b8d40 0x55ec6784c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ecaf9640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55ec677ba030 0x55ec677b8630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:42686/0 (socket says 172.21.15.138:42686) 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ec2f8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55ec677b8d40 0x55ec6784c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55426/0 (socket says 172.21.15.138:55426) 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2131575453 learned_addr learned my addr 172.21.15.138:0/2131575453 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2131575453 >> v1:172.21.15.107:6789/0 conn(0x55ec677ba030 legacy=0x55ec677b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.731+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2131575453 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec677b9150 con 0x55ec677b8d40 2024-02-16T10:31:54.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2131575453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6784c640 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a480 tx=0x7f21e001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c6ad8f8a3ef405 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21ebaf7640 1 -- 172.21.15.138:0/2131575453 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e00aa530 con 0x55ec677b8d40 2024-02-16T10:31:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21ebaf7640 1 -- 172.21.15.138:0/2131575453 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e00a6050 con 0x55ec677b8d40 2024-02-16T10:31:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21ebaf7640 1 -- 172.21.15.138:0/2131575453 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e00aa7e0 con 0x55ec677b8d40 2024-02-16T10:31:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 -- 172.21.15.138:0/2131575453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 msgr2=0x55ec6784c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 --2- 172.21.15.138:0/2131575453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6784c640 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a480 tx=0x7f21e001b280 comp rx=0 tx=0).stop 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 -- 172.21.15.138:0/2131575453 shutdown_connections 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 --2- 172.21.15.138:0/2131575453 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6784c640 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 -- 172.21.15.138:0/2131575453 >> 172.21.15.138:0/2131575453 conn(0x55ec6783ef00 msgr2=0x55ec67841320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 -- 172.21.15.138:0/2131575453 shutdown_connections 2024-02-16T10:31:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.735+0000 7f21eefde980 1 -- 172.21.15.138:0/2131575453 wait complete. 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21eefde980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21eefde980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec67753fc0 con 0x55ec677b8d40 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21ecaf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21ecaf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55436/0 (socket says 172.21.15.138:55436) 2024-02-16T10:31:54.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21ecaf9640 1 -- 172.21.15.138:0/3512059964 learned_addr learned my addr 172.21.15.138:0/3512059964 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21ecaf9640 1 -- 172.21.15.138:0/3512059964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0005d30 con 0x55ec677b8d40 2024-02-16T10:31:54.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/3512059964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21dc006fb0 tx=0x7f21dc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace03ab6b6df1ac5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f20dae0d640 1 -- 172.21.15.138:0/3512059964 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21dc004530 con 0x55ec677b8d40 2024-02-16T10:31:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f20dae0d640 1 -- 172.21.15.138:0/3512059964 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc004690 con 0x55ec677b8d40 2024-02-16T10:31:54.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.751+0000 7f20dae0d640 1 -- 172.21.15.138:0/3512059964 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21dc0049b0 con 0x55ec677b8d40 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/3512059964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 msgr2=0x55ec6792fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 --2- 172.21.15.138:0/3512059964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21dc006fb0 tx=0x7f21dc001940 comp rx=0 tx=0).stop 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/3512059964 shutdown_connections 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 --2- 172.21.15.138:0/3512059964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec6792fb50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/3512059964 >> 172.21.15.138:0/3512059964 conn(0x55ec6783ef00 msgr2=0x55ec6792b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/3512059964 shutdown_connections 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/3512059964 wait complete. 2024-02-16T10:31:54.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6774f7a0 con 0x55ec677b8d40 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21ecaf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21ecaf9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55446/0 (socket says 172.21.15.138:55446) 2024-02-16T10:31:54.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2957642346 learned_addr learned my addr 172.21.15.138:0/2957642346 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec6778fb60 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55ec679309e0 tx=0x7f21dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f20d960a640 1 -- 172.21.15.138:0/2957642346 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21dc013760 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f20d960a640 1 -- 172.21.15.138:0/2957642346 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc0138c0 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ec67937040 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f20d960a640 1 -- 172.21.15.138:0/2957642346 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21dc013b60 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec679374f0 con 0x55ec677b8d40 2024-02-16T10:31:54.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.755+0000 7f20d960a640 1 -- 172.21.15.138:0/2957642346 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f21dc028460 con 0x55ec677b8d40 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f20d960a640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 0x7f20d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f20d960a640 1 -- 172.21.15.138:0/2957642346 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f21dc049620 con 0x55ec677b8d40 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 0x7f20d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 0x55ec6793d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6793dd30 con 0x55ec677ba030 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 0x55ec6793d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 0x7f20d4036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21e00ac000 tx=0x7f21e00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 0x55ec6793d7f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2957642346 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21e40083f0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6793e140 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2957642346 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21e40083f0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6793f9f0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2957642346 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f21e40083f0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6793ebf0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2957642346 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21e40083f0 con 0x55ec677ba030 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 0x55ec67942d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec679433c0 con 0x55ec6793f510 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 0x55ec67942d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 0x55ec67942d70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2957642346 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f21dc024020 con 0x55ec6793f510 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.759+0000 7f21eefde980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec676e7f20 con 0x55ec67951300 2024-02-16T10:31:54.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55458/0 (socket says 172.21.15.138:55458) 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ed2fa640 1 -- 172.21.15.138:0/1117095185 learned_addr learned my addr 172.21.15.138:0/1117095185 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ed2fa640 1 -- 172.21.15.138:0/1117095185 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec67951c60 con 0x55ec67951300 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55ec67937f30 tx=0x7f21e400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 -- 172.21.15.138:0/1117095185 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e400f040 con 0x55ec67951300 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ec67951eb0 con 0x55ec67951300 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 -- 172.21.15.138:0/1117095185 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4019550 con 0x55ec67951300 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 -- 172.21.15.138:0/1117095185 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e40197f0 con 0x55ec67951300 2024-02-16T10:31:54.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec67952a00 con 0x55ec67951300 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 -- 172.21.15.138:0/1117095185 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f21e40199a0 con 0x55ec67951300 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 0x7f20c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f20d27fc640 1 -- 172.21.15.138:0/1117095185 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f21e404b530 con 0x55ec67951300 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 0x7f20c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 0x7f20c4036770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21dc001980 tx=0x7f21dc01d970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.763+0000 7f21eefde980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec676db790 con 0x55ec6795e300 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55460/0 (socket says 172.21.15.138:55460) 2024-02-16T10:31:54.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 -- 172.21.15.138:0/4021778831 learned_addr learned my addr 172.21.15.138:0/4021778831 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 -- 172.21.15.138:0/4021778831 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec6795ecf0 con 0x55ec6795e300 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/4021778831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f21e400efb0 tx=0x7f21e404b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55612d976898691 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c3fff640 1 -- 172.21.15.138:0/4021778831 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e4048070 con 0x55ec6795e300 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c3fff640 1 -- 172.21.15.138:0/4021778831 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e40154d0 con 0x55ec6795e300 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c3fff640 1 -- 172.21.15.138:0/4021778831 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e4015df0 con 0x55ec6795e300 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/4021778831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 msgr2=0x55ec6795e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 --2- 172.21.15.138:0/4021778831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f21e400efb0 tx=0x7f21e404b420 comp rx=0 tx=0).stop 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/4021778831 shutdown_connections 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 --2- 172.21.15.138:0/4021778831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec6795e720 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/4021778831 >> 172.21.15.138:0/4021778831 conn(0x55ec67958e80 msgr2=0x55ec67959d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/4021778831 shutdown_connections 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/4021778831 wait complete. 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 Processor -- start 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- start start 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec67965520 con 0x55ec6795e300 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55468/0 (socket says 172.21.15.138:55468) 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 learned_addr learned my addr 172.21.15.138:0/2899267227 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec67952a00 con 0x55ec6795e300 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f21e40056e0 tx=0x7f21e4049800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c27fc640 1 -- 172.21.15.138:0/2899267227 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e4015b20 con 0x55ec6795e300 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ec67965720 con 0x55ec6795e300 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c27fc640 1 -- 172.21.15.138:0/2899267227 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4048070 con 0x55ec6795e300 2024-02-16T10:31:54.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f20c27fc640 1 -- 172.21.15.138:0/2899267227 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21e4048200 con 0x55ec6795e300 2024-02-16T10:31:54.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.767+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec67965bb0 con 0x55ec6795e300 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f20c27fc640 1 -- 172.21.15.138:0/2899267227 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f21e4032020 con 0x55ec6795e300 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f20c27fc640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20b80342b0 0x7f20b8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f20c27fc640 1 -- 172.21.15.138:0/2899267227 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f21e4037d40 con 0x55ec6795e300 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20b80342b0 0x7f20b8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec67970720 0x55ec67972be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67973330 con 0x55ec67970720 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec67970720 0x55ec67972be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20b80342b0 0x7f20b8036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21dc013fd0 tx=0x7f21dc035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec67970720 0x55ec67972be0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 realm 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67973720 con 0x55ec67970720 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67973fa0 con 0x55ec67970720 2024-02-16T10:31:54.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67974300 con 0x55ec67970720 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67974b00 con 0x55ec67970720 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 20 searching for the correct realm 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ec679769b0 0x55ec67978e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ec679769b0 0x55ec67978e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.771+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ec679769b0 0x55ec67978e70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ed2fa640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f21e4022070 0x7f21e40385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f21e4022070 0x7f21e40385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f21e4022070 0x7f21e40385f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21dc024020 con 0x7f21e4022070 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ecaf9640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f21dc0499c0 0x7f21dc0460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f21dc0499c0 0x7f21dc0460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f21dc0499c0 0x7f21dc0460d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.775+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.779+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.783+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21e4022070 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec679769b0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x7f21dc0499c0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979540 con 0x55ec67970720 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f21e00d9080 con 0x7f21e4022070 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:54.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67975430 con 0x55ec67970720 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67975c80 con 0x55ec67970720 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67975c80 con 0x7f21e4022070 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 zone default found 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 4 Realm: () 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 zonegroup default 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67979980 con 0x7f21dc0499c0 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.787+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797b710 con 0x55ec679769b0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797baf0 con 0x55ec679769b0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 20 started sync module instance, tier type = 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:54.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797aba0 con 0x7f21e4022070 2024-02-16T10:31:54.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94473838634752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797b3a0 con 0x7f21e4022070 2024-02-16T10:31:54.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797c560 con 0x55ec67970720 2024-02-16T10:31:54.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.791+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94473838634752] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94473838636800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797c910 con 0x55ec67970720 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797d280 con 0x55ec679769b0 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94473838636800] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94473838641280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797d280 con 0x55ec679769b0 2024-02-16T10:31:54.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797dc80 con 0x7f21e4022070 2024-02-16T10:31:54.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94473838647200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797e500 con 0x7f21e4022070 2024-02-16T10:31:54.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.795+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797ef00 con 0x55ec67970720 2024-02-16T10:31:54.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.799+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94473838641280] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.799+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94473838647200] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.799+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.799+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94473838649440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797cde0 con 0x55ec67970720 2024-02-16T10:31:54.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.799+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797f750 con 0x7f21dc0499c0 2024-02-16T10:31:54.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94473838649440] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94473838651904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797f700 con 0x7f21dc0499c0 2024-02-16T10:31:54.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980110 con 0x7f21dc0499c0 2024-02-16T10:31:54.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94473838651904] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94473838654048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980110 con 0x7f21dc0499c0 2024-02-16T10:31:54.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.803+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980950 con 0x7f21dc0499c0 2024-02-16T10:31:54.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94473838654048] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94473838656624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980b30 con 0x7f21dc0499c0 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=0 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=1 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=2 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=3 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=4 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=5 2024-02-16T10:31:54.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.807+0000 7f21eefde980 20 add_watcher() i=6 2024-02-16T10:31:54.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94473838656624] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 add_watcher() i=7 2024-02-16T10:31:54.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:54.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67983ef0 con 0x55ec67970720 2024-02-16T10:31:54.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94473838660128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec679812e0 con 0x55ec67970720 2024-02-16T10:31:54.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94473838660128] v33'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f20a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 5 note: GC not initialized 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f20a1fe3640 20 reqs_thread_entry: start 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 Filter name: none 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f20137fe640 20 reqs_thread_entry: start 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec679a5bc0 con 0x7f21e4022070 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(62 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:54.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.811+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec679a99b0 con 0x7f21dc0499c0 2024-02-16T10:31:54.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.815+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v33'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.820 INFO:teuthology.orchestra.run.smithi138.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-02-16T10:31:54.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.815+0000 7f20a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:54.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.815+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94473838660128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6796def0 con 0x55ec67970720 2024-02-16T10:31:54.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94473838660128] v33'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94473838634752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980a20 con 0x7f21e4022070 2024-02-16T10:31:54.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94473838634752] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21eefde980 20 remove_watcher() i=0 2024-02-16T10:31:54.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21eefde980 2 removed watcher, disabling cache 2024-02-16T10:31:54.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.819+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94473838636800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980a20 con 0x55ec67970720 2024-02-16T10:31:54.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94473838636800] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 20 remove_watcher() i=1 2024-02-16T10:31:54.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94473838641280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797af00 con 0x55ec679769b0 2024-02-16T10:31:54.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21ed2fa640 1 -- 172.21.15.138:0/2899267227 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94473838641280] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e4012070 con 0x55ec679769b0 2024-02-16T10:31:54.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 20 remove_watcher() i=2 2024-02-16T10:31:54.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94473838647200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980a20 con 0x7f21e4022070 2024-02-16T10:31:54.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21ecaf9640 1 -- 172.21.15.138:0/2899267227 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94473838647200] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21dc05e040 con 0x7f21e4022070 2024-02-16T10:31:54.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 20 remove_watcher() i=3 2024-02-16T10:31:54.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.823+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94473838649440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797c080 con 0x55ec67970720 2024-02-16T10:31:54.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.827+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94473838649440] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x55ec67970720 2024-02-16T10:31:54.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.827+0000 7f21eefde980 20 remove_watcher() i=4 2024-02-16T10:31:54.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.827+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94473838651904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797af00 con 0x7f21dc0499c0 2024-02-16T10:31:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94473838651904] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21eefde980 20 remove_watcher() i=5 2024-02-16T10:31:54.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94473838654048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec67980a20 con 0x7f21dc0499c0 2024-02-16T10:31:54.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94473838654048] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21eefde980 20 remove_watcher() i=6 2024-02-16T10:31:54.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.831+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94473838656624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55ec6797c080 con 0x7f21dc0499c0 2024-02-16T10:31:54.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94473838656624] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f21e00b4670 con 0x7f21dc0499c0 2024-02-16T10:31:54.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 20 remove_watcher() i=7 2024-02-16T10:31:54.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f21dc0499c0 msgr2=0x7f21dc0460d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f21dc0499c0 0x7f21dc0460d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec67970720 msgr2=0x55ec67972be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec67970720 0x55ec67972be0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f21e4022070 msgr2=0x7f21e40385f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f21e4022070 0x7f21e40385f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ec679769b0 msgr2=0x55ec67978e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55ec679769b0 0x55ec67978e70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20b80342b0 msgr2=0x7f20b8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20b80342b0 0x7f20b8036770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21dc013fd0 tx=0x7f21dc035000 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 msgr2=0x55ec67964fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21ec2f8640 1 -- 172.21.15.138:0/2899267227 reap_dead start 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f21e40056e0 tx=0x7f21e4049800 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 shutdown_connections 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2899267227 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec6795e300 0x55ec67964fe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 >> 172.21.15.138:0/2899267227 conn(0x55ec67958e80 msgr2=0x55ec67959d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 shutdown_connections 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2899267227 wait complete. 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 msgr2=0x7f20c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 0x7f20c4036770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f21dc001980 tx=0x7f21dc01d970 comp rx=0 tx=0).stop 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 msgr2=0x55ec67951720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55ec67937f30 tx=0x7f21e400e8d0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 shutdown_connections 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20c40342b0 0x7f20c4036770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/1117095185 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec67951300 0x55ec67951720 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 >> 172.21.15.138:0/1117095185 conn(0x55ec67946110 msgr2=0x55ec67946c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 shutdown_connections 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/1117095185 wait complete. 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 msgr2=0x55ec6793d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 0x55ec6793d7f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 msgr2=0x55ec67942d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 0x55ec67942d70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 msgr2=0x7f20d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 0x7f20d4036770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21e00ac000 tx=0x7f21e00a5000 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 msgr2=0x55ec67936b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55ec679309e0 tx=0x7f21dc000f50 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 shutdown_connections 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55ec6793f510 0x55ec67942d70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55ec677ba030 0x55ec6793d7f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f20d40342b0 0x7f20d4036770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 --2- 172.21.15.138:0/2957642346 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55ec677b8d40 0x55ec67936b00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 >> 172.21.15.138:0/2957642346 conn(0x55ec6783ef00 msgr2=0x55ec6792a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 shutdown_connections 2024-02-16T10:31:54.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.835+0000 7f21eefde980 1 -- 172.21.15.138:0/2957642346 wait complete. 2024-02-16T10:31:54.851 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-02-16T10:31:54.900 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:54.900 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:31:54.911 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-02-16T10:31:54.912 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-02-16T10:31:54.912 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T10:31:54.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-02-16T10:31:54.915 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-02-16T10:31:54.954 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:54.954 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35af219980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561a3b5b7f60 0x561a3b6486e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35af219980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561a3b58fb60 con 0x561a3b648c20 2024-02-16T10:31:54.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35af219980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x561a3b556d30 con 0x561a3b5b7f60 2024-02-16T10:31:54.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35acd34640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561a3b5b7f60 0x561a3b6486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35acd34640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x561a3b5b7f60 0x561a3b6486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55472/0 (socket says 172.21.15.138:55472) 2024-02-16T10:31:54.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35acd34640 1 -- 172.21.15.138:0/319248634 learned_addr learned my addr 172.21.15.138:0/319248634 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35acd34640 1 -- 172.21.15.138:0/319248634 >> v1:172.21.15.107:6789/0 conn(0x561a3b648c20 legacy=0x561a3b64b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.951+0000 7f35acd34640 1 -- 172.21.15.138:0/319248634 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3b644100 con 0x561a3b5b7f60 2024-02-16T10:31:54.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35acd34640 1 --2- 172.21.15.138:0/319248634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b6486e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f359c00a5c0 tx=0x7f359c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ece1399db9be6f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35abd32640 1 -- 172.21.15.138:0/319248634 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0aa470 con 0x561a3b5b7f60 2024-02-16T10:31:54.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35abd32640 1 -- 172.21.15.138:0/319248634 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0aa5d0 con 0x561a3b5b7f60 2024-02-16T10:31:54.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35abd32640 1 -- 172.21.15.138:0/319248634 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0aa890 con 0x561a3b5b7f60 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 -- 172.21.15.138:0/319248634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 msgr2=0x561a3b6486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 --2- 172.21.15.138:0/319248634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b6486e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f359c00a5c0 tx=0x7f359c01b340 comp rx=0 tx=0).stop 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 -- 172.21.15.138:0/319248634 shutdown_connections 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 --2- 172.21.15.138:0/319248634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b6486e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 -- 172.21.15.138:0/319248634 >> 172.21.15.138:0/319248634 conn(0x561a3b63ddc0 msgr2=0x561a3b6401e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 -- 172.21.15.138:0/319248634 shutdown_connections 2024-02-16T10:31:54.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.955+0000 7f35af219980 1 -- 172.21.15.138:0/319248634 wait complete. 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35af219980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35af219980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3b553fc0 con 0x561a3b5b7f60 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35acd34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35acd34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55486/0 (socket says 172.21.15.138:55486) 2024-02-16T10:31:54.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35acd34640 1 -- 172.21.15.138:0/281374156 learned_addr learned my addr 172.21.15.138:0/281374156 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35acd34640 1 -- 172.21.15.138:0/281374156 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c005df0 con 0x561a3b5b7f60 2024-02-16T10:31:54.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f35acd34640 1 --2- 172.21.15.138:0/281374156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f359c01b380 tx=0x7f359c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02a0769cdf3d279 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f349ae0d640 1 -- 172.21.15.138:0/281374156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0aa930 con 0x561a3b5b7f60 2024-02-16T10:31:54.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f349ae0d640 1 -- 172.21.15.138:0/281374156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0aaab0 con 0x561a3b5b7f60 2024-02-16T10:31:54.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.971+0000 7f349ae0d640 1 -- 172.21.15.138:0/281374156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0aad90 con 0x561a3b5b7f60 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/281374156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 msgr2=0x561a3b72f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 --2- 172.21.15.138:0/281374156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f359c01b380 tx=0x7f359c003030 comp rx=0 tx=0).stop 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/281374156 shutdown_connections 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 --2- 172.21.15.138:0/281374156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b72f900 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/281374156 >> 172.21.15.138:0/281374156 conn(0x561a3b63ddc0 msgr2=0x561a3b72b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/281374156 shutdown_connections 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/281374156 wait complete. 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3b54f7a0 con 0x561a3b5b7f60 2024-02-16T10:31:54.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35acd34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35acd34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55494/0 (socket says 172.21.15.138:55494) 2024-02-16T10:31:54.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35acd34640 1 -- 172.21.15.138:0/2771381128 learned_addr learned my addr 172.21.15.138:0/2771381128 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35acd34640 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3b644100 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35acd34640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f359c0aa5a0 tx=0x7f359c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f349960a640 1 -- 172.21.15.138:0/2771381128 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0aa910 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a3b736b90 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f349960a640 1 -- 172.21.15.138:0/2771381128 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0bd8d0 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f349960a640 1 -- 172.21.15.138:0/2771381128 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f359c0bdb90 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a3b737040 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.975+0000 7f349960a640 1 -- 172.21.15.138:0/2771381128 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f359c0c6480 con 0x561a3b5b7f60 2024-02-16T10:31:54.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f349960a640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 0x7f3494036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f349960a640 1 -- 172.21.15.138:0/2771381128 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f359c0e4d60 con 0x561a3b5b7f60 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ac533640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 0x7f3494036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 0x561a3b73d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b73d880 con 0x561a3b648c20 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 0x561a3b73d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ac533640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 0x7f3494036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35a0000f70 tx=0x7f35a0001420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 0x561a3b73d340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 -- 172.21.15.138:0/2771381128 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b73dc20 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 -- 172.21.15.138:0/2771381128 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b73f4a0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 -- 172.21.15.138:0/2771381128 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b73e6a0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35ad535640 1 -- 172.21.15.138:0/2771381128 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b648c20 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 0x561a3b742820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b742e80 con 0x561a3b73efc0 2024-02-16T10:31:54.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35acd34640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 0x561a3b742820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35acd34640 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 0x561a3b742820 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35acd34640 1 -- 172.21.15.138:0/2771381128 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f359c0cd020 con 0x561a3b73efc0 2024-02-16T10:31:54.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.979+0000 7f35af219980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3b4e7f20 con 0x561a3b750e50 2024-02-16T10:31:54.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55498/0 (socket says 172.21.15.138:55498) 2024-02-16T10:31:54.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35ad535640 1 -- 172.21.15.138:0/1814968158 learned_addr learned my addr 172.21.15.138:0/1814968158 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35ad535640 1 -- 172.21.15.138:0/1814968158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3b7517b0 con 0x561a3b750e50 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35ad535640 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x561a3b737a80 tx=0x7f35a4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 -- 172.21.15.138:0/1814968158 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a401d070 con 0x561a3b750e50 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 -- 172.21.15.138:0/1814968158 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4014450 con 0x561a3b750e50 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a3b751a00 con 0x561a3b750e50 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 -- 172.21.15.138:0/1814968158 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a40146f0 con 0x561a3b750e50 2024-02-16T10:31:54.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a3b752550 con 0x561a3b750e50 2024-02-16T10:31:54.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 -- 172.21.15.138:0/1814968158 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35a4020020 con 0x561a3b750e50 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 0x7f3484036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f34927fc640 1 -- 172.21.15.138:0/1814968158 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f35a404b180 con 0x561a3b750e50 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35acd34640 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 0x7f3484036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35acd34640 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 0x7f3484036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561a3b73e0e0 tx=0x7f359c0bc600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.983+0000 7f35af219980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3b4db790 con 0x561a3b75dda0 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55510/0 (socket says 172.21.15.138:55510) 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 -- 172.21.15.138:0/2718035786 learned_addr learned my addr 172.21.15.138:0/2718035786 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 -- 172.21.15.138:0/2718035786 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3b75e770 con 0x561a3b75dda0 2024-02-16T10:31:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- 172.21.15.138:0/2718035786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f35a40494c0 tx=0x7f35a40480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fffaa2ed434a2b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f3483fff640 1 -- 172.21.15.138:0/2718035786 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a403b050 con 0x561a3b75dda0 2024-02-16T10:31:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f3483fff640 1 -- 172.21.15.138:0/2718035786 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a403b1b0 con 0x561a3b75dda0 2024-02-16T10:31:54.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f3483fff640 1 -- 172.21.15.138:0/2718035786 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a4012690 con 0x561a3b75dda0 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/2718035786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 msgr2=0x561a3b75e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 --2- 172.21.15.138:0/2718035786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f35a40494c0 tx=0x7f35a40480e0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/2718035786 shutdown_connections 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 --2- 172.21.15.138:0/2718035786 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b75e1a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/2718035786 >> 172.21.15.138:0/2718035786 conn(0x561a3b758970 msgr2=0x561a3b759850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/2718035786 shutdown_connections 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/2718035786 wait complete. 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 Processor -- start 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- start start 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3b765070 con 0x561a3b75dda0 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55512/0 (socket says 172.21.15.138:55512) 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 learned_addr learned my addr 172.21.15.138:0/3808171003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:54.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3b752550 con 0x561a3b75dda0 2024-02-16T10:31:54.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35ad535640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f35a4012f90 tx=0x7f35a4049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f34827fc640 1 -- 172.21.15.138:0/3808171003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a4034070 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a3b765270 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f34827fc640 1 -- 172.21.15.138:0/3808171003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a402b720 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a3b7656a0 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.987+0000 7f34827fc640 1 -- 172.21.15.138:0/3808171003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35a402bea0 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f34827fc640 1 -- 172.21.15.138:0/3808171003 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35a4049600 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f34827fc640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34780342b0 0x7f3478036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f34827fc640 1 -- 172.21.15.138:0/3808171003 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f35a402ed60 con 0x561a3b75dda0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35acd34640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34780342b0 0x7f3478036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b770240 0x561a3b772700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b772e50 con 0x561a3b770240 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b770240 0x561a3b772700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35acd34640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34780342b0 0x7f3478036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x561a3b743240 tx=0x7f359c0ec000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:54.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b770240 0x561a3b772700 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 realm 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b76f6a0 con 0x561a3b770240 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:55.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7738d0 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b774150 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7744b0 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 20 searching for the correct realm 2024-02-16T10:31:55.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561a3b776620 0x561a3b778ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7791b0 con 0x561a3b776620 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.991+0000 7f35ad535640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561a3b776620 0x561a3b778ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ad535640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561a3b776620 0x561a3b778ae0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b776620 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ad535640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35a4014850 0x7f35a403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35acd34640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35a4014850 0x7f35a403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35acd34640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35a4014850 0x7f35a403b620 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35acd34640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f359c009040 0x7f359c0e4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f359c009040 0x7f359c0e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f359c009040 0x7f359c0e4720 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.995+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b776620 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a400a4d0 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:54.999+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.003+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b776620 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f359c009040 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x561a3b770240 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35a4053040 con 0x7f35a4014850 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:55.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b774a40 con 0x561a3b770240 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b774df0 con 0x561a3b770240 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b775250 con 0x7f35a4014850 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 zone default found 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 4 Realm: () 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 zonegroup default 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.007+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7795f0 con 0x7f359c009040 2024-02-16T10:31:55.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77b380 con 0x561a3b776620 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77b710 con 0x561a3b776620 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 started sync module instance, tier type = 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77a810 con 0x7f35a4014850 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94670666834800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77b010 con 0x7f35a4014850 2024-02-16T10:31:55.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77c140 con 0x561a3b770240 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.011+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94670666834800] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94670666841248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77c0c0 con 0x561a3b770240 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77ce60 con 0x561a3b776620 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94670666841248] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94670666844608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77cde0 con 0x561a3b776620 2024-02-16T10:31:55.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.015+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77c560 con 0x7f35a4014850 2024-02-16T10:31:55.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94670666848384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77cde0 con 0x7f35a4014850 2024-02-16T10:31:55.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77e750 con 0x561a3b770240 2024-02-16T10:31:55.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94670666844608] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94670666848384] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94670666849440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77e2b0 con 0x561a3b770240 2024-02-16T10:31:55.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.019+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77efa0 con 0x7f359c009040 2024-02-16T10:31:55.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94670666849440] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94670666846736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77ecd0 con 0x7f359c009040 2024-02-16T10:31:55.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77f4d0 con 0x7f359c009040 2024-02-16T10:31:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94670666846736] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94670666852672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77f2c0 con 0x7f359c009040 2024-02-16T10:31:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.023+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77fd70 con 0x7f359c009040 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94670666856560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b780210 con 0x7f359c009040 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=0 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=1 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=2 2024-02-16T10:31:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=3 2024-02-16T10:31:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=4 2024-02-16T10:31:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=5 2024-02-16T10:31:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94670666852672] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=6 2024-02-16T10:31:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94670666856560] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 20 add_watcher() i=7 2024-02-16T10:31:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77ed60 con 0x561a3b770240 2024-02-16T10:31:55.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.027+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94670666857776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b77ed60 con 0x561a3b770240 2024-02-16T10:31:55.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94670666857776] v33'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f3462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:55.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35af219980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:55.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35af219980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:55.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78b840 con 0x561a3b770240 2024-02-16T10:31:55.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.031+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78b8f0 con 0x7f359c009040 2024-02-16T10:31:55.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78c3f0 con 0x561a3b776620 2024-02-16T10:31:55.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78c920 con 0x561a3b770240 2024-02-16T10:31:55.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.035+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78cdc0 con 0x7f35a4014850 2024-02-16T10:31:55.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.039+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.039+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7898b0 con 0x561a3b776620 2024-02-16T10:31:55.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.039+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.039+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7898b0 con 0x561a3b770240 2024-02-16T10:31:55.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.043+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.043+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78d930 con 0x7f359c009040 2024-02-16T10:31:55.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.043+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'46 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.043+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78d930 con 0x7f35a4014850 2024-02-16T10:31:55.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78de60 con 0x561a3b776620 2024-02-16T10:31:55.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e390 con 0x7f35a4014850 2024-02-16T10:31:55.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.047+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e8c0 con 0x7f359c009040 2024-02-16T10:31:55.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.051+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.051+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e8c0 con 0x7f35a4014850 2024-02-16T10:31:55.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.051+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.051+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b789840 con 0x7f359c009040 2024-02-16T10:31:55.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.055+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'52 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.055+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e830 con 0x561a3b770240 2024-02-16T10:31:55.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.055+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.055+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e830 con 0x561a3b776620 2024-02-16T10:31:55.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'64 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e6f0 con 0x7f35a4014850 2024-02-16T10:31:55.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b776620 2024-02-16T10:31:55.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.059+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b770240 2024-02-16T10:31:55.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.063+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.063+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b770240 2024-02-16T10:31:55.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.063+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.063+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b776620 2024-02-16T10:31:55.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'65 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x7f35a4014850 2024-02-16T10:31:55.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b776620 2024-02-16T10:31:55.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.067+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e780 con 0x561a3b776620 2024-02-16T10:31:55.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x561a3b776620 2024-02-16T10:31:55.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'23 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x561a3b776620 2024-02-16T10:31:55.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.071+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x7f359c009040 2024-02-16T10:31:55.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.075+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.075+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x561a3b776620 2024-02-16T10:31:55.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.075+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.075+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x7f359c009040 2024-02-16T10:31:55.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.079+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'47 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.079+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x561a3b776620 2024-02-16T10:31:55.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.079+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'66 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.079+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x7f359c009040 2024-02-16T10:31:55.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.083+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'53 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.083+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b78e160 con 0x7f35a4014850 2024-02-16T10:31:55.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f3461fe3640 20 reqs_thread_entry: start 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 20 Filter name: none 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f33d37fe640 20 reqs_thread_entry: start 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b787b40 con 0x7f35a4014850 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(94 bud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:31:55.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-02-16T10:31:55.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-02-16T10:31:55.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:55.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b787b40 con 0x561a3b770240 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94670666888864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7ab2f0 con 0x7f359c009040 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== watch-notify(notify (1) cookie 94670666846736 notify 141733920801 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f35a0009050 con 0x7f359c009040 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f3483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94670666846736 notifier 4752 bl.length()=170 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f3483fff640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3470003d60 con 0x7f359c009040 2024-02-16T10:31:55.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.087+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(96 notify.5 [notify cookie 94670666888864 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== watch-notify(notify_complete (2) cookie 94670666888864 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561a3b58fb60 con 0x7f359c009040 2024-02-16T10:31:55.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786b30 con 0x561a3b770240 2024-02-16T10:31:55.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v33'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 10 removing email index: 2024-02-16T10:31:55.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 10 removing user buckets index 2024-02-16T10:31:55.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-02-16T10:31:55.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94670666888864 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b7ab2f0 con 0x7f359c009040 2024-02-16T10:31:55.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== watch-notify(notify (1) cookie 94670666852672 notify 141733920802 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x561a3b58fb60 con 0x7f359c009040 2024-02-16T10:31:55.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f34837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94670666852672 notifier 4752 bl.length()=160 2024-02-16T10:31:55.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f34837fe640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f33e00032c0 con 0x7f359c009040 2024-02-16T10:31:55.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(99 notify.6 [notify cookie 94670666888864 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== watch-notify(notify_complete (2) cookie 94670666888864 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f35a0003980 con 0x7f359c009040 2024-02-16T10:31:55.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.091+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786b30 con 0x561a3b770240 2024-02-16T10:31:55.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(101 bud.buckets [delete] v33'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35af219980 10 removing user index: bud 2024-02-16T10:31:55.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35af219980 10 removing default.rgw.meta+users.uid+bud from cache 2024-02-16T10:31:55.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35af219980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-02-16T10:31:55.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94670666884752 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ab0 con 0x7f359c009040 2024-02-16T10:31:55.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== watch-notify(notify (1) cookie 94670666846736 notify 141733920803 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f35a0003980 con 0x7f359c009040 2024-02-16T10:31:55.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f3483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94670666846736 notifier 4752 bl.length()=152 2024-02-16T10:31:55.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f3483fff640 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3470003d60 con 0x7f359c009040 2024-02-16T10:31:55.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(102 notify.5 [notify cookie 94670666884752 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== watch-notify(notify_complete (2) cookie 94670666884752 notify 141733920803 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f35a002f430 con 0x7f359c009040 2024-02-16T10:31:55.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.095+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f35a4014850 2024-02-16T10:31:55.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(104 bud [call,call,delete] v33'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f3462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:55.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94670666857776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x561a3b770240 2024-02-16T10:31:55.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94670666857776] v33'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94670666834800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f35a4014850 2024-02-16T10:31:55.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94670666834800] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35af219980 20 remove_watcher() i=0 2024-02-16T10:31:55.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.099+0000 7f35af219980 2 removed watcher, disabling cache 2024-02-16T10:31:55.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.103+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94670666841248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x561a3b770240 2024-02-16T10:31:55.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.103+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94670666841248] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.103+0000 7f35af219980 20 remove_watcher() i=1 2024-02-16T10:31:55.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.103+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94670666844608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x561a3b776620 2024-02-16T10:31:55.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35ad535640 1 -- 172.21.15.138:0/3808171003 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94670666844608] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a4060040 con 0x561a3b776620 2024-02-16T10:31:55.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 20 remove_watcher() i=2 2024-02-16T10:31:55.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94670666848384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f35a4014850 2024-02-16T10:31:55.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35acd34640 1 -- 172.21.15.138:0/3808171003 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94670666848384] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f359c0cd020 con 0x7f35a4014850 2024-02-16T10:31:55.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 20 remove_watcher() i=3 2024-02-16T10:31:55.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94670666849440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x561a3b770240 2024-02-16T10:31:55.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94670666849440] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x561a3b770240 2024-02-16T10:31:55.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 20 remove_watcher() i=4 2024-02-16T10:31:55.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.107+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94670666846736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f359c009040 2024-02-16T10:31:55.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.111+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94670666846736] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.111+0000 7f35af219980 20 remove_watcher() i=5 2024-02-16T10:31:55.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.111+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94670666852672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f359c009040 2024-02-16T10:31:55.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94670666852672] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 20 remove_watcher() i=6 2024-02-16T10:31:55.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94670666856560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561a3b786ee0 con 0x7f359c009040 2024-02-16T10:31:55.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94670666856560] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35a000bdd0 con 0x7f359c009040 2024-02-16T10:31:55.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 20 remove_watcher() i=7 2024-02-16T10:31:55.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f359c009040 msgr2=0x7f359c0e4720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f359c009040 0x7f359c0e4720 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b770240 msgr2=0x561a3b772700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b770240 0x561a3b772700 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35a4014850 msgr2=0x7f35a403b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35a4014850 0x7f35a403b620 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561a3b776620 msgr2=0x561a3b778ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x561a3b776620 0x561a3b778ae0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34780342b0 msgr2=0x7f3478036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34780342b0 0x7f3478036770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x561a3b743240 tx=0x7f359c0ec000 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 msgr2=0x561a3b764b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f35a4012f90 tx=0x7f35a4049450 comp rx=0 tx=0).stop 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35ac533640 1 -- 172.21.15.138:0/3808171003 reap_dead start 2024-02-16T10:31:55.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 shutdown_connections 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/3808171003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b75dda0 0x561a3b764b30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 >> 172.21.15.138:0/3808171003 conn(0x561a3b758970 msgr2=0x561a3b759850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 shutdown_connections 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/3808171003 wait complete. 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 msgr2=0x7f3484036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 0x7f3484036770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561a3b73e0e0 tx=0x7f359c0bc600 comp rx=0 tx=0).stop 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 msgr2=0x561a3b751270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x561a3b737a80 tx=0x7f35a4018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 shutdown_connections 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34840342b0 0x7f3484036770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 --2- 172.21.15.138:0/1814968158 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b750e50 0x561a3b751270 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 >> 172.21.15.138:0/1814968158 conn(0x561a3b745c60 msgr2=0x561a3b746770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 shutdown_connections 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.115+0000 7f35af219980 1 -- 172.21.15.138:0/1814968158 wait complete. 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 msgr2=0x561a3b73d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 0x561a3b73d340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 msgr2=0x561a3b742820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 0x561a3b742820 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 msgr2=0x7f3494036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 0x7f3494036770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35a0000f70 tx=0x7f35a0001420 comp rx=0 tx=0).stop 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 msgr2=0x561a3b736650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f359c0aa5a0 tx=0x7f359c0180e0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 shutdown_connections 2024-02-16T10:31:55.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x561a3b73efc0 0x561a3b742820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x561a3b648c20 0x561a3b73d340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34940342b0 0x7f3494036770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 --2- 172.21.15.138:0/2771381128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a3b5b7f60 0x561a3b736650 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 >> 172.21.15.138:0/2771381128 conn(0x561a3b63ddc0 msgr2=0x561a3b729fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 shutdown_connections 2024-02-16T10:31:55.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.119+0000 7f35af219980 1 -- 172.21.15.138:0/2771381128 wait complete. 2024-02-16T10:31:55.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T10:31:55.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-02-16T10:31:55.133 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-02-16T10:31:55.206 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:31:55.206 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:31:55.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaed526980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d019bf2770 0x55d019bf4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaed526980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d019b3cb60 con 0x55d019b64760 2024-02-16T10:31:55.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaed526980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d019b03d30 con 0x55d019bf2770 2024-02-16T10:31:55.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaea840640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d019bf2770 0x55d019bf4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaea840640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55d019bf2770 0x55d019bf4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55524/0 (socket says 172.21.15.138:55524) 2024-02-16T10:31:55.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaea840640 1 -- 172.21.15.138:0/2841072402 learned_addr learned my addr 172.21.15.138:0/2841072402 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaea840640 1 -- 172.21.15.138:0/2841072402 >> v1:172.21.15.107:6789/0 conn(0x55d019b64760 legacy=0x55d019bf1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.203+0000 7ffaea840640 1 -- 172.21.15.138:0/2841072402 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d019bf5160 con 0x55d019bf2770 2024-02-16T10:31:55.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaea840640 1 --2- 172.21.15.138:0/2841072402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019bf2770 0x55d019bf4b90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffae000a5c0 tx=0x7ffae001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186212f93c0f8349 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaea03f640 1 -- 172.21.15.138:0/2841072402 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae00aa470 con 0x55d019bf2770 2024-02-16T10:31:55.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaea03f640 1 -- 172.21.15.138:0/2841072402 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae00aa5d0 con 0x55d019bf2770 2024-02-16T10:31:55.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaea03f640 1 -- 172.21.15.138:0/2841072402 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae00aa890 con 0x55d019bf2770 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 -- 172.21.15.138:0/2841072402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019bf2770 msgr2=0x55d019bf4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 --2- 172.21.15.138:0/2841072402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019bf2770 0x55d019bf4b90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffae000a5c0 tx=0x7ffae001b340 comp rx=0 tx=0).stop 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 -- 172.21.15.138:0/2841072402 shutdown_connections 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 --2- 172.21.15.138:0/2841072402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019bf2770 0x55d019bf4b90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 -- 172.21.15.138:0/2841072402 >> 172.21.15.138:0/2841072402 conn(0x55d019bead80 msgr2=0x55d019bed1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 -- 172.21.15.138:0/2841072402 shutdown_connections 2024-02-16T10:31:55.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.207+0000 7ffaed526980 1 -- 172.21.15.138:0/2841072402 wait complete. 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaed526980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaed526980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d019b00fc0 con 0x55d019b64760 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaeb041640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaeb041640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55536/0 (socket says 172.21.15.138:55536) 2024-02-16T10:31:55.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaeb041640 1 -- 172.21.15.138:0/866272807 learned_addr learned my addr 172.21.15.138:0/866272807 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaeb041640 1 -- 172.21.15.138:0/866272807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0005df0 con 0x55d019b64760 2024-02-16T10:31:55.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ffaeb041640 1 --2- 172.21.15.138:0/866272807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffadc001d10 tx=0x7ffadc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef822d12d8e1623 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ff9d960a640 1 -- 172.21.15.138:0/866272807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc014070 con 0x55d019b64760 2024-02-16T10:31:55.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ff9d960a640 1 -- 172.21.15.138:0/866272807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc00f560 con 0x55d019b64760 2024-02-16T10:31:55.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.223+0000 7ff9d960a640 1 -- 172.21.15.138:0/866272807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc00f840 con 0x55d019b64760 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/866272807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 msgr2=0x55d019ce0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 --2- 172.21.15.138:0/866272807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffadc001d10 tx=0x7ffadc00b5c0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/866272807 shutdown_connections 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 --2- 172.21.15.138:0/866272807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce0fd0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/866272807 >> 172.21.15.138:0/866272807 conn(0x55d019bead80 msgr2=0x55d019cdcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/866272807 shutdown_connections 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/866272807 wait complete. 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d019afc7a0 con 0x55d019b64760 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaeb041640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaeb041640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55548/0 (socket says 172.21.15.138:55548) 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaeb041640 1 -- 172.21.15.138:0/1950771801 learned_addr learned my addr 172.21.15.138:0/1950771801 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaeb041640 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d019b3cb60 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaeb041640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00b600 tx=0x7ffadc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 -- 172.21.15.138:0/1950771801 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc014050 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 -- 172.21.15.138:0/1950771801 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc001520 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d019ce8410 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 -- 172.21.15.138:0/1950771801 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffadc01ba80 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d019ce8920 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 -- 172.21.15.138:0/1950771801 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffadc022020 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.227+0000 7ff9d7e07640 1 -- 172.21.15.138:0/1950771801 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffadc048d80 con 0x55d019b64760 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaea840640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 0x55d019ceebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019cef100 con 0x55d019bf2770 2024-02-16T10:31:55.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 0x55d019ceebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaea840640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ae000 tx=0x7ffae00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 0x55d019ceebc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 -- 172.21.15.138:0/1950771801 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffae400a4d0 con 0x55d019bf2770 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019cef4a0 con 0x55d019bf2770 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 -- 172.21.15.138:0/1950771801 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffae400a4d0 con 0x55d019bf2770 2024-02-16T10:31:55.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019cf0d50 con 0x55d019bf2770 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 -- 172.21.15.138:0/1950771801 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ffae400a4d0 con 0x55d019bf2770 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019ceff50 con 0x55d019bf2770 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 -- 172.21.15.138:0/1950771801 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffae400a4d0 con 0x55d019bf2770 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 0x55d019cf40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019cf4720 con 0x55d019cf0870 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb041640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 0x55d019cf40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb041640 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 0x55d019cf40d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb041640 1 -- 172.21.15.138:0/1950771801 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ffadc016070 con 0x55d019cf0870 2024-02-16T10:31:55.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaed526980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d019a94f20 con 0x55d019d026c0 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55562/0 (socket says 172.21.15.138:55562) 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.231+0000 7ffaeb842640 1 -- 172.21.15.138:0/1678453052 learned_addr learned my addr 172.21.15.138:0/1678453052 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 -- 172.21.15.138:0/1678453052 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d019d03020 con 0x55d019d026c0 2024-02-16T10:31:55.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55d019ce9300 tx=0x7ffae4018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 -- 172.21.15.138:0/1678453052 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae401d070 con 0x55d019d026c0 2024-02-16T10:31:55.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d019d03270 con 0x55d019d026c0 2024-02-16T10:31:55.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 -- 172.21.15.138:0/1678453052 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4014450 con 0x55d019d026c0 2024-02-16T10:31:55.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d019d03dc0 con 0x55d019d026c0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 -- 172.21.15.138:0/1678453052 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae40146f0 con 0x55d019d026c0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 -- 172.21.15.138:0/1678453052 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffae4020020 con 0x55d019d026c0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 0x7ff9c40367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ff9d5602640 1 -- 172.21.15.138:0/1678453052 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffae404b2d0 con 0x55d019d026c0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb041640 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 0x7ff9c40367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb041640 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 0x7ff9c40367c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d019cef990 tx=0x7ffadc00ef60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaed526980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d019a88790 con 0x55d019d0f620 2024-02-16T10:31:55.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55578/0 (socket says 172.21.15.138:55578) 2024-02-16T10:31:55.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 -- 172.21.15.138:0/1839233003 learned_addr learned my addr 172.21.15.138:0/1839233003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.235+0000 7ffaeb842640 1 -- 172.21.15.138:0/1839233003 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d019d10010 con 0x55d019d0f620 2024-02-16T10:31:55.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 --2- 172.21.15.138:0/1839233003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffae4049550 tx=0x7ffae4014f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1206559673d2d50 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9ceffd640 1 -- 172.21.15.138:0/1839233003 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae4048070 con 0x55d019d0f620 2024-02-16T10:31:55.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9ceffd640 1 -- 172.21.15.138:0/1839233003 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4022500 con 0x55d019d0f620 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9ceffd640 1 -- 172.21.15.138:0/1839233003 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae4013b00 con 0x55d019d0f620 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/1839233003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 msgr2=0x55d019d0fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 --2- 172.21.15.138:0/1839233003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffae4049550 tx=0x7ffae4014f80 comp rx=0 tx=0).stop 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/1839233003 shutdown_connections 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 --2- 172.21.15.138:0/1839233003 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d0fa40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/1839233003 >> 172.21.15.138:0/1839233003 conn(0x55d019d0a1a0 msgr2=0x55d019d0b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/1839233003 shutdown_connections 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/1839233003 wait complete. 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 Processor -- start 2024-02-16T10:31:55.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- start start 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d019d168a0 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:55590/0 (socket says 172.21.15.138:55590) 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 learned_addr learned my addr 172.21.15.138:0/49618939 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d019d03dc0 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaeb842640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffae404b240 tx=0x7ffae40494e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9cd7fa640 1 -- 172.21.15.138:0/49618939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae4016440 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d019d16aa0 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9cd7fa640 1 -- 172.21.15.138:0/49618939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4022670 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ff9cd7fa640 1 -- 172.21.15.138:0/49618939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffae4022980 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.239+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d019d16f30 con 0x55d019d0f620 2024-02-16T10:31:55.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ff9cd7fa640 1 -- 172.21.15.138:0/49618939 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffae4022d40 con 0x55d019d0f620 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ff9cd7fa640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9b40342b0 0x7ff9b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ff9cd7fa640 1 -- 172.21.15.138:0/49618939 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffae4002390 con 0x55d019d0f620 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb041640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9b40342b0 0x7ff9b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019d21a60 0x55d019d23f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d24670 con 0x55d019d21a60 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019d21a60 0x55d019d23f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb041640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9b40342b0 0x7ff9b4036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffadc01be20 tx=0x7ffadc03a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019d21a60 0x55d019d23f20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 realm 2024-02-16T10:31:55.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d24a60 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d252e0 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d25640 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d25e40 con 0x55d019d21a60 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 20 searching for the correct realm 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d019d27cf0 0x55d019d2a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb842640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d019d27cf0 0x55d019d2a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb842640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d019d27cf0 0x55d019d2a1b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb842640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffae4014850 0x7ffae404d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.243+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffae4014850 0x7ffae404d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffae4014850 0x7ffae404d0c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffadc03d040 0x7ffadc019770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:31:55.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffadc03d040 0x7ffadc019770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:31:55.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffadc03d040 0x7ffadc019770 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.247+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.251+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffae4014850 2024-02-16T10:31:55.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d27cf0 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.255+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x7ffadc03d040 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2a880 con 0x55d019d21a60 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ffae00dd040 con 0x7ffae4014850 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:31:55.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d26640 con 0x55d019d21a60 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d269f0 con 0x55d019d21a60 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d269f0 con 0x7ffae4014850 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:31:55.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 zone default found 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 4 Realm: () 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 zonegroup default 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2acc0 con 0x7ffadc03d040 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2c6a0 con 0x55d019d27cf0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2caa0 con 0x55d019d27cf0 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 started sync module instance, tier type = 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.259+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2bb30 con 0x7ffae4014850 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc016070 con 0x7ffae4014850 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94352274798224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2cec0 con 0x7ffae4014850 2024-02-16T10:31:55.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2d6c0 con 0x55d019d21a60 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94352274798224] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94352274800352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2d780 con 0x55d019d21a60 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.263+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2e230 con 0x55d019d27cf0 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94352274808112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2e1f0 con 0x55d019d27cf0 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2f120 con 0x7ffae4014850 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94352274800352] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94352274811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2f0e0 con 0x7ffae4014850 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2faf0 con 0x55d019d21a60 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94352274808112] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94352274811936] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94352274805280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2faf0 con 0x55d019d21a60 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.267+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2f750 con 0x7ffadc03d040 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.271+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94352274805280] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.271+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.271+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94352274810384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2ff90 con 0x7ffadc03d040 2024-02-16T10:31:55.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.271+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d30900 con 0x7ffadc03d040 2024-02-16T10:31:55.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94352274810384] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94352274816000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d30900 con 0x7ffadc03d040 2024-02-16T10:31:55.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d31270 con 0x7ffadc03d040 2024-02-16T10:31:55.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94352274816000] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94352274818416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d31270 con 0x7ffadc03d040 2024-02-16T10:31:55.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=0 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=1 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=2 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=3 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=4 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=5 2024-02-16T10:31:55.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.275+0000 7ffaed526980 20 add_watcher() i=6 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94352274818416] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 20 add_watcher() i=7 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 2 all 8 watchers are set, enabling cache 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d345a0 con 0x55d019d21a60 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94352274833376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d313e0 con 0x55d019d21a60 2024-02-16T10:31:55.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94352274833376] v33'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ff9a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:55.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:31:55.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:31:55.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.279+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3cbb0 con 0x55d019d21a60 2024-02-16T10:31:55.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3d050 con 0x7ffadc03d040 2024-02-16T10:31:55.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3d4f0 con 0x55d019d27cf0 2024-02-16T10:31:55.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.283+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3acf0 con 0x55d019d21a60 2024-02-16T10:31:55.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3acf0 con 0x7ffae4014850 2024-02-16T10:31:55.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3e230 con 0x55d019d27cf0 2024-02-16T10:31:55.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.287+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3e760 con 0x55d019d21a60 2024-02-16T10:31:55.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.291+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.291+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3ec00 con 0x7ffadc03d040 2024-02-16T10:31:55.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.291+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'48 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.291+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3ec00 con 0x7ffae4014850 2024-02-16T10:31:55.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d39c50 con 0x55d019d27cf0 2024-02-16T10:31:55.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d39c50 con 0x7ffae4014850 2024-02-16T10:31:55.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.295+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x7ffadc03d040 2024-02-16T10:31:55.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.299+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.299+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x7ffae4014850 2024-02-16T10:31:55.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.299+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.299+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x7ffadc03d040 2024-02-16T10:31:55.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'54 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x55d019d21a60 2024-02-16T10:31:55.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d39c50 con 0x55d019d27cf0 2024-02-16T10:31:55.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'67 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.303+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f9c0 con 0x7ffae4014850 2024-02-16T10:31:55.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.307+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.307+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f940 con 0x55d019d27cf0 2024-02-16T10:31:55.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.307+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.307+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f940 con 0x55d019d21a60 2024-02-16T10:31:55.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f940 con 0x55d019d21a60 2024-02-16T10:31:55.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f940 con 0x55d019d27cf0 2024-02-16T10:31:55.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'68 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.311+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f940 con 0x7ffae4014850 2024-02-16T10:31:55.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x55d019d27cf0 2024-02-16T10:31:55.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3f770 con 0x55d019d27cf0 2024-02-16T10:31:55.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.315+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d397b0 con 0x55d019d27cf0 2024-02-16T10:31:55.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.319+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.319+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d397b0 con 0x55d019d27cf0 2024-02-16T10:31:55.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.319+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.319+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x7ffadc03d040 2024-02-16T10:31:55.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.323+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.323+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x55d019d27cf0 2024-02-16T10:31:55.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.323+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.323+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x7ffadc03d040 2024-02-16T10:31:55.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.323+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'49 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.327+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x55d019d27cf0 2024-02-16T10:31:55.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.327+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'69 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.327+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x7ffadc03d040 2024-02-16T10:31:55.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.331+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'55 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.331+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3fd40 con 0x7ffae4014850 2024-02-16T10:31:55.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.331+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.331+0000 7ff9a0fe1640 20 reqs_thread_entry: start 2024-02-16T10:31:55.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.331+0000 7ffaed526980 20 init_complete bucket index max shards: 11 2024-02-16T10:31:55.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 20 Filter name: none 2024-02-16T10:31:55.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ff91a7fc640 20 reqs_thread_entry: start 2024-02-16T10:31:55.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-02-16T10:31:55.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3d970 con 0x7ffadc03d040 2024-02-16T10:31:55.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(94 fud [call out=48b,read 0~347 out=347b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+470 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=347 2024-02-16T10:31:55.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-02-16T10:31:55.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3d930 con 0x7ffadc03d040 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 : miss 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:96 8.8 8:162aaf21:root::.bucket.meta.myfoo7%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d5b7b0 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(96 .bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=355 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 info.flags=0x17 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 to cache LRU end 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.335+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:97 4.38 4:1e24e239:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd90d0 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(97 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:98 4.2 4:41f73ab9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd90d0 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(98 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 4.26 4:6712f6a3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd90d0 con 0x7ffadc03d040 2024-02-16T10:31:55.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(99 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:100 4.32 4:4e99c819:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd90f0 con 0x55d019d21a60 2024-02-16T10:31:55.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(100 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:101 4.24 4:2643334c:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd90f0 con 0x7ffadc03d040 2024-02-16T10:31:55.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(101 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:102 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9130 con 0x55d019d21a60 2024-02-16T10:31:55.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(102 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [call out=378b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+378 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 10 cls_bucket_list_unordered: got fourteen 2024-02-16T10:31:55.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:103 4.1a 4:5b208566:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9130 con 0x7ffae4014850 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(103 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.339+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:104 4.3e 4:7cd2cdb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9130 con 0x7ffae4014850 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(104 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:105 4.1d 4:b85ce579:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9130 con 0x55d019d27cf0 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(105 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:106 4.24 4:275a3436:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9170 con 0x7ffadc03d040 2024-02-16T10:31:55.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(106 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:107 4.9 4:92c31aca:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019dd9170 con 0x55d019d21a60 2024-02-16T10:31:55.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(107 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 20 get_obj_state: octx=0x7ffadc00e410 obj=myfoo7:fourteen state=0x55d019d5ca08 s->prefetch_data=0 2024-02-16T10:31:55.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:108 3.1es0 3:7a3363cb:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d5d820 con 0x7ffadc03d040 2024-02-16T10:31:55.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(108 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 239+0+874 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 10 manifest: total_size = 8 2024-02-16T10:31:55.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.18384832258421163725 2024-02-16T10:31:55.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 20 get_obj_state: octx=0x7ffadc00e410 obj=myfoo7:fourteen state=0x55d019d5ca08 s->prefetch_data=0 2024-02-16T10:31:55.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 20 prepare_atomic_modification: state is not atomic. state=0x55d019d5ca08 2024-02-16T10:31:55.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 2024-02-16T10:31:55.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.343+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:109 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d620a0 con 0x55d019d21a60 2024-02-16T10:31:55.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(109 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:110 3.1es0 3:7a3363cb:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d60080 con 0x7ffadc03d040 2024-02-16T10:31:55.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(110 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10_fourteen [call] v33'4 uv4 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:111 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d620a0 con 0x55d019d21a60 2024-02-16T10:31:55.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:31:55.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:112 4.38 4:1e24e239:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d620a0 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:113 4.2 4:41f73ab9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d620a0 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:114 4.26 4:6712f6a3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d68790 con 0x7ffadc03d040 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:115 4.32 4:4e99c819:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d6b030 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.347+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:116 4.24 4:2643334c:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d6d4f0 con 0x7ffadc03d040 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:117 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d6fe70 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 4.1a 4:5b208566:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d72c80 con 0x7ffae4014850 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:119 4.3e 4:7cd2cdb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d75660 con 0x7ffae4014850 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:120 4.1d 4:b85ce579:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d77fe0 con 0x55d019d27cf0 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:121 4.24 4:275a3436:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a9c0 con 0x7ffadc03d040 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:122 4.9 4:92c31aca:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7d370 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(120 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(112 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(113 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(115 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(114 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(116 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(118 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(119 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(122 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(111 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ff9ce7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== osd_op_reply(117 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(121 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:31:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10])"; uploads.size()=0; is_truncated=0 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:123 4.38 4:1e24e239:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d71360 con 0x55d019d21a60 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:124 4.2 4:41f73ab9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d716c0 con 0x55d019d21a60 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:125 4.26 4:6712f6a3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d71360 con 0x7ffadc03d040 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:126 4.32 4:4e99c819:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d75080 con 0x55d019d21a60 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:127 4.24 4:2643334c:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d794f0 con 0x7ffadc03d040 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:128 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d75080 con 0x55d019d21a60 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:129 4.1a 4:5b208566:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d794f0 con 0x7ffae4014850 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:130 4.3e 4:7cd2cdb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7d320 con 0x7ffae4014850 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:131 4.1d 4:b85ce579:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d794f0 con 0x55d019d27cf0 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(129 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(130 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(131 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:132 4.24 4:275a3436:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d794f0 con 0x7ffadc03d040 2024-02-16T10:31:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:133 4.9 4:92c31aca:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d79e90 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(123 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== osd_op_reply(124 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(126 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== osd_op_reply(125 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(127 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(128 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(133 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(132 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.351+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 20 rados_obj.operate() r=0 bl.length=168 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94352275118288 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== watch-notify(notify (1) cookie 94352274811936 notify 141733920788 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55d019ce8920 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ff9ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94352274811936 notifier 4759 bl.length()=150 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ff9ce7fc640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9200032c0 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(136 notify.3 [notify cookie 94352275118288 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== watch-notify(notify_complete (2) cookie 94352275118288 notify 141733920788 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d019ce8410 con 0x7ffae4014850 2024-02-16T10:31:55.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.355+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffae4014850 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(138 myfoo7 [call,call,delete] v33'47 uv47 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaed526980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 from cache 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10, ofs0, ns] 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:139 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94352275118288 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== watch-notify(notify (1) cookie 94352274816000 notify 141733920804 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7ffae00eb000 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ff9ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94352274816000 notifier 4759 bl.length()=208 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(139 notify.6 [notify cookie 94352275118288 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ff9ceffd640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9b0003d60 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== watch-notify(notify_complete (2) cookie 94352275118288 notify 141733920804 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffae00e6060 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(140 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.359+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:141 8.8 8:162aaf21:root::.bucket.meta.myfoo7%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(141 .bucket.meta.myfoo7:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 [call,call,delete] v33'6 uv6 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:142 4.38 4:1e24e239:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:143 4.2 4:41f73ab9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d32f10 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:144 4.26 4:6712f6a3:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d33790 con 0x7ffadc03d040 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:145 4.32 4:4e99c819:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:146 4.24 4:2643334c:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d32f10 con 0x7ffadc03d040 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:147 4.32 4:4c591a66:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d33b70 con 0x55d019d21a60 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:148 4.1a 4:5b208566:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffae4014850 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:149 4.3e 4:7cd2cdb1:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d33790 con 0x7ffae4014850 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:150 4.1d 4:b85ce579:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d27cf0 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:151 4.24 4:275a3436:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d33b70 con 0x7ffadc03d040 2024-02-16T10:31:55.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:152 4.9 4:92c31aca:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d32f10 con 0x55d019d21a60 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(145 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.3 [delete] v33'9 uv9 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(142 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.0 [delete] v33'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 50 ==== osd_op_reply(143 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.1 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(149 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.7 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 51 ==== osd_op_reply(147 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.5 [delete] v33'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(150 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.8 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(144 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.2 [delete] v33'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(146 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.4 [delete] v33'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.363+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(148 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.6 [delete] v33'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 52 ==== osd_op_reply(152 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.10 [delete] v33'8 uv8 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(151 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10.9 [delete] v33'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 : miss 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 20 rados->read ofs=0 len=0 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:153 6.c 6:36c9f610:::pubsub..bucket.myfoo7%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d27cf0 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(153 pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 info.flags=0x0 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 10 adding default.rgw.log++pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 to cache LRU end 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 10 removing default.rgw.log++pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 from cache 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10, ofs0, ns] 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 94352275118288 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffae4014850 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== watch-notify(notify (1) cookie 94352274811936 notify 141733920789 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x55d019ce8410 con 0x7ffae4014850 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ff9ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94352274811936 notifier 4759 bl.length()=205 2024-02-16T10:31:55.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(154 notify.3 [notify cookie 94352275118288 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ff9ceffd640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9b0003d60 con 0x7ffae4014850 2024-02-16T10:31:55.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== watch-notify(notify_complete (2) cookie 94352275118288 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d019b3cb60 con 0x7ffae4014850 2024-02-16T10:31:55.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:156 6.c 6:36c9f610:::pubsub..bucket.myfoo7%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d27cf0 2024-02-16T10:31:55.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(156 pubsub..bucket.myfoo7/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.10 [delete] v33'11 uv10 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.367+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== osd_op_reply(157 fud.buckets [call] v33'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaed526980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94352275118288 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x55d019d27cf0 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== watch-notify(notify (1) cookie 94352274808112 notify 141733920775 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7ffae406b040 con 0x55d019d27cf0 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ff9ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94352274808112 notifier 4759 bl.length()=170 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(158 notify.2 [notify cookie 94352275118288 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ff9ce7fc640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9200032c0 con 0x55d019d27cf0 2024-02-16T10:31:55.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== watch-notify(notify_complete (2) cookie 94352275118288 notify 141733920775 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d019d16f30 con 0x55d019d27cf0 2024-02-16T10:31:55.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.371+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v33'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaed526980 10 removing email index: 2024-02-16T10:31:55.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaed526980 10 removing user buckets index 2024-02-16T10:31:55.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-02-16T10:31:55.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94352275120976 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d798d0 con 0x7ffadc03d040 2024-02-16T10:31:55.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== watch-notify(notify (1) cookie 94352274816000 notify 141733920805 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7ffae00e6060 con 0x7ffadc03d040 2024-02-16T10:31:55.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ff9ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94352274816000 notifier 4759 bl.length()=160 2024-02-16T10:31:55.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 46 ==== osd_op_reply(161 notify.6 [notify cookie 94352275120976 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ff9ce7fc640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9200032c0 con 0x7ffadc03d040 2024-02-16T10:31:55.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 47 ==== watch-notify(notify_complete (2) cookie 94352275120976 notify 141733920805 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffae00ff040 con 0x7ffadc03d040 2024-02-16T10:31:55.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 48 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.375+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 49 ==== osd_op_reply(163 fud.buckets [delete] v33'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaed526980 10 removing user index: fud 2024-02-16T10:31:55.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaed526980 10 removing default.rgw.meta+users.uid+fud from cache 2024-02-16T10:31:55.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaed526980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-02-16T10:31:55.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94352275120976 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d3d430 con 0x7ffadc03d040 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 50 ==== watch-notify(notify (1) cookie 94352274810384 notify 141733920806 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7ffae00ff040 con 0x7ffadc03d040 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ff9ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94352274810384 notifier 4759 bl.length()=152 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 51 ==== osd_op_reply(164 notify.5 [notify cookie 94352275120976 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ff9ce7fc640 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff9200032c0 con 0x7ffadc03d040 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 52 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 53 ==== watch-notify(notify_complete (2) cookie 94352275120976 notify 141733920806 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffae00e1040 con 0x7ffadc03d040 2024-02-16T10:31:55.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.379+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d7a350 con 0x7ffadc03d040 2024-02-16T10:31:55.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.383+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 54 ==== osd_op_reply(166 fud [call,call,delete] v33'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.383+0000 7ff9a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:31:55.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.383+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94352274833376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x55d019d21a60 2024-02-16T10:31:55.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.383+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 53 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94352274833376] v33'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.383+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94352274798224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x7ffae4014850 2024-02-16T10:31:55.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94352274798224] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaed526980 20 remove_watcher() i=0 2024-02-16T10:31:55.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaed526980 2 removed watcher, disabling cache 2024-02-16T10:31:55.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94352274800352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x55d019d21a60 2024-02-16T10:31:55.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 54 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94352274800352] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaed526980 20 remove_watcher() i=1 2024-02-16T10:31:55.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.387+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94352274808112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2bee0 con 0x55d019d27cf0 2024-02-16T10:31:55.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaeb842640 1 -- 172.21.15.138:0/49618939 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94352274808112] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae4041020 con 0x55d019d27cf0 2024-02-16T10:31:55.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaed526980 20 remove_watcher() i=2 2024-02-16T10:31:55.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94352274811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x7ffae4014850 2024-02-16T10:31:55.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaeb041640 1 -- 172.21.15.138:0/49618939 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94352274811936] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffadc066040 con 0x7ffae4014850 2024-02-16T10:31:55.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaed526980 20 remove_watcher() i=3 2024-02-16T10:31:55.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.391+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94352274805280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2ec20 con 0x55d019d21a60 2024-02-16T10:31:55.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.1 v2:172.21.15.138:6802/802812406 55 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94352274805280] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x55d019d21a60 2024-02-16T10:31:55.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaed526980 20 remove_watcher() i=4 2024-02-16T10:31:55.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94352274810384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x7ffadc03d040 2024-02-16T10:31:55.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 55 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94352274810384] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaed526980 20 remove_watcher() i=5 2024-02-16T10:31:55.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.395+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94352274816000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d2ec20 con 0x7ffadc03d040 2024-02-16T10:31:55.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 56 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94352274816000] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 20 remove_watcher() i=6 2024-02-16T10:31:55.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94352274818416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d019d38f40 con 0x7ffadc03d040 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 <== osd.0 v2:172.21.15.107:6800/1630367885 57 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94352274818416] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffae00b0020 con 0x7ffadc03d040 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 20 remove_watcher() i=7 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffadc03d040 msgr2=0x7ffadc019770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffadc03d040 0x7ffadc019770 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019d21a60 msgr2=0x55d019d23f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019d21a60 0x55d019d23f20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffae4014850 msgr2=0x7ffae404d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffae4014850 0x7ffae404d0c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d019d27cf0 msgr2=0x55d019d2a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55d019d27cf0 0x55d019d2a1b0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9b40342b0 msgr2=0x7ff9b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9b40342b0 0x7ff9b4036770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffadc01be20 tx=0x7ffadc03a000 comp rx=0 tx=0).stop 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 msgr2=0x55d019d16360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaea840640 1 -- 172.21.15.138:0/49618939 reap_dead start 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffae404b240 tx=0x7ffae40494e0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 shutdown_connections 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/49618939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d0f620 0x55d019d16360 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 >> 172.21.15.138:0/49618939 conn(0x55d019d0a1a0 msgr2=0x55d019d0b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 shutdown_connections 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/49618939 wait complete. 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 msgr2=0x7ff9c40367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 0x7ff9c40367c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d019cef990 tx=0x7ffadc00ef60 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 msgr2=0x55d019d02ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55d019ce9300 tx=0x7ffae4018a60 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 shutdown_connections 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9c4034300 0x7ff9c40367c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 --2- 172.21.15.138:0/1678453052 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019d026c0 0x55d019d02ae0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.399+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 >> 172.21.15.138:0/1678453052 conn(0x55d019cf74d0 msgr2=0x55d019cf7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 shutdown_connections 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1678453052 wait complete. 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 msgr2=0x55d019ceebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 0x55d019ceebc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 msgr2=0x55d019cf40d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 0x55d019cf40d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 msgr2=0x7ff9d0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ae000 tx=0x7ffae00a6000 comp rx=0 tx=0).stop 2024-02-16T10:31:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 msgr2=0x55d019ce7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00b600 tx=0x7ffadc000bd0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 shutdown_connections 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55d019cf0870 0x55d019cf40d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55d019bf2770 0x55d019ceebc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ff9d00342b0 0x7ff9d0036770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 --2- 172.21.15.138:0/1950771801 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55d019b64760 0x55d019ce7ed0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 >> 172.21.15.138:0/1950771801 conn(0x55d019bead80 msgr2=0x55d019cdb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 shutdown_connections 2024-02-16T10:31:55.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:31:55.403+0000 7ffaed526980 1 -- 172.21.15.138:0/1950771801 wait complete. 2024-02-16T10:32:00.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-02-16T10:32:00.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-02-16T10:32:00.418 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-02-16T10:32:00.456 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:00.457 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:00.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c7d81980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f9e35e1cd0 0x55f9e35e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c7d81980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f9e3527b50 con 0x55f9e35dd7d0 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c7d81980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f9e34eed30 con 0x55f9e35e1cd0 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c589c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55f9e35dd7d0 0x55f9e35ddbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40378/0 (socket says 172.21.15.138:40378) 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c509b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55f9e35e1cd0 0x55f9e35e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c589c640 1 -- 172.21.15.138:0/2725601548 learned_addr learned my addr 172.21.15.138:0/2725601548 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:32:00.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c509b640 1 -- 172.21.15.138:0/2725601548 >> v1:172.21.15.107:6789/0 conn(0x55f9e35dd7d0 legacy=0x55f9e35ddbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.455+0000 7f61c509b640 1 -- 172.21.15.138:0/2725601548 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e35e5610 con 0x55f9e35e1cd0 2024-02-16T10:32:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c509b640 1 --2- 172.21.15.138:0/2725601548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35e1cd0 0x55f9e35e40c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00a480 tx=0x7f61bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c200830e574c5d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c489a640 1 -- 172.21.15.138:0/2725601548 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61bc0ab540 con 0x55f9e35e1cd0 2024-02-16T10:32:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c489a640 1 -- 172.21.15.138:0/2725601548 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc0ab6a0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c489a640 1 -- 172.21.15.138:0/2725601548 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61bc0ab960 con 0x55f9e35e1cd0 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 -- 172.21.15.138:0/2725601548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35e1cd0 msgr2=0x55f9e35e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2725601548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35e1cd0 0x55f9e35e40c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00a480 tx=0x7f61bc01b280 comp rx=0 tx=0).stop 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 -- 172.21.15.138:0/2725601548 shutdown_connections 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2725601548 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35e1cd0 0x55f9e35e40c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 -- 172.21.15.138:0/2725601548 >> 172.21.15.138:0/2725601548 conn(0x55f9e3550ef0 msgr2=0x55f9e3551300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 -- 172.21.15.138:0/2725601548 shutdown_connections 2024-02-16T10:32:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.459+0000 7f61c7d81980 1 -- 172.21.15.138:0/2725601548 wait complete. 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c7d81980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c7d81980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e34ebfc0 con 0x55f9e35dd7d0 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c589c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c589c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36534/0 (socket says 172.21.15.138:36534) 2024-02-16T10:32:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c589c640 1 -- 172.21.15.138:0/1256289444 learned_addr learned my addr 172.21.15.138:0/1256289444 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c589c640 1 -- 172.21.15.138:0/1256289444 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc005d30 con 0x55f9e35dd7d0 2024-02-16T10:32:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f61c589c640 1 --2- 172.21.15.138:0/1256289444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f61b8001c90 tx=0x7f61b800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a7be68b6f0d84 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f60b3e07640 1 -- 172.21.15.138:0/1256289444 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b800e690 con 0x55f9e35dd7d0 2024-02-16T10:32:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f60b3e07640 1 -- 172.21.15.138:0/1256289444 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800e7f0 con 0x55f9e35dd7d0 2024-02-16T10:32:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.475+0000 7f60b3e07640 1 -- 172.21.15.138:0/1256289444 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b800eaf0 con 0x55f9e35dd7d0 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1256289444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 msgr2=0x55f9e36c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1256289444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f61b8001c90 tx=0x7f61b800b6d0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1256289444 shutdown_connections 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1256289444 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36c7900 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1256289444 >> 172.21.15.138:0/1256289444 conn(0x55f9e3550ef0 msgr2=0x55f9e36c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1256289444 shutdown_connections 2024-02-16T10:32:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1256289444 wait complete. 2024-02-16T10:32:00.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e34e77a0 con 0x55f9e35dd7d0 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c589c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c589c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36538/0 (socket says 172.21.15.138:36538) 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c589c640 1 -- 172.21.15.138:0/1176361338 learned_addr learned my addr 172.21.15.138:0/1176361338 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c589c640 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e3527b50 con 0x55f9e35dd7d0 2024-02-16T10:32:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c589c640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f61b8001ee0 tx=0x7f61b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f60b2604640 1 -- 172.21.15.138:0/1176361338 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b801f070 con 0x55f9e35dd7d0 2024-02-16T10:32:00.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f9e36ced50 con 0x55f9e35dd7d0 2024-02-16T10:32:00.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f60b2604640 1 -- 172.21.15.138:0/1176361338 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b801a4d0 con 0x55f9e35dd7d0 2024-02-16T10:32:00.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f60b2604640 1 -- 172.21.15.138:0/1176361338 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b801a770 con 0x55f9e35dd7d0 2024-02-16T10:32:00.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.479+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9e36cf200 con 0x55f9e35dd7d0 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f60b2604640 1 -- 172.21.15.138:0/1176361338 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61b800a040 con 0x55f9e35dd7d0 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f60b2604640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f60b2604640 1 -- 172.21.15.138:0/1176361338 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61b8049710 con 0x55f9e35dd7d0 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c509b640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 0x55f9e36d5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e36d5a40 con 0x55f9e35e1cd0 2024-02-16T10:32:00.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 0x55f9e36d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c509b640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 0x7f60ac036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0ad000 tx=0x7f61bc0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 0x55f9e36d5500 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 -- 172.21.15.138:0/1176361338 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e36d5e00 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 -- 172.21.15.138:0/1176361338 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e36d76b0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 -- 172.21.15.138:0/1176361338 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e36d68b0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c609d640 1 -- 172.21.15.138:0/1176361338 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e35e1cd0 2024-02-16T10:32:00.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 0x55f9e36daa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e36db040 con 0x55f9e36d71d0 2024-02-16T10:32:00.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c589c640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 0x55f9e36daa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c589c640 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 0x55f9e36daa30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c589c640 1 -- 172.21.15.138:0/1176361338 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f61b8014070 con 0x55f9e36d71d0 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.483+0000 7f61c7d81980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e347ff20 con 0x55f9e36e8f90 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36542/0 (socket says 172.21.15.138:36542) 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c609d640 1 -- 172.21.15.138:0/2708443234 learned_addr learned my addr 172.21.15.138:0/2708443234 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c609d640 1 -- 172.21.15.138:0/2708443234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e36e98f0 con 0x55f9e36e8f90 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c609d640 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55f9e36cf8f0 tx=0x7f61c00188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 -- 172.21.15.138:0/2708443234 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c001d070 con 0x55f9e36e8f90 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 -- 172.21.15.138:0/2708443234 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0014580 con 0x55f9e36e8f90 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f9e36e9b40 con 0x55f9e36e8f90 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 -- 172.21.15.138:0/2708443234 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c0014860 con 0x55f9e36e8f90 2024-02-16T10:32:00.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9e36ea690 con 0x55f9e36e8f90 2024-02-16T10:32:00.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 -- 172.21.15.138:0/2708443234 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61c0020020 con 0x55f9e36e8f90 2024-02-16T10:32:00.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 0x7f60a0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f60ab7fe640 1 -- 172.21.15.138:0/2708443234 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61c004b310 con 0x55f9e36e8f90 2024-02-16T10:32:00.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c589c640 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 0x7f60a0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c589c640 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 0x7f60a0036770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61b8024000 tx=0x7f61b8023f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.487+0000 7f61c7d81980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3473790 con 0x55f9e36f5f30 2024-02-16T10:32:00.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36548/0 (socket says 172.21.15.138:36548) 2024-02-16T10:32:00.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 -- 172.21.15.138:0/2591393881 learned_addr learned my addr 172.21.15.138:0/2591393881 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 -- 172.21.15.138:0/2591393881 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e36f6920 con 0x55f9e36f5f30 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- 172.21.15.138:0/2591393881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f61c0049590 tx=0x7f61c002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f740c549a04066 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60a97fa640 1 -- 172.21.15.138:0/2591393881 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c003b2f0 con 0x55f9e36f5f30 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60a97fa640 1 -- 172.21.15.138:0/2591393881 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c003b050 con 0x55f9e36f5f30 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60a97fa640 1 -- 172.21.15.138:0/2591393881 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c0016590 con 0x55f9e36f5f30 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/2591393881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 msgr2=0x55f9e36f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2591393881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f61c0049590 tx=0x7f61c002bf20 comp rx=0 tx=0).stop 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/2591393881 shutdown_connections 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2591393881 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36f6350 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/2591393881 >> 172.21.15.138:0/2591393881 conn(0x55f9e36f0ab0 msgr2=0x55f9e36f1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/2591393881 shutdown_connections 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/2591393881 wait complete. 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 Processor -- start 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- start start 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e36fd1e0 con 0x55f9e36f5f30 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36564/0 (socket says 172.21.15.138:36564) 2024-02-16T10:32:00.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 learned_addr learned my addr 172.21.15.138:0/358049911 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e36ea690 con 0x55f9e36f5f30 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c609d640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f61c002bf60 tx=0x7f61c0049520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60977fe640 1 -- 172.21.15.138:0/358049911 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c0012eb0 con 0x55f9e36f5f30 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60977fe640 1 -- 172.21.15.138:0/358049911 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c002b920 con 0x55f9e36f5f30 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f9e36fd3e0 con 0x55f9e36f5f30 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f60977fe640 1 -- 172.21.15.138:0/358049911 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61c00498f0 con 0x55f9e36f5f30 2024-02-16T10:32:00.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.491+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9e36fd810 con 0x55f9e36f5f30 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f60977fe640 1 -- 172.21.15.138:0/358049911 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f61c0049a50 con 0x55f9e36f5f30 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f60977fe640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6090034260 0x7f6090036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f60977fe640 1 -- 172.21.15.138:0/358049911 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f61c0007050 con 0x55f9e36f5f30 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c589c640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6090034260 0x7f6090036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e37083f0 0x55f9e370a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370b000 con 0x55f9e37083f0 2024-02-16T10:32:00.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e37083f0 0x55f9e370a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c589c640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6090034260 0x7f6090036720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55f9e36d62f0 tx=0x7f61b8048000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e37083f0 0x55f9e370a8b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 realm 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370b3f0 con 0x55f9e37083f0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370bc70 con 0x55f9e37083f0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370bfd0 con 0x55f9e37083f0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370c7d0 con 0x55f9e37083f0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 20 searching for the correct realm 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f9e370e680 0x55f9e3710b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.495+0000 7f61c609d640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f9e370e680 0x55f9e3710b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c609d640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f9e370e680 0x55f9e3710b40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c609d640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61c0014070 0x7f61c003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c589c640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61c0014070 0x7f61c003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c589c640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61c0014070 0x7f61c003b4c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c589c640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61b8039070 0x7f61b80251d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61b8039070 0x7f61b80251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61b8039070 0x7f61b80251d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.499+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.503+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.507+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61c0014070 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e370e680 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x7f61b8039070 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711210 con 0x55f9e37083f0 2024-02-16T10:32:00.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f61bc0da080 con 0x7f61c0014070 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370d100 con 0x55f9e37083f0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370d950 con 0x55f9e37083f0 2024-02-16T10:32:00.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e370d950 con 0x7f61c0014070 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 zone default found 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 4 Realm: () 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 zonegroup default 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3711650 con 0x7f61b8039070 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.511+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e37134d0 con 0x55f9e370e680 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3713830 con 0x55f9e370e680 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 20 started sync module instance, tier type = 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3712910 con 0x7f61c0014070 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531751060592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3713160 con 0x7f61c0014070 2024-02-16T10:32:00.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3714280 con 0x55f9e37083f0 2024-02-16T10:32:00.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.515+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531751060592] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531751067008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3714630 con 0x55f9e37083f0 2024-02-16T10:32:00.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3714fe0 con 0x55f9e370e680 2024-02-16T10:32:00.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531751067008] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531751062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3714fa0 con 0x55f9e370e680 2024-02-16T10:32:00.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e37159a0 con 0x7f61c0014070 2024-02-16T10:32:00.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531751073024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e37161f0 con 0x7f61c0014070 2024-02-16T10:32:00.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.519+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3716be0 con 0x55f9e37083f0 2024-02-16T10:32:00.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.523+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531751062720] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.523+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531751073024] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.523+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.523+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531751075152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3714b00 con 0x55f9e37083f0 2024-02-16T10:32:00.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.523+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3717430 con 0x7f61b8039070 2024-02-16T10:32:00.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531751075152] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531751077568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e37173e0 con 0x7f61b8039070 2024-02-16T10:32:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3717df0 con 0x7f61b8039070 2024-02-16T10:32:00.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531751077568] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531751079744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3717df0 con 0x7f61b8039070 2024-02-16T10:32:00.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.527+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718630 con 0x7f61b8039070 2024-02-16T10:32:00.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531751083504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718cb0 con 0x7f61b8039070 2024-02-16T10:32:00.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=0 2024-02-16T10:32:00.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=1 2024-02-16T10:32:00.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=2 2024-02-16T10:32:00.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=3 2024-02-16T10:32:00.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=4 2024-02-16T10:32:00.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=5 2024-02-16T10:32:00.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531751079744] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=6 2024-02-16T10:32:00.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531751083504] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 20 add_watcher() i=7 2024-02-16T10:32:00.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 2 all 8 watchers are set, enabling cache 2024-02-16T10:32:00.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e371bbd0 con 0x55f9e37083f0 2024-02-16T10:32:00.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.531+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531751085824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718ff0 con 0x55f9e37083f0 2024-02-16T10:32:00.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531751085824] v33'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f60777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 5 note: GC not initialized 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f60767fc640 20 reqs_thread_entry: start 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 init_complete bucket index max shards: 11 2024-02-16T10:32:00.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 Filter name: none 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f5fe7fff640 20 reqs_thread_entry: start 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e373d9b0 con 0x55f9e37083f0 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:32:00.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:32:00.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.535+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e373fd70 con 0x7f61b8039070 2024-02-16T10:32:00.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.539+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call] v33'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.539+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e373fd70 con 0x7f61b8039070 2024-02-16T10:32:00.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.539+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(64 usage.10 [call] v33'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.539+0000 7f60777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:00.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.539+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531751085824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e371de20 con 0x55f9e37083f0 2024-02-16T10:32:00.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94531751085824] v33'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531751060592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718700 con 0x7f61c0014070 2024-02-16T10:32:00.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94531751060592] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c7d81980 20 remove_watcher() i=0 2024-02-16T10:32:00.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c7d81980 2 removed watcher, disabling cache 2024-02-16T10:32:00.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.543+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531751067008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718700 con 0x55f9e37083f0 2024-02-16T10:32:00.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94531751067008] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 20 remove_watcher() i=1 2024-02-16T10:32:00.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531751062720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718700 con 0x55f9e370e680 2024-02-16T10:32:00.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c609d640 1 -- 172.21.15.138:0/358049911 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94531751062720] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61c000a4d0 con 0x55f9e370e680 2024-02-16T10:32:00.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 20 remove_watcher() i=2 2024-02-16T10:32:00.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531751073024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3712cc0 con 0x7f61c0014070 2024-02-16T10:32:00.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c589c640 1 -- 172.21.15.138:0/358049911 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94531751073024] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61b804f040 con 0x7f61c0014070 2024-02-16T10:32:00.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 20 remove_watcher() i=3 2024-02-16T10:32:00.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.547+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531751075152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718700 con 0x55f9e37083f0 2024-02-16T10:32:00.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.551+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94531751075152] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x55f9e37083f0 2024-02-16T10:32:00.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.551+0000 7f61c7d81980 20 remove_watcher() i=4 2024-02-16T10:32:00.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.551+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531751077568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3715500 con 0x7f61b8039070 2024-02-16T10:32:00.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94531751077568] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c7d81980 20 remove_watcher() i=5 2024-02-16T10:32:00.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531751079744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3712cc0 con 0x7f61b8039070 2024-02-16T10:32:00.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94531751079744] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c7d81980 20 remove_watcher() i=6 2024-02-16T10:32:00.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.555+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531751083504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f9e3718700 con 0x7f61b8039070 2024-02-16T10:32:00.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94531751083504] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f61bc0ab810 con 0x7f61b8039070 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 20 remove_watcher() i=7 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61b8039070 msgr2=0x7f61b80251d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f61b8039070 0x7f61b80251d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e37083f0 msgr2=0x55f9e370a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e37083f0 0x55f9e370a8b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61c0014070 msgr2=0x7f61c003b4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f61c0014070 0x7f61c003b4c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f9e370e680 msgr2=0x55f9e3710b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55f9e370e680 0x55f9e3710b40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6090034260 msgr2=0x7f6090036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f6090034260 0x7f6090036720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55f9e36d62f0 tx=0x7f61b8048000 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 msgr2=0x55f9e36fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f61c002bf60 tx=0x7f61c0049520 comp rx=0 tx=0).stop 2024-02-16T10:32:00.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c509b640 1 -- 172.21.15.138:0/358049911 reap_dead start 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 shutdown_connections 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/358049911 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36f5f30 0x55f9e36fcca0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 >> 172.21.15.138:0/358049911 conn(0x55f9e36f0ab0 msgr2=0x55f9e36f1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 shutdown_connections 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/358049911 wait complete. 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 msgr2=0x7f60a0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 0x7f60a0036770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61b8024000 tx=0x7f61b8023f90 comp rx=0 tx=0).stop 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 msgr2=0x55f9e36e93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55f9e36cf8f0 tx=0x7f61c00188f0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 shutdown_connections 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60a00342b0 0x7f60a0036770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/2708443234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e36e8f90 0x55f9e36e93b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 >> 172.21.15.138:0/2708443234 conn(0x55f9e36ddda0 msgr2=0x55f9e36de8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 shutdown_connections 2024-02-16T10:32:00.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/2708443234 wait complete. 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 msgr2=0x55f9e36d5500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 0x55f9e36d5500 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 msgr2=0x55f9e36daa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 0x55f9e36daa30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 msgr2=0x7f60ac036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 0x7f60ac036770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0ad000 tx=0x7f61bc0a5040 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 msgr2=0x55f9e36ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f61b8001ee0 tx=0x7f61b8000ee0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 shutdown_connections 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55f9e36d71d0 0x55f9e36daa30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55f9e35e1cd0 0x55f9e36d5500 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f60ac0342b0 0x7f60ac036770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 --2- 172.21.15.138:0/1176361338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9e35dd7d0 0x55f9e36ce810 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 >> 172.21.15.138:0/1176361338 conn(0x55f9e3550ef0 msgr2=0x55f9e36c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 shutdown_connections 2024-02-16T10:32:00.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.559+0000 7f61c7d81980 1 -- 172.21.15.138:0/1176361338 wait complete. 2024-02-16T10:32:00.574 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-02-16T10:32:00.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-02-16T10:32:00.575 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-02-16T10:32:00.654 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:00.655 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:00.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa91720980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cf984accd0 0x55cf984af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa91720980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cf983f2b50 con 0x55cf984a87d0 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa91720980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cf983b9d30 con 0x55cf984accd0 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa8ea3a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55cf984accd0 0x55cf984af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa8f23b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55cf984a87d0 0x55cf984a8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40388/0 (socket says 172.21.15.138:40388) 2024-02-16T10:32:00.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa8f23b640 1 -- 172.21.15.138:0/2038972673 learned_addr learned my addr 172.21.15.138:0/2038972673 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:32:00.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa8ea3a640 1 -- 172.21.15.138:0/2038972673 >> v1:172.21.15.107:6789/0 conn(0x55cf984a87d0 legacy=0x55cf984a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.651+0000 7faa8ea3a640 1 -- 172.21.15.138:0/2038972673 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf984b0610 con 0x55cf984accd0 2024-02-16T10:32:00.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/2038972673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984accd0 0x55cf984af0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7faa8400a480 tx=0x7faa8401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50e5b538ee5ddba server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa8e239640 1 -- 172.21.15.138:0/2038972673 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa840ab540 con 0x55cf984accd0 2024-02-16T10:32:00.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa8e239640 1 -- 172.21.15.138:0/2038972673 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840ab6a0 con 0x55cf984accd0 2024-02-16T10:32:00.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa8e239640 1 -- 172.21.15.138:0/2038972673 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa840ab960 con 0x55cf984accd0 2024-02-16T10:32:00.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 -- 172.21.15.138:0/2038972673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984accd0 msgr2=0x55cf984af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 --2- 172.21.15.138:0/2038972673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984accd0 0x55cf984af0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7faa8400a480 tx=0x7faa8401b280 comp rx=0 tx=0).stop 2024-02-16T10:32:00.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 -- 172.21.15.138:0/2038972673 shutdown_connections 2024-02-16T10:32:00.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 --2- 172.21.15.138:0/2038972673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984accd0 0x55cf984af0c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 -- 172.21.15.138:0/2038972673 >> 172.21.15.138:0/2038972673 conn(0x55cf9841bef0 msgr2=0x55cf9841c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 -- 172.21.15.138:0/2038972673 shutdown_connections 2024-02-16T10:32:00.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.655+0000 7faa91720980 1 -- 172.21.15.138:0/2038972673 wait complete. 2024-02-16T10:32:00.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.671+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.671+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.671+0000 7faa91720980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.671+0000 7faa91720980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf983b6fc0 con 0x55cf984a87d0 2024-02-16T10:32:00.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36592/0 (socket says 172.21.15.138:36592) 2024-02-16T10:32:00.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 -- 172.21.15.138:0/2566142667 learned_addr learned my addr 172.21.15.138:0/2566142667 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 -- 172.21.15.138:0/2566142667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84005d30 con 0x55cf984a87d0 2024-02-16T10:32:00.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 --2- 172.21.15.138:0/2566142667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7faa80001c90 tx=0x7faa8000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28236019b4914d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7fa97d60a640 1 -- 172.21.15.138:0/2566142667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8000e690 con 0x55cf984a87d0 2024-02-16T10:32:00.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7fa97d60a640 1 -- 172.21.15.138:0/2566142667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000e7f0 con 0x55cf984a87d0 2024-02-16T10:32:00.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7fa97d60a640 1 -- 172.21.15.138:0/2566142667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8000eaf0 con 0x55cf984a87d0 2024-02-16T10:32:00.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- 172.21.15.138:0/2566142667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 msgr2=0x55cf98592900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 --2- 172.21.15.138:0/2566142667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7faa80001c90 tx=0x7faa8000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- 172.21.15.138:0/2566142667 shutdown_connections 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 --2- 172.21.15.138:0/2566142667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98592900 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- 172.21.15.138:0/2566142667 >> 172.21.15.138:0/2566142667 conn(0x55cf9841bef0 msgr2=0x55cf9858e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- 172.21.15.138:0/2566142667 shutdown_connections 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- 172.21.15.138:0/2566142667 wait complete. 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa91720980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf983b27a0 con 0x55cf984a87d0 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36600/0 (socket says 172.21.15.138:36600) 2024-02-16T10:32:00.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 -- 172.21.15.138:0/302588267 learned_addr learned my addr 172.21.15.138:0/302588267 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.675+0000 7faa8f23b640 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf983f2b50 con 0x55cf984a87d0 2024-02-16T10:32:00.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8f23b640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7faa80001ee0 tx=0x7faa80000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 -- 172.21.15.138:0/302588267 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8001f070 con 0x55cf984a87d0 2024-02-16T10:32:00.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf98599d50 con 0x55cf984a87d0 2024-02-16T10:32:00.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 -- 172.21.15.138:0/302588267 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80018830 con 0x55cf984a87d0 2024-02-16T10:32:00.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 -- 172.21.15.138:0/302588267 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa80018ad0 con 0x55cf984a87d0 2024-02-16T10:32:00.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf9859a200 con 0x55cf984a87d0 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 -- 172.21.15.138:0/302588267 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa8000a040 con 0x55cf984a87d0 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 0x7fa9740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7fa97be07640 1 -- 172.21.15.138:0/302588267 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7faa80049940 con 0x55cf984a87d0 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 0x7fa9740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 0x55cf985a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985a0a40 con 0x55cf984accd0 2024-02-16T10:32:00.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 0x55cf985a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 0x7fa9740367c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa840ad000 tx=0x7faa840a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 0x55cf985a0500 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8fa3c640 1 -- 172.21.15.138:0/302588267 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf984accd0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985a0e00 con 0x55cf984accd0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa8fa3c640 1 -- 172.21.15.138:0/302588267 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf984accd0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.679+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985a26b0 con 0x55cf984accd0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 -- 172.21.15.138:0/302588267 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf984accd0 2024-02-16T10:32:00.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985a18b0 con 0x55cf984accd0 2024-02-16T10:32:00.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 -- 172.21.15.138:0/302588267 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf984accd0 2024-02-16T10:32:00.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 0x55cf985a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985a6040 con 0x55cf985a21d0 2024-02-16T10:32:00.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8f23b640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 0x55cf985a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8f23b640 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 0x55cf985a5a30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8f23b640 1 -- 172.21.15.138:0/302588267 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faa80014070 con 0x55cf985a21d0 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9834af20 con 0x55cf985b3f70 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36608/0 (socket says 172.21.15.138:36608) 2024-02-16T10:32:00.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 -- 172.21.15.138:0/383377034 learned_addr learned my addr 172.21.15.138:0/383377034 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 -- 172.21.15.138:0/383377034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf985b48d0 con 0x55cf985b3f70 2024-02-16T10:32:00.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55cf9859a8f0 tx=0x7faa880188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7fa979602640 1 -- 172.21.15.138:0/383377034 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8801d070 con 0x55cf985b3f70 2024-02-16T10:32:00.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7fa979602640 1 -- 172.21.15.138:0/383377034 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88014580 con 0x55cf985b3f70 2024-02-16T10:32:00.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf985b4b20 con 0x55cf985b3f70 2024-02-16T10:32:00.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7fa979602640 1 -- 172.21.15.138:0/383377034 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa88014860 con 0x55cf985b3f70 2024-02-16T10:32:00.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.683+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf985b5670 con 0x55cf985b3f70 2024-02-16T10:32:00.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa979602640 1 -- 172.21.15.138:0/383377034 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa88020020 con 0x55cf985b3f70 2024-02-16T10:32:00.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa979602640 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 0x7fa9680367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa979602640 1 -- 172.21.15.138:0/383377034 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7faa8804b2f0 con 0x55cf985b3f70 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8f23b640 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 0x7fa9680367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf9833e790 con 0x55cf985c0f10 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8f23b640 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 0x7fa9680367c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cf985a12f0 tx=0x7faa80047b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36616/0 (socket says 172.21.15.138:36616) 2024-02-16T10:32:00.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8fa3c640 1 -- 172.21.15.138:0/3788406568 learned_addr learned my addr 172.21.15.138:0/3788406568 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8fa3c640 1 -- 172.21.15.138:0/3788406568 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf985c1900 con 0x55cf985c0f10 2024-02-16T10:32:00.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/3788406568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faa88049570 tx=0x7faa8802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3561ed650aca0840 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa972ffd640 1 -- 172.21.15.138:0/3788406568 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8803f030 con 0x55cf985c0f10 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa972ffd640 1 -- 172.21.15.138:0/3788406568 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88016440 con 0x55cf985c0f10 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7fa972ffd640 1 -- 172.21.15.138:0/3788406568 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa880149c0 con 0x55cf985c0f10 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- 172.21.15.138:0/3788406568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 msgr2=0x55cf985c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 --2- 172.21.15.138:0/3788406568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7faa88049570 tx=0x7faa8802bf40 comp rx=0 tx=0).stop 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- 172.21.15.138:0/3788406568 shutdown_connections 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 --2- 172.21.15.138:0/3788406568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c1330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- 172.21.15.138:0/3788406568 >> 172.21.15.138:0/3788406568 conn(0x55cf985bba40 msgr2=0x55cf985bc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- 172.21.15.138:0/3788406568 shutdown_connections 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.687+0000 7faa91720980 1 -- 172.21.15.138:0/3788406568 wait complete. 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 Processor -- start 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 -- start start 2024-02-16T10:32:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf985c8180 con 0x55cf985c0f10 2024-02-16T10:32:00.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8fa3c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36620/0 (socket says 172.21.15.138:36620) 2024-02-16T10:32:00.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 learned_addr learned my addr 172.21.15.138:0/231416088 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf985b5670 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faa88049570 tx=0x7faa88049500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 -- 172.21.15.138:0/231416088 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa88032070 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf985c8380 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 -- 172.21.15.138:0/231416088 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88048300 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 -- 172.21.15.138:0/231416088 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faa8802b940 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf985c8810 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 -- 172.21.15.138:0/231416088 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7faa88042070 con 0x55cf985c0f10 2024-02-16T10:32:00.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa9580342b0 0x7fa958036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7fa9717fa640 1 -- 172.21.15.138:0/231416088 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7faa88040070 con 0x55cf985c0f10 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8f23b640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa9580342b0 0x7fa958036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf985d3360 0x55cf985d5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d5f70 con 0x55cf985d3360 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf985d3360 0x55cf985d5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.691+0000 7faa8f23b640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa9580342b0 0x7fa958036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa80047fd0 tx=0x7faa8003b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf985d3360 0x55cf985d5820 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 realm 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d6360 con 0x55cf985d3360 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d6bb0 con 0x55cf985d3360 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d6f10 con 0x55cf985d3360 2024-02-16T10:32:00.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d6850 con 0x55cf985d3360 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 20 searching for the correct realm 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cf985d9160 0x55cf985db5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dbc80 con 0x55cf985d9160 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cf985d9160 0x55cf985db5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cf985d9160 0x55cf985db5b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8fa3c640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faa88014070 0x7faa8803b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8f23b640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faa88014070 0x7faa8803b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8f23b640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faa88014070 0x7faa8803b4a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8f23b640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faa80039030 0x7faa800490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.695+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faa80039030 0x7faa800490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faa80039030 0x7faa800490b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.699+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.703+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa88014070 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d9160 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x7faa80039030 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.707+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa88053040 con 0x55cf985d3360 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faa840da080 con 0x7faa88014070 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:32:00.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d7c40 con 0x55cf985d3360 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d7ff0 con 0x55cf985d3360 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d7ff0 con 0x7faa88014070 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 zone default found 2024-02-16T10:32:00.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 4 Realm: () 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 zonegroup default 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985d88c0 con 0x7faa80039030 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985ddb40 con 0x55cf985d9160 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985ddfa0 con 0x55cf985d9160 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 started sync module instance, tier type = 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.711+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dcfd0 con 0x7faa88014070 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350102874928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dd7d0 con 0x7faa88014070 2024-02-16T10:32:00.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dea70 con 0x55cf985d3360 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350102874928] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350102876976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dee20 con 0x55cf985d3360 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.715+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985df7d0 con 0x55cf985d9160 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350102876976] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350102881632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985df790 con 0x55cf985d9160 2024-02-16T10:32:00.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e0190 con 0x7faa88014070 2024-02-16T10:32:00.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350102887664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e09e0 con 0x7faa88014070 2024-02-16T10:32:00.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e1400 con 0x55cf985d3360 2024-02-16T10:32:00.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.719+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350102881632] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350102887664] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350102889792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985df2f0 con 0x55cf985d3360 2024-02-16T10:32:00.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e1c50 con 0x7faa80039030 2024-02-16T10:32:00.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350102889792] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350102892256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e1b60 con 0x7faa80039030 2024-02-16T10:32:00.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.723+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e2500 con 0x7faa80039030 2024-02-16T10:32:00.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.727+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.727+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350102892256] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.727+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350102896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e2960 con 0x7faa80039030 2024-02-16T10:32:00.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.727+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e1700 con 0x7faa80039030 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350102896640] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350102897856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e28e0 con 0x7faa80039030 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=0 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=1 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=2 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=3 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=4 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=5 2024-02-16T10:32:00.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=6 2024-02-16T10:32:00.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350102897856] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 20 add_watcher() i=7 2024-02-16T10:32:00.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 2 all 8 watchers are set, enabling cache 2024-02-16T10:32:00.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e63b0 con 0x55cf985d3360 2024-02-16T10:32:00.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.731+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350102900448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985e3870 con 0x55cf985d3360 2024-02-16T10:32:00.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350102900448] v33'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7fa945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:00.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 5 note: GC not initialized 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7fa944fe1640 20 reqs_thread_entry: start 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 init_complete bucket index max shards: 11 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 Filter name: none 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7fa8be7fc640 20 reqs_thread_entry: start 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x55cf985d3360 2024-02-16T10:32:00.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:32:00.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x7faa80039030 2024-02-16T10:32:00.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7fa945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:00.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.735+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350102900448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x55cf985d3360 2024-02-16T10:32:00.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94350102900448] v33'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350102874928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x7faa88014070 2024-02-16T10:32:00.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94350102874928] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa91720980 20 remove_watcher() i=0 2024-02-16T10:32:00.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa91720980 2 removed watcher, disabling cache 2024-02-16T10:32:00.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.739+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350102876976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x55cf985d3360 2024-02-16T10:32:00.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94350102876976] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 20 remove_watcher() i=1 2024-02-16T10:32:00.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350102881632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x55cf985d9160 2024-02-16T10:32:00.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa8fa3c640 1 -- 172.21.15.138:0/231416088 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94350102881632] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa8800a4d0 con 0x55cf985d9160 2024-02-16T10:32:00.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 20 remove_watcher() i=2 2024-02-16T10:32:00.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350102887664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x7faa88014070 2024-02-16T10:32:00.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa8f23b640 1 -- 172.21.15.138:0/231416088 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94350102887664] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa80014070 con 0x7faa88014070 2024-02-16T10:32:00.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 20 remove_watcher() i=3 2024-02-16T10:32:00.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.743+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350102889792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x55cf985d3360 2024-02-16T10:32:00.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94350102889792] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x55cf985d3360 2024-02-16T10:32:00.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa91720980 20 remove_watcher() i=4 2024-02-16T10:32:00.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350102892256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x7faa80039030 2024-02-16T10:32:00.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94350102892256] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa91720980 20 remove_watcher() i=5 2024-02-16T10:32:00.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.747+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350102896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf98607c60 con 0x7faa80039030 2024-02-16T10:32:00.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94350102896640] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 20 remove_watcher() i=6 2024-02-16T10:32:00.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350102897856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55cf985dd330 con 0x7faa80039030 2024-02-16T10:32:00.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94350102897856] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faa840ab810 con 0x7faa80039030 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 20 remove_watcher() i=7 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faa80039030 msgr2=0x7faa800490b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7faa80039030 0x7faa800490b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf985d3360 msgr2=0x55cf985d5820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf985d3360 0x55cf985d5820 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faa88014070 msgr2=0x7faa8803b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7faa88014070 0x7faa8803b4a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cf985d9160 msgr2=0x55cf985db5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.751+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55cf985d9160 0x55cf985db5b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa9580342b0 msgr2=0x7fa958036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa9580342b0 0x7fa958036770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa80047fd0 tx=0x7faa8003b000 comp rx=0 tx=0).stop 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 msgr2=0x55cf985c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa8ea3a640 1 -- 172.21.15.138:0/231416088 reap_dead start 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faa88049570 tx=0x7faa88049500 comp rx=0 tx=0).stop 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 shutdown_connections 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/231416088 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985c0f10 0x55cf985c7c40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 >> 172.21.15.138:0/231416088 conn(0x55cf985bba40 msgr2=0x55cf985bc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 shutdown_connections 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/231416088 wait complete. 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 msgr2=0x7fa9680367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 0x7fa9680367c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55cf985a12f0 tx=0x7faa80047b50 comp rx=0 tx=0).stop 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 msgr2=0x55cf985b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55cf9859a8f0 tx=0x7faa880188f0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 shutdown_connections 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa968034300 0x7fa9680367c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/383377034 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf985b3f70 0x55cf985b4390 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 >> 172.21.15.138:0/383377034 conn(0x55cf985a8d80 msgr2=0x55cf985a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 shutdown_connections 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/383377034 wait complete. 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 msgr2=0x55cf985a0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 0x55cf985a0500 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 msgr2=0x55cf985a5a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 0x55cf985a5a30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 msgr2=0x7fa9740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 0x7fa9740367c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa840ad000 tx=0x7faa840a5040 comp rx=0 tx=0).stop 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 msgr2=0x55cf98599810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7faa80001ee0 tx=0x7faa80000ee0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 shutdown_connections 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55cf985a21d0 0x55cf985a5a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55cf984accd0 0x55cf985a0500 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa974034300 0x7fa9740367c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 --2- 172.21.15.138:0/302588267 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55cf984a87d0 0x55cf98599810 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 >> 172.21.15.138:0/302588267 conn(0x55cf9841bef0 msgr2=0x55cf9858cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 shutdown_connections 2024-02-16T10:32:00.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.755+0000 7faa91720980 1 -- 172.21.15.138:0/302588267 wait complete. 2024-02-16T10:32:00.770 INFO:teuthology.orchestra.run.smithi138.stdout:{"entries":[],"summary":[]} 2024-02-16T10:32:00.770 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-02-16T10:32:00.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T10:32:00.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-02-16T10:32:00.770 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-02-16T10:32:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb51d08980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556313c047e0 0x556313c04bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb51d08980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556313b4eb60 con 0x556313c05100 2024-02-16T10:32:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb51d08980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x556313b15d30 con 0x556313c047e0 2024-02-16T10:32:00.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb4f823640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556313c047e0 0x556313c04bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb4f823640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x556313c047e0 0x556313c04bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36622/0 (socket says 172.21.15.138:36622) 2024-02-16T10:32:00.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb4f823640 1 -- 172.21.15.138:0/2214002796 learned_addr learned my addr 172.21.15.138:0/2214002796 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb4f823640 1 -- 172.21.15.138:0/2214002796 >> v1:172.21.15.107:6789/0 conn(0x556313c05100 legacy=0x556313c05ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.843+0000 7ffb4f823640 1 -- 172.21.15.138:0/2214002796 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313c062e0 con 0x556313c047e0 2024-02-16T10:32:00.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2214002796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313c04bc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a4e0 tx=0x7ffb4801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90487c3cccb55a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb4e821640 1 -- 172.21.15.138:0/2214002796 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480aa540 con 0x556313c047e0 2024-02-16T10:32:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb4e821640 1 -- 172.21.15.138:0/2214002796 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480a6070 con 0x556313c047e0 2024-02-16T10:32:00.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb4e821640 1 -- 172.21.15.138:0/2214002796 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480aa850 con 0x556313c047e0 2024-02-16T10:32:00.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 -- 172.21.15.138:0/2214002796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 msgr2=0x556313c04bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2214002796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313c04bc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a4e0 tx=0x7ffb4801b090 comp rx=0 tx=0).stop 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 -- 172.21.15.138:0/2214002796 shutdown_connections 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2214002796 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313c04bc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 -- 172.21.15.138:0/2214002796 >> 172.21.15.138:0/2214002796 conn(0x556313b77f00 msgr2=0x556313b78310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 -- 172.21.15.138:0/2214002796 shutdown_connections 2024-02-16T10:32:00.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.847+0000 7ffb51d08980 1 -- 172.21.15.138:0/2214002796 wait complete. 2024-02-16T10:32:00.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb51d08980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb51d08980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313b12fc0 con 0x556313c047e0 2024-02-16T10:32:00.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb4f823640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb4f823640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36624/0 (socket says 172.21.15.138:36624) 2024-02-16T10:32:00.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.863+0000 7ffb4f823640 1 -- 172.21.15.138:0/3700215621 learned_addr learned my addr 172.21.15.138:0/3700215621 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 -- 172.21.15.138:0/3700215621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4800a1c0 con 0x556313c047e0 2024-02-16T10:32:00.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 --2- 172.21.15.138:0/3700215621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffb48017ca0 tx=0x7ffb480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5d4a60840a55f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffa3de0b640 1 -- 172.21.15.138:0/3700215621 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480aa700 con 0x556313c047e0 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffa3de0b640 1 -- 172.21.15.138:0/3700215621 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480aa860 con 0x556313c047e0 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffa3de0b640 1 -- 172.21.15.138:0/3700215621 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480aab40 con 0x556313c047e0 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- 172.21.15.138:0/3700215621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 msgr2=0x556313ceee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3700215621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffb48017ca0 tx=0x7ffb480033b0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- 172.21.15.138:0/3700215621 shutdown_connections 2024-02-16T10:32:00.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3700215621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313ceee40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- 172.21.15.138:0/3700215621 >> 172.21.15.138:0/3700215621 conn(0x556313b77f00 msgr2=0x556313cea9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- 172.21.15.138:0/3700215621 shutdown_connections 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- 172.21.15.138:0/3700215621 wait complete. 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb51d08980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313b0e7a0 con 0x556313c047e0 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36632/0 (socket says 172.21.15.138:36632) 2024-02-16T10:32:00.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 -- 172.21.15.138:0/3221555133 learned_addr learned my addr 172.21.15.138:0/3221555133 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313c062e0 con 0x556313c047e0 2024-02-16T10:32:00.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.867+0000 7ffb4f823640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801b930 tx=0x7ffb48017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 -- 172.21.15.138:0/3221555133 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480bd580 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 -- 172.21.15.138:0/3221555133 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480bd6e0 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556313cf6110 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 -- 172.21.15.138:0/3221555133 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb480bd980 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556313cf6560 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 -- 172.21.15.138:0/3221555133 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb480c6030 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 0x7ffa380367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffa37fff640 1 -- 172.21.15.138:0/3221555133 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffb480e4750 con 0x556313c047e0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb4f022640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 0x7ffa380367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 0x556313cfc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313cfce00 con 0x556313c05100 2024-02-16T10:32:00.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 0x556313cfc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb4f022640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 0x7ffa380367c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb38001e20 tx=0x7ffb380013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 0x556313cfc8c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 -- 172.21.15.138:0/3221555133 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb400083f0 con 0x556313c05100 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313cfd1a0 con 0x556313c05100 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 -- 172.21.15.138:0/3221555133 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffb400083f0 con 0x556313c05100 2024-02-16T10:32:00.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313cfea50 con 0x556313c05100 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 -- 172.21.15.138:0/3221555133 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7ffb400083f0 con 0x556313c05100 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313cfdc50 con 0x556313c05100 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb50024640 1 -- 172.21.15.138:0/3221555133 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffb400083f0 con 0x556313c05100 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 0x556313d01dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.871+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d023e0 con 0x556313cfe570 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb4f823640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 0x556313d01dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb4f823640 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 0x556313d01dd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb4f823640 1 -- 172.21.15.138:0/3221555133 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ffb480bdb70 con 0x556313cfe570 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313aa6f20 con 0x556313d10350 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36644/0 (socket says 172.21.15.138:36644) 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb50024640 1 -- 172.21.15.138:0/2469268970 learned_addr learned my addr 172.21.15.138:0/2469268970 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb50024640 1 -- 172.21.15.138:0/2469268970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313d10cb0 con 0x556313d10350 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb50024640 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x556313cf6cb0 tx=0x7ffb4000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffa357fa640 1 -- 172.21.15.138:0/2469268970 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4000f040 con 0x556313d10350 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffa357fa640 1 -- 172.21.15.138:0/2469268970 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40019550 con 0x556313d10350 2024-02-16T10:32:00.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffa357fa640 1 -- 172.21.15.138:0/2469268970 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb40019810 con 0x556313d10350 2024-02-16T10:32:00.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556313d10f00 con 0x556313d10350 2024-02-16T10:32:00.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.875+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556313d11a50 con 0x556313d10350 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa357fa640 1 -- 172.21.15.138:0/2469268970 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb40019970 con 0x556313d10350 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa357fa640 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 0x7ffa28036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa357fa640 1 -- 172.21.15.138:0/2469268970 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffb4004b5c0 con 0x556313d10350 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 0x7ffa28036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 0x7ffa28036810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x556313cfd690 tx=0x7ffb480e29e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313a9a790 con 0x556313d1d240 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36650/0 (socket says 172.21.15.138:36650) 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb50024640 1 -- 172.21.15.138:0/277918545 learned_addr learned my addr 172.21.15.138:0/277918545 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb50024640 1 -- 172.21.15.138:0/277918545 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313d1dc30 con 0x556313d1d240 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb50024640 1 --2- 172.21.15.138:0/277918545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffb40049870 tx=0x7ffb4002af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde861238ee4f485 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa2effd640 1 -- 172.21.15.138:0/277918545 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb40048070 con 0x556313d1d240 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa2effd640 1 -- 172.21.15.138:0/277918545 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4003a200 con 0x556313d1d240 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffa2effd640 1 -- 172.21.15.138:0/277918545 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb4003b580 con 0x556313d1d240 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- 172.21.15.138:0/277918545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 msgr2=0x556313d1d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:00.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 --2- 172.21.15.138:0/277918545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ffb40049870 tx=0x7ffb4002af40 comp rx=0 tx=0).stop 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- 172.21.15.138:0/277918545 shutdown_connections 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 --2- 172.21.15.138:0/277918545 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d1d660 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- 172.21.15.138:0/277918545 >> 172.21.15.138:0/277918545 conn(0x556313d17e10 msgr2=0x556313d18cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- 172.21.15.138:0/277918545 shutdown_connections 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.879+0000 7ffb51d08980 1 -- 172.21.15.138:0/277918545 wait complete. 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 Processor -- start 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 -- start start 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313d244d0 con 0x556313d1d240 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb50024640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36666/0 (socket says 172.21.15.138:36666) 2024-02-16T10:32:00.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 learned_addr learned my addr 172.21.15.138:0/2539714282 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313d11a50 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb50024640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ffb40048710 tx=0x7ffb400497d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 -- 172.21.15.138:0/2539714282 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb40048070 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556313d246d0 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 -- 172.21.15.138:0/2539714282 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400481f0 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 -- 172.21.15.138:0/2539714282 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb400484d0 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556313d24b60 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 -- 172.21.15.138:0/2539714282 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb40017a50 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa180342b0 0x7ffa18036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffa2d7fa640 1 -- 172.21.15.138:0/2539714282 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffb40036d60 con 0x556313d1d240 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa180342b0 0x7ffa18036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313d2f610 0x556313d31ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d32220 con 0x556313d2f610 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb4f022640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313d2f610 0x556313d31ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.883+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa180342b0 0x7ffa18036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb480a3b60 tx=0x7ffb480e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313d2f610 0x556313d31ad0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 realm 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d2ea70 con 0x556313d2f610 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:32:00.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d32ca0 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d33520 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d33880 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 20 searching for the correct realm 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556313d35940 0x556313d37e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb50024640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556313d35940 0x556313d37e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb50024640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556313d35940 0x556313d37e00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb50024640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb40035070 0x7ffb400078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb40035070 0x7ffb400078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb40035070 0x7ffb400078e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f823640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffb480f3040 0x7ffb480e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.887+0000 7ffb4f022640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffb480f3040 0x7ffb480e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:00.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffb480f3040 0x7ffb480e59c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.891+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40012070 con 0x556313d35940 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.895+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d35940 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb480f3040 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x556313d2f610 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.899+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d384d0 con 0x7ffb40035070 2024-02-16T10:32:00.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d34ed0 con 0x556313d2f610 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d346f0 con 0x556313d2f610 2024-02-16T10:32:00.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d38910 con 0x7ffb40035070 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 zone default found 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 4 Realm: () 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 zonegroup default 2024-02-16T10:32:00.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d38c70 con 0x7ffb480f3040 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3aed0 con 0x556313d35940 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3b230 con 0x556313d35940 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:00.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 started sync module instance, tier type = 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.903+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3a4a0 con 0x7ffb40035070 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93884022759424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3b230 con 0x7ffb40035070 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3bba0 con 0x556313d2f610 2024-02-16T10:32:00.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93884022759424] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93884022765312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3bfc0 con 0x556313d2f610 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.907+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3c930 con 0x556313d35940 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93884022765312] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93884022766640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3c930 con 0x556313d35940 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3d2a0 con 0x7ffb40035070 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93884022771200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3d6c0 con 0x7ffb40035070 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3e120 con 0x556313d2f610 2024-02-16T10:32:00.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93884022766640] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.911+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93884022771200] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93884022768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3d220 con 0x556313d2f610 2024-02-16T10:32:00.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3e970 con 0x7ffb480f3040 2024-02-16T10:32:00.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93884022768784] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93884022774800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3d220 con 0x7ffb480f3040 2024-02-16T10:32:00.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.915+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3ee90 con 0x7ffb480f3040 2024-02-16T10:32:00.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93884022774800] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93884022778224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3ee50 con 0x7ffb480f3040 2024-02-16T10:32:00.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3f7c0 con 0x7ffb480f3040 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93884022778224] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93884022776592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d3f7c0 con 0x7ffb480f3040 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=0 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=1 2024-02-16T10:32:00.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=2 2024-02-16T10:32:00.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=3 2024-02-16T10:32:00.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=4 2024-02-16T10:32:00.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=5 2024-02-16T10:32:00.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.919+0000 7ffb51d08980 20 add_watcher() i=6 2024-02-16T10:32:00.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93884022776592] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 20 add_watcher() i=7 2024-02-16T10:32:00.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 2 all 8 watchers are set, enabling cache 2024-02-16T10:32:00.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d42bb0 con 0x556313d2f610 2024-02-16T10:32:00.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93884022781168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d400c0 con 0x556313d2f610 2024-02-16T10:32:00.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93884022781168] v33'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffa05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:00.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:00.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:00.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.923+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4b200 con 0x556313d2f610 2024-02-16T10:32:00.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.927+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.927+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4b6a0 con 0x7ffb480f3040 2024-02-16T10:32:00.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.927+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.927+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4bb40 con 0x556313d35940 2024-02-16T10:32:00.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d49280 con 0x556313d2f610 2024-02-16T10:32:00.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d49250 con 0x7ffb40035070 2024-02-16T10:32:00.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'74 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.931+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4c880 con 0x556313d35940 2024-02-16T10:32:00.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.935+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.935+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4cdb0 con 0x556313d2f610 2024-02-16T10:32:00.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.935+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.935+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4d250 con 0x7ffb480f3040 2024-02-16T10:32:00.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.939+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'50 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.939+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4c880 con 0x7ffb40035070 2024-02-16T10:32:00.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.939+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.939+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4d420 con 0x556313d35940 2024-02-16T10:32:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.943+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.943+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4d8c0 con 0x7ffb40035070 2024-02-16T10:32:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.943+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'75 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.943+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48240 con 0x7ffb480f3040 2024-02-16T10:32:00.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.947+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'34 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.947+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb40035070 2024-02-16T10:32:00.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.947+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.947+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb480f3040 2024-02-16T10:32:00.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'56 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d2f610 2024-02-16T10:32:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'70 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.951+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb40035070 2024-02-16T10:32:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.955+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'76 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.955+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.955+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.955+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d2f610 2024-02-16T10:32:00.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d2f610 2024-02-16T10:32:00.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'71 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.959+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb40035070 2024-02-16T10:32:00.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.963+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.963+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.963+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.963+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.967+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb480f3040 2024-02-16T10:32:00.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.971+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.971+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.971+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.971+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb480f3040 2024-02-16T10:32:00.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.975+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'51 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.975+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x556313d35940 2024-02-16T10:32:00.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.975+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'72 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.975+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb480f3040 2024-02-16T10:32:00.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.979+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'57 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.979+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d48830 con 0x7ffb40035070 2024-02-16T10:32:00.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.979+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.979+0000 7ffa04fe1640 20 reqs_thread_entry: start 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 init_complete bucket index max shards: 11 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 Filter name: none 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ff97e7fc640 20 reqs_thread_entry: start 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4a6e0 con 0x556313d2f610 2024-02-16T10:32:00.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(94 foo [call out=48b,read 0~358 out=358b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+481 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=358 2024-02-16T10:32:00.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-02-16T10:32:00.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-02-16T10:32:00.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:32:00.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d4a6a0 con 0x7ffb40035070 2024-02-16T10:32:00.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 : miss 2024-02-16T10:32:00.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:00.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:96 8.13 8:ccca42c9:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d69c00 con 0x7ffb480f3040 2024-02-16T10:32:00.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(96 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv9 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=352 2024-02-16T10:32:00.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 info.flags=0x17 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 to cache LRU end 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 4.2e 4:749d69d9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de70c0 con 0x556313d35940 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(97 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.983+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:98 4.18 4:1a0ac780:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de70c0 con 0x7ffb40035070 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(98 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:99 4.23 4:c4188c1f:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de70c0 con 0x7ffb480f3040 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(99 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:100 4.29 4:97dacb26:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x556313d35940 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(100 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:101 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x556313d2f610 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(101 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:102 4.7 4:e21b3d1d:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x7ffb480f3040 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(102 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:103 4.13 4:cb4660fa:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x7ffb40035070 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(103 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.987+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:104 4.10 4:09961ec5:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x556313d35940 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(104 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:105 4.16 4:6a800811:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x556313d35940 2024-02-16T10:32:00.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(105 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:00.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:106 4.1a 4:58af2b64:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x7ffb40035070 2024-02-16T10:32:00.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(106 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:107 4.17 4:e8345c60:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de7100 con 0x7ffb480f3040 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(107 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 20 get_obj_state: octx=0x7ffb480c0820 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556313de50e8 s->prefetch_data=0 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:108 3.36s0 3:6c8cf594:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de6020 con 0x7ffb40035070 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(108 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 10 manifest: total_size = 6 2024-02-16T10:32:00.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 20 get_obj_state: setting s->obj_tag to 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.4157548376662507599 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 20 get_obj_state: octx=0x7ffb480c0820 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x556313de50e8 s->prefetch_data=0 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 20 prepare_atomic_modification: state is not atomic. state=0x556313de50e8 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 20 bucket index object: :.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.991+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:109 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de6aa0 con 0x556313d2f610 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(109 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:00.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:110 3.36s0 3:6c8cf594:::56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de6aa0 con 0x7ffb40035070 2024-02-16T10:32:01.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(110 56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:111 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d6e4c0 con 0x556313d2f610 2024-02-16T10:32:01.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb51d08980 20 list_objects_ordered: starting attempt 1 2024-02-16T10:32:01.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb51d08980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-02-16T10:32:01.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.995+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:112 4.2e 4:749d69d9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d6e4c0 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:113 4.18 4:1a0ac780:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d6e4c0 con 0x7ffb40035070 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:114 4.23 4:c4188c1f:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d74c40 con 0x7ffb480f3040 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:115 4.29 4:97dacb26:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d77610 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:116 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d79f00 con 0x556313d2f610 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:117 4.7 4:e21b3d1d:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7cb10 con 0x7ffb480f3040 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(112 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:118 4.13 4:cb4660fa:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7f5a0 con 0x7ffb40035070 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(115 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:119 4.10 4:09961ec5:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d79f00 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(113 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:120 4.16 4:6a800811:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7cb10 con 0x556313d35940 2024-02-16T10:32:01.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:121 4.1a 4:58af2b64:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7fa40 con 0x7ffb40035070 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:122 4.17 4:e8345c60:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d824c0 con 0x7ffb480f3040 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(118 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(120 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(114 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(117 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(119 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(121 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(122 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(111 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffa2e7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-02-16T10:32:01.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(116 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7])"; uploads.size()=0; is_truncated=0 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:123 4.2e 4:749d69d9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c590 con 0x556313d35940 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:124 4.18 4:1a0ac780:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d764f0 con 0x7ffb40035070 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:125 4.23 4:c4188c1f:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d76890 con 0x7ffb480f3040 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:126 4.29 4:97dacb26:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d81f10 con 0x556313d35940 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:127 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c590 con 0x556313d2f610 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:128 4.7 4:e21b3d1d:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d81f10 con 0x7ffb480f3040 2024-02-16T10:32:01.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:129 4.13 4:cb4660fa:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d6e2c0 con 0x7ffb40035070 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:130 4.10 4:09961ec5:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7f930 con 0x556313d35940 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:131 4.16 4:6a800811:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d81f10 con 0x556313d35940 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:132 4.1a 4:58af2b64:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7f930 con 0x7ffb40035070 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:133 4.17 4:e8345c60:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d81f10 con 0x7ffb480f3040 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(124 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(123 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(126 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(130 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(127 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(125 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(128 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(129 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(133 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(132 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(131 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:00.999+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(134 foo.buckets [call] v33'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 20 rados_obj.operate() r=0 bl.length=165 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 10 removing default.rgw.meta+root+myfoo from cache 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93884023055184 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb480f3040 2024-02-16T10:32:01.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== watch-notify(notify (1) cookie 93884022778224 notify 141733920807 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7ffb38009050 con 0x7ffb480f3040 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffa2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 93884022778224 notifier 4780 bl.length()=149 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(136 notify.6 [notify cookie 93884023055184 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.003+0000 7ffa2effd640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ffa14003d60 con 0x7ffb480f3040 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== watch-notify(notify_complete (2) cookie 93884023055184 notify 141733920807 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556313b4eb60 con 0x7ffb480f3040 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb40035070 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(138 myfoo [call,call,delete] v33'49 uv49 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb51d08980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 from cache 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7, ofs0, ns] 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:139 7.d 7:b4812045:::notify.4:head [notify cookie 93884023055184 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d2f610 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== watch-notify(notify (1) cookie 93884022768784 notify 141733920801 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x556313b4eb60 con 0x556313d2f610 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffa2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 93884022768784 notifier 4780 bl.length()=206 2024-02-16T10:32:01.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(139 notify.4 [notify cookie 93884023055184 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffa2e7fc640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff984003320 con 0x556313d2f610 2024-02-16T10:32:01.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(140 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== watch-notify(notify_complete (2) cookie 93884023055184 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffb38003b80 con 0x556313d2f610 2024-02-16T10:32:01.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.007+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:141 8.13 8:ccca42c9:root::.bucket.meta.myfoo%3a56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb480f3040 2024-02-16T10:32:01.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(141 .bucket.meta.myfoo:56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 [call,call,delete] v33'12 uv12 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:142 4.2e 4:749d69d9:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d35940 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:143 4.18 4:1a0ac780:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:144 4.23 4:c4188c1f:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d68450 con 0x7ffb480f3040 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:145 4.29 4:97dacb26:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d35940 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:146 4.3c 4:3f22c534:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d690f0 con 0x556313d2f610 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:147 4.7 4:e21b3d1d:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d68450 con 0x7ffb480f3040 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:148 4.13 4:cb4660fa:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb40035070 2024-02-16T10:32:01.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:149 4.10 4:09961ec5:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x556313d35940 2024-02-16T10:32:01.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:150 4.16 4:6a800811:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d35940 2024-02-16T10:32:01.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:151 4.1a 4:58af2b64:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.011+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:152 4.17 4:e8345c60:::.dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d68450 con 0x7ffb480f3040 2024-02-16T10:32:01.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(143 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.1 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(145 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.3 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(147 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.5 [delete] v33'9 uv9 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(142 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.0 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(146 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.4 [delete] v33'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(151 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.9 [delete] v33'13 uv13 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(150 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.8 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(149 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.7 [delete] v33'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== osd_op_reply(148 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.6 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(152 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.10 [delete] v33'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(144 .dir.56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7.2 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb51d08980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 : miss 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb51d08980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.015+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:153 6.0 6:066531d3:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb480f3040 2024-02-16T10:32:01.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(153 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 info.flags=0x0 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 10 adding default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 to cache LRU end 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 10 removing default.rgw.log++pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 from cache 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7, ofs0, ns] 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 93884023464736 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== watch-notify(notify (1) cookie 93884022771200 notify 141733920790 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7ffb48108060 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(154 notify.3 [notify cookie 93884023464736 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffa2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 93884022771200 notifier 4780 bl.length()=203 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffa2effd640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ffa14003d60 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== watch-notify(notify_complete (2) cookie 93884023464736 notify 141733920790 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556313cf6560 con 0x7ffb40035070 2024-02-16T10:32:01.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:156 6.0 6:066531d3:::pubsub..bucket.myfoo%2f56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb480f3040 2024-02-16T10:32:01.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(156 pubsub..bucket.myfoo/56ab4e6d-2e06-4b6b-ad50-3371060fac3a.4227.7 [delete] v33'58 uv43 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.019+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(157 foo.buckets [call] v33'50 uv50 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb51d08980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 93884023464736 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 43 ==== watch-notify(notify (1) cookie 93884022771200 notify 141733920791 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x556313cf6560 con 0x7ffb40035070 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffa2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 93884022771200 notifier 4780 bl.length()=170 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 44 ==== osd_op_reply(158 notify.3 [notify cookie 93884023464736 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffa2effd640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ffa14003d60 con 0x7ffb40035070 2024-02-16T10:32:01.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 45 ==== watch-notify(notify_complete (2) cookie 93884023464736 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556313cf6110 con 0x7ffb40035070 2024-02-16T10:32:01.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 46 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.023+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb480f3040 2024-02-16T10:32:01.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb51d08980 10 removing email index: foo@foo.com 2024-02-16T10:32:01.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-02-16T10:32:01.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 93884023464736 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 47 ==== watch-notify(notify (1) cookie 93884022771200 notify 141733920792 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x556313cf6110 con 0x7ffb40035070 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 48 ==== osd_op_reply(161 notify.3 [notify cookie 93884023464736 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffa2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 93884022771200 notifier 4780 bl.length()=162 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffa2e7fc640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff984003320 con 0x7ffb40035070 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 49 ==== watch-notify(notify_complete (2) cookie 93884023464736 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x556313c062e0 con 0x7ffb40035070 2024-02-16T10:32:01.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 50 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.027+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x556313d2f610 2024-02-16T10:32:01.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(163 foo@foo.com [delete] v33'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb51d08980 10 removing user buckets index 2024-02-16T10:32:01.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-02-16T10:32:01.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 93884023464736 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb480f3040 2024-02-16T10:32:01.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== watch-notify(notify (1) cookie 93884022774800 notify 141733920808 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7ffb38003b80 con 0x7ffb480f3040 2024-02-16T10:32:01.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffa2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 93884022774800 notifier 4780 bl.length()=160 2024-02-16T10:32:01.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(164 notify.5 [notify cookie 93884023464736 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffa2e7fc640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff984003320 con 0x7ffb480f3040 2024-02-16T10:32:01.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== watch-notify(notify_complete (2) cookie 93884023464736 notify 141733920808 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffb3801f4b0 con 0x7ffb480f3040 2024-02-16T10:32:01.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 46 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.031+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x7ffb40035070 2024-02-16T10:32:01.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 51 ==== osd_op_reply(166 foo.buckets [delete] v33'51 uv51 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb51d08980 10 removing user index: foo 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb51d08980 10 removing default.rgw.meta+users.uid+foo from cache 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb51d08980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 93884023464736 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== watch-notify(notify (1) cookie 93884022768784 notify 141733920802 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7ffb3801f4b0 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(167 notify.4 [notify cookie 93884023464736 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffa2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 93884022768784 notifier 4780 bl.length()=152 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffa2e7fc640 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7ff984003320 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== watch-notify(notify_complete (2) cookie 93884023464736 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ffb3801f640 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.035+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313de5ad0 con 0x556313d2f610 2024-02-16T10:32:01.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.039+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(169 foo [call,call,delete] v33'19 uv19 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.039+0000 7ffa05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:01.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.039+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93884022781168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d2f610 2024-02-16T10:32:01.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93884022781168] v33'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93884022759424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb40035070 2024-02-16T10:32:01.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 52 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93884022759424] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb51d08980 20 remove_watcher() i=0 2024-02-16T10:32:01.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb51d08980 2 removed watcher, disabling cache 2024-02-16T10:32:01.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.043+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93884022765312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d2f610 2024-02-16T10:32:01.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93884022765312] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb51d08980 20 remove_watcher() i=1 2024-02-16T10:32:01.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93884022766640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d35940 2024-02-16T10:32:01.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb50024640 1 -- 172.21.15.138:0/2539714282 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93884022766640] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb40061040 con 0x556313d35940 2024-02-16T10:32:01.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb51d08980 20 remove_watcher() i=2 2024-02-16T10:32:01.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.047+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93884022771200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb40035070 2024-02-16T10:32:01.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb4f823640 1 -- 172.21.15.138:0/2539714282 <== osd.2 v2:172.21.15.138:6815/3134970710 53 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93884022771200] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb480bdb70 con 0x7ffb40035070 2024-02-16T10:32:01.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb51d08980 20 remove_watcher() i=3 2024-02-16T10:32:01.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93884022768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x556313d2f610 2024-02-16T10:32:01.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93884022768784] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x556313d2f610 2024-02-16T10:32:01.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb51d08980 20 remove_watcher() i=4 2024-02-16T10:32:01.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.051+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93884022774800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb480f3040 2024-02-16T10:32:01.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 47 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93884022774800] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb51d08980 20 remove_watcher() i=5 2024-02-16T10:32:01.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93884022778224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb480f3040 2024-02-16T10:32:01.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 48 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93884022778224] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb51d08980 20 remove_watcher() i=6 2024-02-16T10:32:01.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.055+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93884022776592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556313d7c480 con 0x7ffb480f3040 2024-02-16T10:32:01.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 <== osd.0 v2:172.21.15.107:6800/1630367885 49 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93884022776592] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffb380105b0 con 0x7ffb480f3040 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 20 remove_watcher() i=7 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffb480f3040 msgr2=0x7ffb480e59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7ffb480f3040 0x7ffb480e59c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313d2f610 msgr2=0x556313d31ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313d2f610 0x556313d31ad0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb40035070 msgr2=0x7ffb400078e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7ffb40035070 0x7ffb400078e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556313d35940 msgr2=0x556313d37e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x556313d35940 0x556313d37e00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa180342b0 msgr2=0x7ffa18036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa180342b0 0x7ffa18036770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb480a3b60 tx=0x7ffb480e0000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb4f022640 1 -- 172.21.15.138:0/2539714282 reap_dead start 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 msgr2=0x556313d23f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ffb40048710 tx=0x7ffb400497d0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 shutdown_connections 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2539714282 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d1d240 0x556313d23f90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 >> 172.21.15.138:0/2539714282 conn(0x556313d17e10 msgr2=0x556313d18cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 shutdown_connections 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2539714282 wait complete. 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 msgr2=0x7ffa28036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 0x7ffa28036810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x556313cfd690 tx=0x7ffb480e29e0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 msgr2=0x556313d10770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x556313cf6cb0 tx=0x7ffb4000e8d0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 shutdown_connections 2024-02-16T10:32:01.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa28034350 0x7ffa28036810 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/2469268970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313d10350 0x556313d10770 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 >> 172.21.15.138:0/2469268970 conn(0x556313d05160 msgr2=0x556313d05c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 shutdown_connections 2024-02-16T10:32:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/2469268970 wait complete. 2024-02-16T10:32:01.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 msgr2=0x556313cfc8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 0x556313cfc8c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 msgr2=0x556313d01dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 0x556313d01dd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 msgr2=0x7ffa380367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 0x7ffa380367c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb38001e20 tx=0x7ffb380013a0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 msgr2=0x556313cf5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.059+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801b930 tx=0x7ffb48017e30 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 shutdown_connections 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x556313cfe570 0x556313d01dd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x556313c05100 0x556313cfc8c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffa38034300 0x7ffa380367c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 --2- 172.21.15.138:0/3221555133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556313c047e0 0x556313cf5bd0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 >> 172.21.15.138:0/3221555133 conn(0x556313b77f00 msgr2=0x556313ce94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 shutdown_connections 2024-02-16T10:32:01.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.063+0000 7ffb51d08980 1 -- 172.21.15.138:0/3221555133 wait complete. 2024-02-16T10:32:01.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-02-16T10:32:01.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-02-16T10:32:01.082 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-02-16T10:32:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.166 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fc989980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b27d04dba0 0x55b27d04df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fc989980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b27cf97b50 con 0x55b27d04ea60 2024-02-16T10:32:01.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fc989980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b27cf5ed30 con 0x55b27d04dba0 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fa4a4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b27d04dba0 0x55b27d04df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fa4a4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55b27d04dba0 0x55b27d04df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36674/0 (socket says 172.21.15.138:36674) 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fa4a4640 1 -- 172.21.15.138:0/3238429470 learned_addr learned my addr 172.21.15.138:0/3238429470 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35f9ca3640 1 --1- 172.21.15.138:0/3238429470 >> v1:172.21.15.107:6789/0 conn(0x55b27d04ea60 0x55b27d04ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40408/0 (socket says 172.21.15.138:40408) 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fa4a4640 1 -- 172.21.15.138:0/3238429470 >> v1:172.21.15.107:6789/0 conn(0x55b27d04ea60 legacy=0x55b27d04ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.163+0000 7f35fa4a4640 1 -- 172.21.15.138:0/3238429470 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27d04e670 con 0x55b27d04dba0 2024-02-16T10:32:01.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/3238429470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d04df80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f35f400a5c0 tx=0x7f35f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c6fcdf6aed882c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35f94a2640 1 -- 172.21.15.138:0/3238429470 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40aa470 con 0x55b27d04dba0 2024-02-16T10:32:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35f94a2640 1 -- 172.21.15.138:0/3238429470 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f40aa5d0 con 0x55b27d04dba0 2024-02-16T10:32:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35f94a2640 1 -- 172.21.15.138:0/3238429470 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40aa890 con 0x55b27d04dba0 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 -- 172.21.15.138:0/3238429470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 msgr2=0x55b27d04df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 --2- 172.21.15.138:0/3238429470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d04df80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f35f400a5c0 tx=0x7f35f401b340 comp rx=0 tx=0).stop 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 -- 172.21.15.138:0/3238429470 shutdown_connections 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 --2- 172.21.15.138:0/3238429470 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d04df80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 -- 172.21.15.138:0/3238429470 >> 172.21.15.138:0/3238429470 conn(0x55b27cfc0f40 msgr2=0x55b27cfc1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 -- 172.21.15.138:0/3238429470 shutdown_connections 2024-02-16T10:32:01.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.167+0000 7f35fc989980 1 -- 172.21.15.138:0/3238429470 wait complete. 2024-02-16T10:32:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fc989980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fc989980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27cf5bfc0 con 0x55b27d04dba0 2024-02-16T10:32:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fa4a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fa4a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36676/0 (socket says 172.21.15.138:36676) 2024-02-16T10:32:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fa4a4640 1 -- 172.21.15.138:0/3624423328 learned_addr learned my addr 172.21.15.138:0/3624423328 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fa4a4640 1 -- 172.21.15.138:0/3624423328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4005df0 con 0x55b27d04dba0 2024-02-16T10:32:01.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.183+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/3624423328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f35f401b380 tx=0x7f35f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f807d4cfb4fe41 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e8608640 1 -- 172.21.15.138:0/3624423328 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40aa9b0 con 0x55b27d04dba0 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e8608640 1 -- 172.21.15.138:0/3624423328 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f40aab30 con 0x55b27d04dba0 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e8608640 1 -- 172.21.15.138:0/3624423328 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40aae10 con 0x55b27d04dba0 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/3624423328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 msgr2=0x55b27d137cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 --2- 172.21.15.138:0/3624423328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f35f401b380 tx=0x7f35f4003030 comp rx=0 tx=0).stop 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/3624423328 shutdown_connections 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 --2- 172.21.15.138:0/3624423328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d137cc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/3624423328 >> 172.21.15.138:0/3624423328 conn(0x55b27cfc0f40 msgr2=0x55b27d133850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/3624423328 shutdown_connections 2024-02-16T10:32:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/3624423328 wait complete. 2024-02-16T10:32:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27cf577a0 con 0x55b27d04dba0 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fa4a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fa4a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36692/0 (socket says 172.21.15.138:36692) 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fa4a4640 1 -- 172.21.15.138:0/457362595 learned_addr learned my addr 172.21.15.138:0/457362595 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fa4a4640 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27d04e670 con 0x55b27d04dba0 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f35f40aa5a0 tx=0x7f35f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e6e05640 1 -- 172.21.15.138:0/457362595 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40cb070 con 0x55b27d04dba0 2024-02-16T10:32:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e6e05640 1 -- 172.21.15.138:0/457362595 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f40c6690 con 0x55b27d04dba0 2024-02-16T10:32:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b27d13efd0 con 0x55b27d04dba0 2024-02-16T10:32:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f34e6e05640 1 -- 172.21.15.138:0/457362595 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35f40c6930 con 0x55b27d04dba0 2024-02-16T10:32:01.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.187+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b27d13f480 con 0x55b27d04dba0 2024-02-16T10:32:01.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f34e6e05640 1 -- 172.21.15.138:0/457362595 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35f40c6b20 con 0x55b27d04dba0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f34e6e05640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 0x7f34e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f34e6e05640 1 -- 172.21.15.138:0/457362595 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f35f40e4a00 con 0x55b27d04dba0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 0x7f34e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 0x55b27d145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d145c70 con 0x55b27d04ea60 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 0x55b27d145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 0x7f34e0036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f35e4001e50 tx=0x7f35e40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 0x55b27d145730 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 -- 172.21.15.138:0/457362595 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d04ea60 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d146010 con 0x55b27d04ea60 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 -- 172.21.15.138:0/457362595 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d04ea60 2024-02-16T10:32:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d147890 con 0x55b27d04ea60 2024-02-16T10:32:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 -- 172.21.15.138:0/457362595 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d04ea60 2024-02-16T10:32:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d146a90 con 0x55b27d04ea60 2024-02-16T10:32:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35faca5640 1 -- 172.21.15.138:0/457362595 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d04ea60 2024-02-16T10:32:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 0x55b27d14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d14b270 con 0x55b27d1473b0 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 0x55b27d14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 0x55b27d14ac10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.191+0000 7f35fa4a4640 1 -- 172.21.15.138:0/457362595 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f35f40cd070 con 0x55b27d1473b0 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27ceeff20 con 0x55b27d159210 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36702/0 (socket says 172.21.15.138:36702) 2024-02-16T10:32:01.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35faca5640 1 -- 172.21.15.138:0/856584570 learned_addr learned my addr 172.21.15.138:0/856584570 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35faca5640 1 -- 172.21.15.138:0/856584570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27d159b70 con 0x55b27d159210 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35faca5640 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55b27d13f630 tx=0x7f35ec018a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 -- 172.21.15.138:0/856584570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec01d070 con 0x55b27d159210 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b27d159dc0 con 0x55b27d159210 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 -- 172.21.15.138:0/856584570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec014450 con 0x55b27d159210 2024-02-16T10:32:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 -- 172.21.15.138:0/856584570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec0146f0 con 0x55b27d159210 2024-02-16T10:32:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b27d15a910 con 0x55b27d159210 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 -- 172.21.15.138:0/856584570 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35ec020020 con 0x55b27d159210 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 0x7f34d4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f34dffff640 1 -- 172.21.15.138:0/856584570 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f35ec04b240 con 0x55b27d159210 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 0x7f34d4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.195+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 0x7f34d4036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b27d1464d0 tx=0x7f35f40aaa50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27cee3790 con 0x55b27d166190 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36712/0 (socket says 172.21.15.138:36712) 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 -- 172.21.15.138:0/1006121988 learned_addr learned my addr 172.21.15.138:0/1006121988 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 -- 172.21.15.138:0/1006121988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27d166b80 con 0x55b27d166190 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 --2- 172.21.15.138:0/1006121988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0494c0 tx=0x7f35ec0480e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eaa902fe52c4a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f34ddffb640 1 -- 172.21.15.138:0/1006121988 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec02b480 con 0x55b27d166190 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f34ddffb640 1 -- 172.21.15.138:0/1006121988 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec03b050 con 0x55b27d166190 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f34ddffb640 1 -- 172.21.15.138:0/1006121988 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec012560 con 0x55b27d166190 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- 172.21.15.138:0/1006121988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 msgr2=0x55b27d1665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 --2- 172.21.15.138:0/1006121988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0494c0 tx=0x7f35ec0480e0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- 172.21.15.138:0/1006121988 shutdown_connections 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 --2- 172.21.15.138:0/1006121988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d1665b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- 172.21.15.138:0/1006121988 >> 172.21.15.138:0/1006121988 conn(0x55b27d160d10 msgr2=0x55b27d161bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- 172.21.15.138:0/1006121988 shutdown_connections 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- 172.21.15.138:0/1006121988 wait complete. 2024-02-16T10:32:01.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 Processor -- start 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- start start 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35fc989980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27d16d460 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36716/0 (socket says 172.21.15.138:36716) 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 learned_addr learned my addr 172.21.15.138:0/332091248 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.199+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27d15a910 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35faca5640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f35ec04b1b0 tx=0x7f35ec049450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 -- 172.21.15.138:0/332091248 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec033070 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b27d16d660 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 -- 172.21.15.138:0/332091248 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec02b720 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 -- 172.21.15.138:0/332091248 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35ec049ae0 con 0x55b27d166190 2024-02-16T10:32:01.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b27d16daf0 con 0x55b27d166190 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 -- 172.21.15.138:0/332091248 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f35ec049c40 con 0x55b27d166190 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34c40342b0 0x7f34c4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f34cbfff640 1 -- 172.21.15.138:0/332091248 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f35ec038d20 con 0x55b27d166190 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34c40342b0 0x7f34c4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d178620 0x55b27d17aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17b1c0 con 0x55b27d178620 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d178620 0x55b27d17aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34c40342b0 0x7f34c4036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f4005940 tx=0x7f35f40e8000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d178620 0x55b27d17aa70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 realm 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d177b90 con 0x55b27d178620 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:32:01.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17bc40 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.203+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17c0d0 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17c970 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+875 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 20 rados_obj.operate() r=0 bl.length=875 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 20 searching for the correct realm 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b27d17e690 0x55b27d180a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x55b27d17e690 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35faca5640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b27d17e690 0x55b27d180a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35faca5640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b27d17e690 0x55b27d180a80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35faca5640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35ec014850 0x7f35ec02d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x7f35ec014850 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35ec014850 0x7f35ec02d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35ec014850 0x7f35ec02d440 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fa4a4640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35f4009040 0x7f35f40bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x7f35f4009040 2024-02-16T10:32:01.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35f4009040 0x7f35f40bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35f4009040 0x7f35f40bc5d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.207+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d180fc0 con 0x7f35f4009040 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35f4009040 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.211+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35f4009040 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.215+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35f4009040 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35f4009040 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35f40cd070 con 0x7f35ec014850 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d17e690 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35f4009040 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x55b27d178620 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f35e402d040 con 0x7f35ec014850 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17d2a0 con 0x55b27d178620 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.219+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17cf20 con 0x55b27d178620 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d17db70 con 0x7f35ec014850 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados_obj.operate() r=0 bl.length=398 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 zone default found 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 4 Realm: () 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:32:01.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 zonegroup default 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1813b0 con 0x7f35f4009040 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d183230 con 0x55b27d17e690 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d183590 con 0x55b27d17e690 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 started sync module instance, tier type = 2024-02-16T10:32:01.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:32:01.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1827b0 con 0x7f35ec014850 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225091273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d183590 con 0x7f35ec014850 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.223+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d183f40 con 0x55b27d178620 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.227+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225091273488] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.227+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.227+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225091275664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1842f0 con 0x55b27d178620 2024-02-16T10:32:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.227+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d184ca0 con 0x55b27d17e690 2024-02-16T10:32:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225091275664] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225091279456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d184c60 con 0x55b27d17e690 2024-02-16T10:32:01.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d185660 con 0x7f35ec014850 2024-02-16T10:32:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225091285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d185eb0 con 0x7f35ec014850 2024-02-16T10:32:01.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1868a0 con 0x55b27d178620 2024-02-16T10:32:01.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225091279456] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.231+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225091285440] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225091289984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d185a10 con 0x55b27d178620 2024-02-16T10:32:01.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1870f0 con 0x7f35f4009040 2024-02-16T10:32:01.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225091291776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d187340 con 0x7f35f4009040 2024-02-16T10:32:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d187b40 con 0x7f35f4009040 2024-02-16T10:32:01.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.235+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225091289984] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225091291776] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225091292832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d187760 con 0x7f35f4009040 2024-02-16T10:32:01.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d187fa0 con 0x7f35f4009040 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225091292832] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225091293888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d188180 con 0x7f35f4009040 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=0 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=1 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=2 2024-02-16T10:32:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=3 2024-02-16T10:32:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=4 2024-02-16T10:32:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=5 2024-02-16T10:32:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.239+0000 7f35fc989980 20 add_watcher() i=6 2024-02-16T10:32:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225091293888] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 add_watcher() i=7 2024-02-16T10:32:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 2 all 8 watchers are set, enabling cache 2024-02-16T10:32:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d18b540 con 0x55b27d178620 2024-02-16T10:32:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225091297392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d188930 con 0x55b27d178620 2024-02-16T10:32:01.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225091297392] v33'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f34b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 5 note: GC not initialized 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f342b7fe640 20 reqs_thread_entry: start 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 init_complete bucket index max shards: 11 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 Filter name: none 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f34297fa640 20 reqs_thread_entry: start 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 rados->read ofs=0 len=0 2024-02-16T10:32:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1ace30 con 0x55b27d178620 2024-02-16T10:32:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.243+0000 7f35fc989980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:could not fetch user info: no user info saved 2024-02-16T10:32:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f34b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:01.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225091297392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x55b27d178620 2024-02-16T10:32:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94225091297392] v33'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225091273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x7f35ec014850 2024-02-16T10:32:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94225091273488] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fc989980 20 remove_watcher() i=0 2024-02-16T10:32:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fc989980 2 removed watcher, disabling cache 2024-02-16T10:32:01.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.247+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225091275664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x55b27d178620 2024-02-16T10:32:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94225091275664] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35fc989980 20 remove_watcher() i=1 2024-02-16T10:32:01.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225091279456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x55b27d17e690 2024-02-16T10:32:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35faca5640 1 -- 172.21.15.138:0/332091248 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94225091279456] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35ec00a4d0 con 0x55b27d17e690 2024-02-16T10:32:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35fc989980 20 remove_watcher() i=2 2024-02-16T10:32:01.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.251+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225091285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x7f35ec014850 2024-02-16T10:32:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35fa4a4640 1 -- 172.21.15.138:0/332091248 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94225091285440] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35f4105040 con 0x7f35ec014850 2024-02-16T10:32:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35fc989980 20 remove_watcher() i=3 2024-02-16T10:32:01.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225091289984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x55b27d178620 2024-02-16T10:32:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94225091289984] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x55b27d178620 2024-02-16T10:32:01.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35fc989980 20 remove_watcher() i=4 2024-02-16T10:32:01.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.255+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225091291776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x7f35f4009040 2024-02-16T10:32:01.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94225091291776] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35fc989980 20 remove_watcher() i=5 2024-02-16T10:32:01.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225091292832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x7f35f4009040 2024-02-16T10:32:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94225091292832] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35fc989980 20 remove_watcher() i=6 2024-02-16T10:32:01.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.259+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225091293888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b27d1acdf0 con 0x7f35f4009040 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94225091293888] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f35e400f6a0 con 0x7f35f4009040 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 20 remove_watcher() i=7 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35f4009040 msgr2=0x7f35f40bc5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7f35f4009040 0x7f35f40bc5d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d178620 msgr2=0x55b27d17aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d178620 0x55b27d17aa70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35ec014850 msgr2=0x7f35ec02d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f35ec014850 0x7f35ec02d440 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b27d17e690 msgr2=0x55b27d180a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55b27d17e690 0x55b27d180a80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34c40342b0 msgr2=0x7f34c4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34c40342b0 0x7f34c4036770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f35f4005940 tx=0x7f35f40e8000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 msgr2=0x55b27d16cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35f9ca3640 1 -- 172.21.15.138:0/332091248 reap_dead start 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f35ec04b1b0 tx=0x7f35ec049450 comp rx=0 tx=0).stop 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 shutdown_connections 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/332091248 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d166190 0x55b27d16cf20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 >> 172.21.15.138:0/332091248 conn(0x55b27d160d10 msgr2=0x55b27d161bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 shutdown_connections 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/332091248 wait complete. 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 msgr2=0x7f34d4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 0x7f34d4036770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b27d1464d0 tx=0x7f35f40aaa50 comp rx=0 tx=0).stop 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 msgr2=0x55b27d159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55b27d13f630 tx=0x7f35ec018a60 comp rx=0 tx=0).stop 2024-02-16T10:32:01.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 shutdown_connections 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34d40342b0 0x7f34d4036770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/856584570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d159210 0x55b27d159630 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 >> 172.21.15.138:0/856584570 conn(0x55b27d14e020 msgr2=0x55b27d14eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 shutdown_connections 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/856584570 wait complete. 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 msgr2=0x55b27d145730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 0x55b27d145730 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 msgr2=0x55b27d14ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 0x55b27d14ac10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 msgr2=0x7f34e0036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 0x7f34e0036770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f35e4001e50 tx=0x7f35e40013b0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 msgr2=0x55b27d13ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f35f40aa5a0 tx=0x7f35f40180e0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 shutdown_connections 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55b27d1473b0 0x55b27d14ac10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55b27d04ea60 0x55b27d145730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f34e00342b0 0x7f34e0036770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 --2- 172.21.15.138:0/457362595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55b27d04dba0 0x55b27d13ea90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 >> 172.21.15.138:0/457362595 conn(0x55b27cfc0f40 msgr2=0x55b27d132360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 shutdown_connections 2024-02-16T10:32:01.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.263+0000 7f35fc989980 1 -- 172.21.15.138:0/457362595 wait complete. 2024-02-16T10:32:01.280 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-02-16T10:32:01.280 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-02-16T10:32:01.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-02-16T10:32:01.281 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-02-16T10:32:01.358 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.358 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7d0cd5980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5605374d5e10 0x5605374d8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7d0cd5980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56053741bb50 con 0x560537443860 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7d0cd5980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605373e2d30 con 0x5605374d5e10 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7cdfef640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5605374d5e10 0x5605374d8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7ce7f0640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x560537443860 0x5605374d46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40410/0 (socket says 172.21.15.138:40410) 2024-02-16T10:32:01.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/2505353460 learned_addr learned my addr 172.21.15.138:0/2505353460 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:32:01.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7cdfef640 1 -- 172.21.15.138:0/2505353460 >> v1:172.21.15.107:6789/0 conn(0x560537443860 legacy=0x5605374d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.355+0000 7fe7cdfef640 1 -- 172.21.15.138:0/2505353460 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605374d9750 con 0x5605374d5e10 2024-02-16T10:32:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7cdfef640 1 --2- 172.21.15.138:0/2505353460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605374d5e10 0x5605374d8200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800a480 tx=0x7fe7b801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87f266185685ad5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7cd7ee640 1 -- 172.21.15.138:0/2505353460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80ab540 con 0x5605374d5e10 2024-02-16T10:32:01.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7cd7ee640 1 -- 172.21.15.138:0/2505353460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b80ab6a0 con 0x5605374d5e10 2024-02-16T10:32:01.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7cd7ee640 1 -- 172.21.15.138:0/2505353460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80ab960 con 0x5605374d5e10 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2505353460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605374d5e10 msgr2=0x5605374d8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2505353460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605374d5e10 0x5605374d8200 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800a480 tx=0x7fe7b801b280 comp rx=0 tx=0).stop 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2505353460 shutdown_connections 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2505353460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605374d5e10 0x5605374d8200 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2505353460 >> 172.21.15.138:0/2505353460 conn(0x5605374c9dd0 msgr2=0x5605374cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2505353460 shutdown_connections 2024-02-16T10:32:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.359+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2505353460 wait complete. 2024-02-16T10:32:01.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7d0cd5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7d0cd5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605373dffc0 con 0x560537443860 2024-02-16T10:32:01.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36728/0 (socket says 172.21.15.138:36728) 2024-02-16T10:32:01.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.375+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/1813615754 learned_addr learned my addr 172.21.15.138:0/1813615754 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/1813615754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8005d30 con 0x560537443860 2024-02-16T10:32:01.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 --2- 172.21.15.138:0/1813615754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001c90 tx=0x7fe7c000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db5159ec06b0a46 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bc608640 1 -- 172.21.15.138:0/1813615754 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c000e690 con 0x560537443860 2024-02-16T10:32:01.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bc608640 1 -- 172.21.15.138:0/1813615754 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000e7f0 con 0x560537443860 2024-02-16T10:32:01.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bc608640 1 -- 172.21.15.138:0/1813615754 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c000eaf0 con 0x560537443860 2024-02-16T10:32:01.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1813615754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 msgr2=0x5605375bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1813615754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001c90 tx=0x7fe7c000b6d0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1813615754 shutdown_connections 2024-02-16T10:32:01.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1813615754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375bb990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1813615754 >> 172.21.15.138:0/1813615754 conn(0x5605374c9dd0 msgr2=0x5605375b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1813615754 shutdown_connections 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1813615754 wait complete. 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605373db7a0 con 0x560537443860 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36730/0 (socket says 172.21.15.138:36730) 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/4123670724 learned_addr learned my addr 172.21.15.138:0/4123670724 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/4123670724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56053741bb50 con 0x560537443860 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7ce7f0640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001ee0 tx=0x7fe7c0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bae05640 1 -- 172.21.15.138:0/4123670724 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c001f070 con 0x560537443860 2024-02-16T10:32:01.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bae05640 1 -- 172.21.15.138:0/4123670724 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0018830 con 0x560537443860 2024-02-16T10:32:01.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605375c2e70 con 0x560537443860 2024-02-16T10:32:01.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.379+0000 7fe6bae05640 1 -- 172.21.15.138:0/4123670724 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c0018ad0 con 0x560537443860 2024-02-16T10:32:01.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605375c3320 con 0x560537443860 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560537373f20 con 0x5605375cfa00 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6bae05640 1 -- 172.21.15.138:0/4123670724 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7c000a040 con 0x560537443860 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36734/0 (socket says 172.21.15.138:36734) 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 -- 172.21.15.138:0/2124727549 learned_addr learned my addr 172.21.15.138:0/2124727549 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6bae05640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 0x7fe6b4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6bae05640 1 -- 172.21.15.138:0/4123670724 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe7c0049670 con 0x560537443860 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ce7f0640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 0x7fe6b4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 -- 172.21.15.138:0/2124727549 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605375d0360 con 0x5605375cfa00 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 --2- 172.21.15.138:0/2124727549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a430 tx=0x7fe7c800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569d15546b53c75e server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ce7f0640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 0x7fe6b4036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001440 tx=0x7fe7c000df70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6b8e01640 1 -- 172.21.15.138:0/2124727549 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c800f6e0 con 0x5605375cfa00 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6b8e01640 1 -- 172.21.15.138:0/2124727549 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800f860 con 0x5605375cfa00 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe6b8e01640 1 -- 172.21.15.138:0/2124727549 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c800fb40 con 0x5605375cfa00 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2124727549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 msgr2=0x5605375cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2124727549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a430 tx=0x7fe7c800a8f0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2124727549 shutdown_connections 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2124727549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375cfe20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2124727549 >> 172.21.15.138:0/2124727549 conn(0x5605374d5e10 msgr2=0x5605375cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2124727549 shutdown_connections 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2124727549 wait complete. 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7d0cd5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x560537367790 con 0x5605375cfa00 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36742/0 (socket says 172.21.15.138:36742) 2024-02-16T10:32:01.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.383+0000 7fe7ceff1640 1 -- 172.21.15.138:0/1418055914 learned_addr learned my addr 172.21.15.138:0/1418055914 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7ceff1640 1 -- 172.21.15.138:0/1418055914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c800a0e0 con 0x5605375cfa00 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7ceff1640 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5605375d07e0 tx=0x7fe7c8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 -- 172.21.15.138:0/1418055914 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c8010a20 con 0x5605375cfa00 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605375d6e70 con 0x5605375cfa00 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 -- 172.21.15.138:0/1418055914 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8010b80 con 0x5605375cfa00 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 -- 172.21.15.138:0/1418055914 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c801a480 con 0x5605375cfa00 2024-02-16T10:32:01.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605375d7300 con 0x5605375cfa00 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 -- 172.21.15.138:0/1418055914 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7c801a6f0 con 0x5605375cfa00 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 0x7fe6a8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe6b2ffd640 1 -- 172.21.15.138:0/1418055914 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe7c804a060 con 0x5605375cfa00 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7cdfef640 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 0x7fe6a8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 Processor -- start 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 -- start start 2024-02-16T10:32:01.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7cdfef640 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 0x7fe6a8036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ad000 tx=0x7fe7b80a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7d0cd5980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605375f0e90 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7ce7f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36754/0 (socket says 172.21.15.138:36754) 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.387+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/2646750210 learned_addr learned my addr 172.21.15.138:0/2646750210 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ce7f0640 1 -- 172.21.15.138:0/2646750210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605375f0fd0 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ce7f0640 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00224e0 tx=0x7fe7c00216a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 -- 172.21.15.138:0/2646750210 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c002d440 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 -- 172.21.15.138:0/2646750210 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c002d5a0 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605375f1930 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 -- 172.21.15.138:0/2646750210 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c00234f0 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605375f1930 con 0x5605375f0530 2024-02-16T10:32:01.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 -- 172.21.15.138:0/2646750210 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe7c0017c50 con 0x5605375f0530 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 0x7fe6040367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6937e6640 1 -- 172.21.15.138:0/2646750210 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe7c0016cb0 con 0x5605375f0530 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7cdfef640 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 0x7fe6040367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7cdfef640 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 0x7fe6040367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ab670 tx=0x7fe7b8005a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe6917e2640 20 reqs_thread_entry: start 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 0x5605375f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5605375c68f0 con 0x5605375f5510 2024-02-16T10:32:01.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ceff1640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 0x5605375f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ceff1640 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 0x5605375f7900 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ceff1640 1 -- 172.21.15.138:0/4123670724 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe7c8016020 con 0x5605375f5510 2024-02-16T10:32:01.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5605375f8ed0 con 0x5605375f5510 2024-02-16T10:32:01.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.391+0000 7fe7ceff1640 1 -- 172.21.15.138:0/4123670724 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fe7c8016020 con 0x5605375f5510 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 msgr2=0x7fe6a8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 0x7fe6a8036770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ad000 tx=0x7fe7b80a5040 comp rx=0 tx=0).stop 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 msgr2=0x5605375d6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5605375d07e0 tx=0x7fe7c8003380 comp rx=0 tx=0).stop 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 shutdown_connections 2024-02-16T10:32:01.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6a80342b0 0x7fe6a8036770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/1418055914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375cfa00 0x5605375d6930 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 >> 172.21.15.138:0/1418055914 conn(0x5605374d5e10 msgr2=0x5605375c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 shutdown_connections 2024-02-16T10:32:01.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/1418055914 wait complete. 2024-02-16T10:32:01.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 msgr2=0x7fe6040367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 0x7fe6040367c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ab670 tx=0x7fe7b8005a10 comp rx=0 tx=0).stop 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 msgr2=0x5605375f0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00224e0 tx=0x7fe7c00216a0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 shutdown_connections 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe604034300 0x7fe6040367c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/2646750210 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5605375f0530 0x5605375f0950 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 >> 172.21.15.138:0/2646750210 conn(0x5605375e5240 msgr2=0x5605375e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 shutdown_connections 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/2646750210 wait complete. 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 msgr2=0x5605375f7900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 0x5605375f7900 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 msgr2=0x7fe6b4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 0x7fe6b4036770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001440 tx=0x7fe7c000df70 comp rx=0 tx=0).stop 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 msgr2=0x5605375c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001ee0 tx=0x7fe7c0000ee0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 shutdown_connections 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5605375f5510 0x5605375f7900 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe6b40342b0 0x7fe6b4036770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 --2- 172.21.15.138:0/4123670724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560537443860 0x5605375c2930 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 >> 172.21.15.138:0/4123670724 conn(0x5605374c9dd0 msgr2=0x5605375b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 shutdown_connections 2024-02-16T10:32:01.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.395+0000 7fe7d0cd5980 1 -- 172.21.15.138:0/4123670724 wait complete. 2024-02-16T10:32:01.413 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:32:01.413 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:32:01.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-02-16T10:32:01.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-02-16T10:32:01.414 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-02-16T10:32:01.491 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.491 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09cc69980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55601ae3f490 0x55601ae3f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09cc69980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55601ad8cb40 con 0x55601ae3fdb0 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09cc69980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55601ad53d30 con 0x55601ae3f490 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09a784640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55601ae3f490 0x55601ae3f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09a784640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55601ae3f490 0x55601ae3f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36758/0 (socket says 172.21.15.138:36758) 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09a784640 1 -- 172.21.15.138:0/337898223 learned_addr learned my addr 172.21.15.138:0/337898223 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb099f83640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x55601ae3fdb0 0x55601ae407c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40426/0 (socket says 172.21.15.138:40426) 2024-02-16T10:32:01.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09a784640 1 -- 172.21.15.138:0/337898223 >> v1:172.21.15.107:6789/0 conn(0x55601ae3fdb0 legacy=0x55601ae407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.487+0000 7fb09a784640 1 -- 172.21.15.138:0/337898223 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601ae40ff0 con 0x55601ae3f490 2024-02-16T10:32:01.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09a784640 1 --2- 172.21.15.138:0/337898223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601ae3f870 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a7a0 tx=0x7fb09401d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4562249fc71d825f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb099782640 1 -- 172.21.15.138:0/337898223 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940a6720 con 0x55601ae3f490 2024-02-16T10:32:01.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb099782640 1 -- 172.21.15.138:0/337898223 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940a6880 con 0x55601ae3f490 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb099782640 1 -- 172.21.15.138:0/337898223 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940a6b40 con 0x55601ae3f490 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 -- 172.21.15.138:0/337898223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 msgr2=0x55601ae3f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 --2- 172.21.15.138:0/337898223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601ae3f870 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb09400a7a0 tx=0x7fb09401d800 comp rx=0 tx=0).stop 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 -- 172.21.15.138:0/337898223 shutdown_connections 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 --2- 172.21.15.138:0/337898223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601ae3f870 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 -- 172.21.15.138:0/337898223 >> 172.21.15.138:0/337898223 conn(0x55601ae3ad60 msgr2=0x55601ae3d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 -- 172.21.15.138:0/337898223 shutdown_connections 2024-02-16T10:32:01.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.491+0000 7fb09cc69980 1 -- 172.21.15.138:0/337898223 wait complete. 2024-02-16T10:32:01.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09cc69980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09cc69980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601ad50fc0 con 0x55601ae3f490 2024-02-16T10:32:01.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36770/0 (socket says 172.21.15.138:36770) 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09a784640 1 -- 172.21.15.138:0/3943155785 learned_addr learned my addr 172.21.15.138:0/3943155785 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09a784640 1 -- 172.21.15.138:0/3943155785 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09400a480 con 0x55601ae3f490 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.507+0000 7fb09a784640 1 --2- 172.21.15.138:0/3943155785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb09401b430 tx=0x7fb0940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd8545a09b5e309 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf88608640 1 -- 172.21.15.138:0/3943155785 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940bc070 con 0x55601ae3f490 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf88608640 1 -- 172.21.15.138:0/3943155785 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940a6b20 con 0x55601ae3f490 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf88608640 1 -- 172.21.15.138:0/3943155785 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940a6e00 con 0x55601ae3f490 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/3943155785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 msgr2=0x55601af28b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3943155785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb09401b430 tx=0x7fb0940033b0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/3943155785 shutdown_connections 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3943155785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af28b90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/3943155785 >> 172.21.15.138:0/3943155785 conn(0x55601ae3ad60 msgr2=0x55601af24720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/3943155785 shutdown_connections 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/3943155785 wait complete. 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af33d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601ad4c7a0 con 0x55601ae3f490 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af33d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af33d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36786/0 (socket says 172.21.15.138:36786) 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 learned_addr learned my addr 172.21.15.138:0/1421552102 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601ae40ff0 con 0x55601ae3f490 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af33d90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb09401b430 tx=0x7fb09401a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf86e05640 1 -- 172.21.15.138:0/1421552102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940bc050 con 0x55601ae3f490 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf86e05640 1 -- 172.21.15.138:0/1421552102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940c1480 con 0x55601ae3f490 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7faf86e05640 1 -- 172.21.15.138:0/1421552102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940a6ea0 con 0x55601ae3f490 2024-02-16T10:32:01.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55601af342d0 con 0x55601ae3f490 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55601af34780 con 0x55601ae3f490 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.511+0000 7fb09cc69980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601ace4f20 con 0x55601af40e70 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36790/0 (socket says 172.21.15.138:36790) 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 -- 172.21.15.138:0/1106179147 learned_addr learned my addr 172.21.15.138:0/1106179147 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf86e05640 1 -- 172.21.15.138:0/1421552102 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb0940ae440 con 0x55601ae3f490 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf86e05640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf800342b0 0x7faf80036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf86e05640 1 -- 172.21.15.138:0/1421552102 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb0940e3ed0 con 0x55601ae3f490 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 -- 172.21.15.138:0/1106179147 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601af417d0 con 0x55601af40e70 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf800342b0 0x7faf80036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 --2- 172.21.15.138:0/1106179147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00a440 tx=0x7fb08c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3728e8a1e0e1714 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf800342b0 0x7faf80036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0940aefd0 tx=0x7fb0940c9e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf84e01640 1 -- 172.21.15.138:0/1106179147 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb08c008850 con 0x55601af40e70 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf84e01640 1 -- 172.21.15.138:0/1106179147 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c0089d0 con 0x55601af40e70 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7faf84e01640 1 -- 172.21.15.138:0/1106179147 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb08c008cb0 con 0x55601af40e70 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- 172.21.15.138:0/1106179147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 msgr2=0x55601af41290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1106179147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00a440 tx=0x7fb08c00a900 comp rx=0 tx=0).stop 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- 172.21.15.138:0/1106179147 shutdown_connections 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1106179147 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af41290 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- 172.21.15.138:0/1106179147 >> 172.21.15.138:0/1106179147 conn(0x55601ae3fdb0 msgr2=0x55601af3c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- 172.21.15.138:0/1106179147 shutdown_connections 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- 172.21.15.138:0/1106179147 wait complete. 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09cc69980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601acd8790 con 0x55601af40e70 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36796/0 (socket says 172.21.15.138:36796) 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 -- 172.21.15.138:0/565113296 learned_addr learned my addr 172.21.15.138:0/565113296 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.515+0000 7fb09af85640 1 -- 172.21.15.138:0/565113296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c005cd0 con 0x55601af40e70 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09af85640 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55601af41c50 tx=0x7fb08c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 -- 172.21.15.138:0/565113296 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb08c013aa0 con 0x55601af40e70 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 -- 172.21.15.138:0/565113296 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c013c00 con 0x55601af40e70 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55601af48320 con 0x55601af40e70 2024-02-16T10:32:01.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 -- 172.21.15.138:0/565113296 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb08c013ea0 con 0x55601af40e70 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55601af48750 con 0x55601af40e70 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 -- 172.21.15.138:0/565113296 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb08c028460 con 0x55601af40e70 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 0x7faf740367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7faf7effd640 1 -- 172.21.15.138:0/565113296 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb08c049950 con 0x55601af40e70 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 Processor -- start 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09af85640 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 0x7faf740367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 -- start start 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09cc69980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601af62360 con 0x55601af61a00 2024-02-16T10:32:01.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09af85640 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 0x7faf740367c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb08c028880 tx=0x7fb08c0287b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09a784640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36810/0 (socket says 172.21.15.138:36810) 2024-02-16T10:32:01.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09a784640 1 -- 172.21.15.138:0/3269120095 learned_addr learned my addr 172.21.15.138:0/3269120095 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09a784640 1 -- 172.21.15.138:0/3269120095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601af624a0 con 0x55601af61a00 2024-02-16T10:32:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.519+0000 7fb09a784640 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb094005ca0 tx=0x7fb0940aeca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 -- 172.21.15.138:0/3269120095 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940de070 con 0x55601af61a00 2024-02-16T10:32:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 -- 172.21.15.138:0/3269120095 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940d3070 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55601af62d40 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 -- 172.21.15.138:0/3269120095 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0940caa30 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55601af631d0 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 -- 172.21.15.138:0/3269120095 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb0940e6020 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 0x7faedc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5efe5640 1 -- 172.21.15.138:0/3269120095 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb0940ead30 con 0x55601af61a00 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb099f83640 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 0x7faedc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7faf5cfe1640 20 reqs_thread_entry: start 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55601af66920 0x55601af68d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af69250 con 0x55601af66920 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb099f83640 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 0x7faedc036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb084000f70 tx=0x7fb084001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09af85640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55601af66920 0x55601af68d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09af85640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55601af66920 0x55601af68d10 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af695b0 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6a960 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.523+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af70830 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:NOTICE: set zone's realm_id= 2024-02-16T10:32:01.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55601af74860 0x55601af700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55601af74860 0x55601af700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55601af74860 0x55601af700c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940b5040 con 0x55601af74860 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09a784640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb0940cb060 0x7fb0940c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb099f83640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb0940cb060 0x7fb0940c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb099f83640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb0940cb060 0x7fb0940c1720 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb099f83640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb08400e8d0 0x7fb08400d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb08400e8d0 0x7fb08400d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb08400e8d0 0x7fb08400d320 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.527+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940b5040 con 0x55601af74860 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(17 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.531+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.535+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af74860 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb0940fc040 con 0x55601af74860 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09a784640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb08400e8d0 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08c024020 con 0x7fb08400e8d0 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x55601af66920 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6ad70 con 0x7fb0940cb060 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb099f83640 1 -- 172.21.15.138:0/1421552102 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb08400f600 con 0x7fb0940cb060 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af71e30 con 0x55601af66920 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6d930 con 0x55601af66920 2024-02-16T10:32:01.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.539+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [create,call version.set in=58b,writefull 0~1037 in=1037b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6fbf0 con 0x55601af66920 2024-02-16T10:32:01.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.543+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [create,call,writefull 0~1037] v33'4 uv4 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.543+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6dc90 con 0x55601af66920 2024-02-16T10:32:01.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.543+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.543+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55601af6dc90 con 0x55601af66920 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'5 uv2 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7fb08c024020 con 0x55601af66920 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 msgr2=0x7faf740367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 0x7faf740367c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb08c028880 tx=0x7fb08c0287b0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 msgr2=0x55601af47de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55601af41c50 tx=0x7fb08c003000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 shutdown_connections 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf74034300 0x7faf740367c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/565113296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af40e70 0x55601af47de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 >> 172.21.15.138:0/565113296 conn(0x55601ae3fdb0 msgr2=0x55601af3be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 shutdown_connections 2024-02-16T10:32:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/565113296 wait complete. 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 msgr2=0x7faedc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 0x7faedc036770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb084000f70 tx=0x7fb084001300 comp rx=0 tx=0).stop 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 msgr2=0x55601af61e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb094005ca0 tx=0x7fb0940aeca0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 shutdown_connections 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faedc0342b0 0x7faedc036770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/3269120095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601af61a00 0x55601af61e20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 >> 172.21.15.138:0/3269120095 conn(0x55601af56770 msgr2=0x55601af57190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 shutdown_connections 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/3269120095 wait complete. 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb08400e8d0 msgr2=0x7fb08400d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fb08400e8d0 0x7fb08400d320 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55601af66920 msgr2=0x55601af68d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55601af66920 0x55601af68d10 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb0940cb060 msgr2=0x7fb0940c1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7fb0940cb060 0x7fb0940c1720 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55601af74860 msgr2=0x55601af700c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x55601af74860 0x55601af700c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf800342b0 msgr2=0x7faf80036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7faf800342b0 0x7faf80036770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0940aefd0 tx=0x7fb0940c9e80 comp rx=0 tx=0).stop 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 msgr2=0x55601af33d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 --2- 172.21.15.138:0/1421552102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55601ae3f490 0x55601af33d90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb09401b430 tx=0x7fb09401a5a0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09af85640 1 -- 172.21.15.138:0/1421552102 reap_dead start 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 shutdown_connections 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 >> 172.21.15.138:0/1421552102 conn(0x55601ae3ad60 msgr2=0x55601af23230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 shutdown_connections 2024-02-16T10:32:01.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.547+0000 7fb09cc69980 1 -- 172.21.15.138:0/1421552102 wait complete. 2024-02-16T10:32:01.563 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:32:01.563 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:32:01.564 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-02-16T10:32:01.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-02-16T10:32:01.564 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-02-16T10:32:01.638 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcff9a7980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5619313a57c0 0x5619313a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcff9a7980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5619312efb40 con 0x5619313a60e0 2024-02-16T10:32:01.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcff9a7980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5619312b6d30 con 0x5619313a57c0 2024-02-16T10:32:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcfd4c2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5619313a57c0 0x5619313a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcfccc1640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5619313a60e0 0x5619313a6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40432/0 (socket says 172.21.15.138:40432) 2024-02-16T10:32:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcfccc1640 1 -- 172.21.15.138:0/32422416 learned_addr learned my addr 172.21.15.138:0/32422416 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:32:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcfd4c2640 1 -- 172.21.15.138:0/32422416 >> v1:172.21.15.107:6789/0 conn(0x5619313a60e0 legacy=0x5619313a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.635+0000 7efcfd4c2640 1 -- 172.21.15.138:0/32422416 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619313a72c0 con 0x5619313a57c0 2024-02-16T10:32:01.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/32422416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x5619313a5ba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a480 tx=0x7efcf001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e876cdec7dbb4c73 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efceffff640 1 -- 172.21.15.138:0/32422416 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00ab540 con 0x5619313a57c0 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efceffff640 1 -- 172.21.15.138:0/32422416 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00ab6a0 con 0x5619313a57c0 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efceffff640 1 -- 172.21.15.138:0/32422416 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00ab960 con 0x5619313a57c0 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 -- 172.21.15.138:0/32422416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 msgr2=0x5619313a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 --2- 172.21.15.138:0/32422416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x5619313a5ba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a480 tx=0x7efcf001b280 comp rx=0 tx=0).stop 2024-02-16T10:32:01.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 -- 172.21.15.138:0/32422416 shutdown_connections 2024-02-16T10:32:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 --2- 172.21.15.138:0/32422416 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x5619313a5ba0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 -- 172.21.15.138:0/32422416 >> 172.21.15.138:0/32422416 conn(0x561931318ee0 msgr2=0x5619313192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 -- 172.21.15.138:0/32422416 shutdown_connections 2024-02-16T10:32:01.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.639+0000 7efcff9a7980 1 -- 172.21.15.138:0/32422416 wait complete. 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.655+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.655+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619312b3fc0 con 0x5619313a57c0 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36828/0 (socket says 172.21.15.138:36828) 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 -- 172.21.15.138:0/2765043041 learned_addr learned my addr 172.21.15.138:0/2765043041 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 -- 172.21.15.138:0/2765043041 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0005d30 con 0x5619313a57c0 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/2765043041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcf0017e90 tx=0x7efcf0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c368fdf339afcb server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efbeb606640 1 -- 172.21.15.138:0/2765043041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf000a180 con 0x5619313a57c0 2024-02-16T10:32:01.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efbeb606640 1 -- 172.21.15.138:0/2765043041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf000a2e0 con 0x5619313a57c0 2024-02-16T10:32:01.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efbeb606640 1 -- 172.21.15.138:0/2765043041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00ab960 con 0x5619313a57c0 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- 172.21.15.138:0/2765043041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 msgr2=0x56193148fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 --2- 172.21.15.138:0/2765043041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcf0017e90 tx=0x7efcf0003030 comp rx=0 tx=0).stop 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- 172.21.15.138:0/2765043041 shutdown_connections 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 --2- 172.21.15.138:0/2765043041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x56193148fea0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- 172.21.15.138:0/2765043041 >> 172.21.15.138:0/2765043041 conn(0x561931318ee0 msgr2=0x56193148ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- 172.21.15.138:0/2765043041 shutdown_connections 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- 172.21.15.138:0/2765043041 wait complete. 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcff9a7980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619312af7a0 con 0x5619313a57c0 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36830/0 (socket says 172.21.15.138:36830) 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 -- 172.21.15.138:0/3984694961 learned_addr learned my addr 172.21.15.138:0/3984694961 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.659+0000 7efcfd4c2640 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619313a72c0 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efcf00b8040 tx=0x7efcf0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 -- 172.21.15.138:0/3984694961 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00abdd0 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 -- 172.21.15.138:0/3984694961 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00ca440 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561931497150 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 -- 172.21.15.138:0/3984694961 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00ca720 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561931497660 con 0x5619313a57c0 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x561931247f20 con 0x5619314a3d00 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfdcc3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfdcc3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36840/0 (socket says 172.21.15.138:36840) 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfdcc3640 1 -- 172.21.15.138:0/1167526335 learned_addr learned my addr 172.21.15.138:0/1167526335 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 -- 172.21.15.138:0/3984694961 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efcf00d3440 con 0x5619313a57c0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 0x7efbe4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe9e03640 1 -- 172.21.15.138:0/3984694961 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7efcf00e4530 con 0x5619313a57c0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 0x7efbe4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfdcc3640 1 -- 172.21.15.138:0/1167526335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619314a4660 con 0x5619314a3d00 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/1167526335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efcf800a440 tx=0x7efcf800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49537345e61d760c server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 0x7efbe4036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efcf00abfd0 tx=0x7efcf0009f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe37fe640 1 -- 172.21.15.138:0/1167526335 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf8008850 con 0x5619314a3d00 2024-02-16T10:32:01.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe37fe640 1 -- 172.21.15.138:0/1167526335 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf80089d0 con 0x5619314a3d00 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efbe37fe640 1 -- 172.21.15.138:0/1167526335 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf8008cb0 con 0x5619314a3d00 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/1167526335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 msgr2=0x5619314a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1167526335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efcf800a440 tx=0x7efcf800a900 comp rx=0 tx=0).stop 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/1167526335 shutdown_connections 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1167526335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314a4120 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/1167526335 >> 172.21.15.138:0/1167526335 conn(0x5619313a60e0 msgr2=0x56193149f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/1167526335 shutdown_connections 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.663+0000 7efcff9a7980 1 -- 172.21.15.138:0/1167526335 wait complete. 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193123b790 con 0x5619314a3d00 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcfdcc3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcfdcc3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36852/0 (socket says 172.21.15.138:36852) 2024-02-16T10:32:01.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcfdcc3640 1 -- 172.21.15.138:0/37904501 learned_addr learned my addr 172.21.15.138:0/37904501 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcfdcc3640 1 -- 172.21.15.138:0/37904501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8005cd0 con 0x5619314a3d00 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5619314a4ae0 tx=0x7efcf8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 -- 172.21.15.138:0/37904501 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf8013aa0 con 0x5619314a3d00 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 -- 172.21.15.138:0/37904501 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8013c00 con 0x5619314a3d00 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619314ab190 con 0x5619314a3d00 2024-02-16T10:32:01.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 -- 172.21.15.138:0/37904501 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf8013ea0 con 0x5619314a3d00 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619314ab5c0 con 0x5619314a3d00 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 -- 172.21.15.138:0/37904501 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efcf8028460 con 0x5619314a3d00 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efcff9a7980 1 Processor -- start 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 0x7efbd4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.667+0000 7efbe1ffb640 1 -- 172.21.15.138:0/37904501 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7efcf8049890 con 0x5619314a3d00 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 -- start start 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 0x7efbd4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619314c5220 con 0x5619314c48c0 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 0x7efbd4036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efcf8012fd0 tx=0x7efcf8005870 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfd4c2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36868/0 (socket says 172.21.15.138:36868) 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfd4c2640 1 -- 172.21.15.138:0/1911902678 learned_addr learned my addr 172.21.15.138:0/1911902678 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfd4c2640 1 -- 172.21.15.138:0/1911902678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619314c5360 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfd4c2640 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efcf001b0b0 tx=0x7efcf00e44a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 -- 172.21.15.138:0/1911902678 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf0009760 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 -- 172.21.15.138:0/1911902678 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00098c0 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619314c5c50 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 -- 172.21.15.138:0/1911902678 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcf00bf530 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619314c60e0 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 -- 172.21.15.138:0/1911902678 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7efcf00bf810 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 0x7efb400367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efbc1fe3640 1 -- 172.21.15.138:0/1911902678 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7efcf00a6070 con 0x5619314c48c0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfccc1640 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 0x7efb400367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efb3b7fe640 20 reqs_thread_entry: start 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 0x5619314cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5619314cbd80 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfccc1640 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 0x7efb400367c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcf40012f0 tx=0x7efcf4006680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.671+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 0x5619314cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcfdcc3640 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 0x5619314cb840 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcfdcc3640 1 -- 172.21.15.138:0/3984694961 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efcf8024020 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5619314cc230 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcfdcc3640 1 -- 172.21.15.138:0/3984694961 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efcf8024020 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5619314cd7c0 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcfdcc3640 1 -- 172.21.15.138:0/3984694961 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~1037 out=1037b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7efcf8024020 con 0x56193149aad0 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 msgr2=0x7efbd4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 0x7efbd4036770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efcf8012fd0 tx=0x7efcf8005870 comp rx=0 tx=0).stop 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 msgr2=0x5619314aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5619314a4ae0 tx=0x7efcf8003000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 shutdown_connections 2024-02-16T10:32:01.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbd40342b0 0x7efbd4036770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/37904501 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314a3d00 0x5619314aac50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 >> 172.21.15.138:0/37904501 conn(0x5619313a60e0 msgr2=0x56193149df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 shutdown_connections 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/37904501 wait complete. 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 msgr2=0x7efb400367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 0x7efb400367c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcf40012f0 tx=0x7efcf4006680 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 msgr2=0x5619314c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efcf001b0b0 tx=0x7efcf00e44a0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 shutdown_connections 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efb40034300 0x7efb400367c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/1911902678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619314c48c0 0x5619314c4ce0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 >> 172.21.15.138:0/1911902678 conn(0x5619314b95e0 msgr2=0x5619314ba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 shutdown_connections 2024-02-16T10:32:01.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/1911902678 wait complete. 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 msgr2=0x5619314cb840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 0x5619314cb840 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 msgr2=0x7efbe4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 0x7efbe4036770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efcf00abfd0 tx=0x7efcf0009f90 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 msgr2=0x561931496c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efcf00b8040 tx=0x7efcf0018020 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 shutdown_connections 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56193149aad0 0x5619314cb840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7efbe40342b0 0x7efbe4036770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 --2- 172.21.15.138:0/3984694961 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5619313a57c0 0x561931496c10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 >> 172.21.15.138:0/3984694961 conn(0x561931318ee0 msgr2=0x56193148a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 shutdown_connections 2024-02-16T10:32:01.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.675+0000 7efcff9a7980 1 -- 172.21.15.138:0/3984694961 wait complete. 2024-02-16T10:32:01.691 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:32:01.691 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:32:01.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:32:01.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-02-16T10:32:01.692 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-02-16T10:32:01.770 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.770 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08425e1980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5572be55d9b0 0x5572be55fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08425e1980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5572be4a5af0 con 0x5572be4cd800 2024-02-16T10:32:01.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08425e1980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5572be46cd30 con 0x5572be55d9b0 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f083f8fb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5572be55d9b0 0x5572be55fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f083f8fb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5572be55d9b0 0x5572be55fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36878/0 (socket says 172.21.15.138:36878) 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f083f8fb640 1 -- 172.21.15.138:0/2176760410 learned_addr learned my addr 172.21.15.138:0/2176760410 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f08400fc640 1 --1- 172.21.15.138:0/2176760410 >> v1:172.21.15.107:6789/0 conn(0x5572be4cd800 0x5572be55c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40446/0 (socket says 172.21.15.138:40446) 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f083f8fb640 1 -- 172.21.15.138:0/2176760410 >> v1:172.21.15.107:6789/0 conn(0x5572be4cd800 legacy=0x5572be55c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.767+0000 7f083f8fb640 1 -- 172.21.15.138:0/2176760410 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572be561380 con 0x5572be55d9b0 2024-02-16T10:32:01.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f083f8fb640 1 --2- 172.21.15.138:0/2176760410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be55d9b0 0x5572be55fda0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f082800a5c0 tx=0x7f082801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f663ef565c63553 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f083f0fa640 1 -- 172.21.15.138:0/2176760410 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08280aa470 con 0x5572be55d9b0 2024-02-16T10:32:01.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f083f0fa640 1 -- 172.21.15.138:0/2176760410 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08280aa5d0 con 0x5572be55d9b0 2024-02-16T10:32:01.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f083f0fa640 1 -- 172.21.15.138:0/2176760410 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08280aa890 con 0x5572be55d9b0 2024-02-16T10:32:01.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 -- 172.21.15.138:0/2176760410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be55d9b0 msgr2=0x5572be55fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 --2- 172.21.15.138:0/2176760410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be55d9b0 0x5572be55fda0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f082800a5c0 tx=0x7f082801b340 comp rx=0 tx=0).stop 2024-02-16T10:32:01.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 -- 172.21.15.138:0/2176760410 shutdown_connections 2024-02-16T10:32:01.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 --2- 172.21.15.138:0/2176760410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be55d9b0 0x5572be55fda0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 -- 172.21.15.138:0/2176760410 >> 172.21.15.138:0/2176760410 conn(0x5572be553d70 msgr2=0x5572be556190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 -- 172.21.15.138:0/2176760410 shutdown_connections 2024-02-16T10:32:01.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.771+0000 7f08425e1980 1 -- 172.21.15.138:0/2176760410 wait complete. 2024-02-16T10:32:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572be469fc0 con 0x5572be4cd800 2024-02-16T10:32:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36880/0 (socket says 172.21.15.138:36880) 2024-02-16T10:32:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08400fc640 1 -- 172.21.15.138:0/3447490363 learned_addr learned my addr 172.21.15.138:0/3447490363 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08400fc640 1 -- 172.21.15.138:0/3447490363 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828005df0 con 0x5572be4cd800 2024-02-16T10:32:01.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08400fc640 1 --2- 172.21.15.138:0/3447490363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0830006fc0 tx=0x7f08300019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7eb2b42c1213856 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f072e60c640 1 -- 172.21.15.138:0/3447490363 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0830013420 con 0x5572be4cd800 2024-02-16T10:32:01.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f072e60c640 1 -- 172.21.15.138:0/3447490363 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830013580 con 0x5572be4cd800 2024-02-16T10:32:01.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f072e60c640 1 -- 172.21.15.138:0/3447490363 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0830013880 con 0x5572be4cd800 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- 172.21.15.138:0/3447490363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 msgr2=0x5572be643720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 --2- 172.21.15.138:0/3447490363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0830006fc0 tx=0x7f08300019b0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- 172.21.15.138:0/3447490363 shutdown_connections 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 --2- 172.21.15.138:0/3447490363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be643720 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- 172.21.15.138:0/3447490363 >> 172.21.15.138:0/3447490363 conn(0x5572be553d70 msgr2=0x5572be63f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.787+0000 7f08425e1980 1 -- 172.21.15.138:0/3447490363 shutdown_connections 2024-02-16T10:32:01.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- 172.21.15.138:0/3447490363 wait complete. 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572be4657a0 con 0x5572be4cd800 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36888/0 (socket says 172.21.15.138:36888) 2024-02-16T10:32:01.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 -- 172.21.15.138:0/4124054554 learned_addr learned my addr 172.21.15.138:0/4124054554 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572be4a5af0 con 0x5572be4cd800 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08300012f0 tx=0x7f0830001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 -- 172.21.15.138:0/4124054554 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0830006320 con 0x5572be4cd800 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572be55a0b0 con 0x5572be4cd800 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 -- 172.21.15.138:0/4124054554 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830006840 con 0x5572be4cd800 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 -- 172.21.15.138:0/4124054554 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0830004c90 con 0x5572be4cd800 2024-02-16T10:32:01.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572be5585b0 con 0x5572be4cd800 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08425e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572be3fdf20 con 0x5572be659990 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 -- 172.21.15.138:0/4124054554 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f083001e3f0 con 0x5572be4cd800 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08408fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 0x7f0728036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08408fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36904/0 (socket says 172.21.15.138:36904) 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08408fd640 1 -- 172.21.15.138:0/1483877328 learned_addr learned my addr 172.21.15.138:0/1483877328 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f072ce09640 1 -- 172.21.15.138:0/4124054554 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f0830049850 con 0x5572be4cd800 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.791+0000 7f08400fc640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 0x7f0728036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 -- 172.21.15.138:0/1483877328 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572be65a2f0 con 0x5572be659990 2024-02-16T10:32:01.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08400fc640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 0x7f0728036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0830006810 tx=0x7f0830026fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 --2- 172.21.15.138:0/1483877328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f083800a440 tx=0x7f083800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0381120a0fc5d6f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f07267fc640 1 -- 172.21.15.138:0/1483877328 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0838008850 con 0x5572be659990 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f07267fc640 1 -- 172.21.15.138:0/1483877328 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08380089d0 con 0x5572be659990 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f07267fc640 1 -- 172.21.15.138:0/1483877328 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0838008cb0 con 0x5572be659990 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/1483877328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 msgr2=0x5572be659db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 --2- 172.21.15.138:0/1483877328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f083800a440 tx=0x7f083800a900 comp rx=0 tx=0).stop 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/1483877328 shutdown_connections 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 --2- 172.21.15.138:0/1483877328 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be659db0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/1483877328 >> 172.21.15.138:0/1483877328 conn(0x5572be55d9b0 msgr2=0x5572be654e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/1483877328 shutdown_connections 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/1483877328 wait complete. 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572be3f1790 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36920/0 (socket says 172.21.15.138:36920) 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 -- 172.21.15.138:0/498447599 learned_addr learned my addr 172.21.15.138:0/498447599 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 -- 172.21.15.138:0/498447599 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838005cd0 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08408fd640 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5572be65a770 tx=0x7f0838003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f0724ff9640 1 -- 172.21.15.138:0/498447599 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0838013aa0 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f0724ff9640 1 -- 172.21.15.138:0/498447599 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838013c00 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572be660eb0 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f0724ff9640 1 -- 172.21.15.138:0/498447599 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0838013ea0 con 0x5572be659990 2024-02-16T10:32:01.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.795+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572be6612e0 con 0x5572be659990 2024-02-16T10:32:01.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0724ff9640 1 -- 172.21.15.138:0/498447599 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f0838028460 con 0x5572be659990 2024-02-16T10:32:01.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 Processor -- start 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0724ff9640 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 0x7f0718036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0724ff9640 1 -- 172.21.15.138:0/498447599 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f0838049750 con 0x5572be659990 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08408fd640 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 0x7f0718036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 -- start start 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572be67aed0 con 0x5572be67a570 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08408fd640 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 0x7f0718036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f08380058b0 tx=0x7f08380287f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08400fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36924/0 (socket says 172.21.15.138:36924) 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08400fc640 1 -- 172.21.15.138:0/1754207536 learned_addr learned my addr 172.21.15.138:0/1754207536 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08400fc640 1 -- 172.21.15.138:0/1754207536 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572be67b010 con 0x5572be67a570 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08400fc640 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0830047bc0 tx=0x7f083001ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0704fe1640 1 -- 172.21.15.138:0/1754207536 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0830036070 con 0x5572be67a570 2024-02-16T10:32:01.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572be67b900 con 0x5572be67a570 2024-02-16T10:32:01.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0704fe1640 1 -- 172.21.15.138:0/1754207536 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830012700 con 0x5572be67a570 2024-02-16T10:32:01.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f0704fe1640 1 -- 172.21.15.138:0/1754207536 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f083000f2c0 con 0x5572be67a570 2024-02-16T10:32:01.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.799+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572be67b900 con 0x5572be67a570 2024-02-16T10:32:01.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f0704fe1640 1 -- 172.21.15.138:0/1754207536 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f08300113e0 con 0x5572be67a570 2024-02-16T10:32:01.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f0704fe1640 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 0x7f067c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f0704fe1640 1 -- 172.21.15.138:0/1754207536 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f0830053d00 con 0x5572be67a570 2024-02-16T10:32:01.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f083f8fb640 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 0x7f067c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f06867fc640 20 reqs_thread_entry: start 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 0x5572be6818d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572be681e10 con 0x5572be67f4e0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08408fd640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 0x5572be6818d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f083f8fb640 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 0x7f067c036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f08280ae000 tx=0x7f08280a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08408fd640 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 0x5572be6818d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08408fd640 1 -- 172.21.15.138:0/4124054554 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0838024020 con 0x5572be67f4e0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572be683180 con 0x5572be67f4e0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08408fd640 1 -- 172.21.15.138:0/4124054554 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~1037 out=1037b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+1085 (crc 0 0 0) 0x7f0838024020 con 0x5572be67f4e0 2024-02-16T10:32:01.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~875 in=875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5572be687ad0 con 0x5572be67f4e0 2024-02-16T10:32:01.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.803+0000 7f08408fd640 1 -- 172.21.15.138:0/4124054554 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [stat,call,call,writefull 0~875] v33'6 uv6 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f0838024020 con 0x5572be67f4e0 2024-02-16T10:32:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 msgr2=0x7f0718036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 0x7f0718036770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f08380058b0 tx=0x7f08380287f0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 msgr2=0x5572be660970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5572be65a770 tx=0x7f0838003000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 shutdown_connections 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07180342b0 0x7f0718036770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/498447599 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be659990 0x5572be660970 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 >> 172.21.15.138:0/498447599 conn(0x5572be55d9b0 msgr2=0x5572be653c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 shutdown_connections 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/498447599 wait complete. 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 msgr2=0x7f067c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 0x7f067c036770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f08280ae000 tx=0x7f08280a6000 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 msgr2=0x5572be67a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0830047bc0 tx=0x7f083001ef90 comp rx=0 tx=0).stop 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 shutdown_connections 2024-02-16T10:32:01.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f067c0342b0 0x7f067c036770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/1754207536 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be67a570 0x5572be67a990 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 >> 172.21.15.138:0/1754207536 conn(0x5572be66f290 msgr2=0x5572be66fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 shutdown_connections 2024-02-16T10:32:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/1754207536 wait complete. 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 msgr2=0x5572be6818d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 0x5572be6818d0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 msgr2=0x7f0728036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 0x7f0728036770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0830006810 tx=0x7f0830026fb0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 msgr2=0x5572be559b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08300012f0 tx=0x7f0830001260 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 shutdown_connections 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5572be67f4e0 0x5572be6818d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f07280342b0 0x7f0728036770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 --2- 172.21.15.138:0/4124054554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5572be4cd800 0x5572be559b70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 >> 172.21.15.138:0/4124054554 conn(0x5572be553d70 msgr2=0x5572be63ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 shutdown_connections 2024-02-16T10:32:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.807+0000 7f08425e1980 1 -- 172.21.15.138:0/4124054554 wait complete. 2024-02-16T10:32:01.823 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:32:01.823 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:32:01.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-02-16T10:32:01.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-02-16T10:32:01.824 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-02-16T10:32:01.899 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:01.899 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:01.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbdfcb980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55792c9e74d0 0x55792c9e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbdfcb980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55792c934b40 con 0x55792c9e7df0 2024-02-16T10:32:01.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbdfcb980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x55792c8fbd30 con 0x55792c9e74d0 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbbae6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55792c9e74d0 0x55792c9e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbbae6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x55792c9e74d0 0x55792c9e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36938/0 (socket says 172.21.15.138:36938) 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbbae6640 1 -- 172.21.15.138:0/739484841 learned_addr learned my addr 172.21.15.138:0/739484841 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbb2e5640 1 --1- 172.21.15.138:0/739484841 >> v1:172.21.15.107:6789/0 conn(0x55792c9e7df0 0x55792c9e87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40450/0 (socket says 172.21.15.138:40450) 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbbae6640 1 -- 172.21.15.138:0/739484841 >> v1:172.21.15.107:6789/0 conn(0x55792c9e7df0 legacy=0x55792c9e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.895+0000 7fbfbbae6640 1 -- 172.21.15.138:0/739484841 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55792c9e8fe0 con 0x55792c9e74d0 2024-02-16T10:32:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/739484841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c9e78b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400a5c0 tx=0x7fbfb401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55468ec44175305f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbaae4640 1 -- 172.21.15.138:0/739484841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40aa470 con 0x55792c9e74d0 2024-02-16T10:32:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbaae4640 1 -- 172.21.15.138:0/739484841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40aa5d0 con 0x55792c9e74d0 2024-02-16T10:32:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbaae4640 1 -- 172.21.15.138:0/739484841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40aa890 con 0x55792c9e74d0 2024-02-16T10:32:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/739484841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 msgr2=0x55792c9e78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/739484841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c9e78b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400a5c0 tx=0x7fbfb401b340 comp rx=0 tx=0).stop 2024-02-16T10:32:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/739484841 shutdown_connections 2024-02-16T10:32:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/739484841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c9e78b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/739484841 >> 172.21.15.138:0/739484841 conn(0x55792c9e2da0 msgr2=0x55792c9e51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/739484841 shutdown_connections 2024-02-16T10:32:01.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.899+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/739484841 wait complete. 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbdfcb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbdfcb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792c8f8fc0 con 0x55792c9e74d0 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36946/0 (socket says 172.21.15.138:36946) 2024-02-16T10:32:01.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbbae6640 1 -- 172.21.15.138:0/2213920944 learned_addr learned my addr 172.21.15.138:0/2213920944 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbbae6640 1 -- 172.21.15.138:0/2213920944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4005df0 con 0x55792c9e74d0 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/2213920944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbfb401b380 tx=0x7fbfb4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377b22430c20ec93 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbea9e0b640 1 -- 172.21.15.138:0/2213920944 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40aa9b0 con 0x55792c9e74d0 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbea9e0b640 1 -- 172.21.15.138:0/2213920944 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40aab30 con 0x55792c9e74d0 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.915+0000 7fbea9e0b640 1 -- 172.21.15.138:0/2213920944 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40aae10 con 0x55792c9e74d0 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2213920944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 msgr2=0x55792c95c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2213920944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbfb401b380 tx=0x7fbfb4003030 comp rx=0 tx=0).stop 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2213920944 shutdown_connections 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2213920944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792c95c6a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2213920944 >> 172.21.15.138:0/2213920944 conn(0x55792c9e2da0 msgr2=0x55792cacd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2213920944 shutdown_connections 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2213920944 wait complete. 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792c8f47a0 con 0x55792c9e74d0 2024-02-16T10:32:01.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36960/0 (socket says 172.21.15.138:36960) 2024-02-16T10:32:01.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 -- 172.21.15.138:0/1394573516 learned_addr learned my addr 172.21.15.138:0/1394573516 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55792c9e8fe0 con 0x55792c9e74d0 2024-02-16T10:32:01.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40aa5a0 tx=0x7fbfb40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 -- 172.21.15.138:0/1394573516 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40cb070 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55792cad9f00 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 -- 172.21.15.138:0/1394573516 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40c6690 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 -- 172.21.15.138:0/1394573516 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40c6930 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55792cada3b0 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbdfcb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792c88cf20 con 0x55792cae6a40 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 -- 172.21.15.138:0/1394573516 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfb40c6b20 con 0x55792c9e74d0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbc2e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 0x7fbea4036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbc2e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36962/0 (socket says 172.21.15.138:36962) 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/651473129 learned_addr learned my addr 172.21.15.138:0/651473129 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbea3fff640 1 -- 172.21.15.138:0/1394573516 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fbfb40e4940 con 0x55792c9e74d0 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.919+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 0x7fbea4036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/651473129 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55792cae73a0 con 0x55792cae6a40 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 0x7fbea4036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40d0f20 tx=0x7fbfb40d0eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/651473129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00a430 tx=0x7fbfac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f68f5be6a23c2b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbea1ffb640 1 -- 172.21.15.138:0/651473129 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfac00f6e0 con 0x55792cae6a40 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbea1ffb640 1 -- 172.21.15.138:0/651473129 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac00f860 con 0x55792cae6a40 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbea1ffb640 1 -- 172.21.15.138:0/651473129 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfac00fb40 con 0x55792cae6a40 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/651473129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 msgr2=0x55792cae6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/651473129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00a430 tx=0x7fbfac00a8f0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/651473129 shutdown_connections 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/651473129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792cae6e60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/651473129 >> 172.21.15.138:0/651473129 conn(0x55792c9e7df0 msgr2=0x55792cae1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/651473129 shutdown_connections 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/651473129 wait complete. 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792c880790 con 0x55792cae6a40 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36976/0 (socket says 172.21.15.138:36976) 2024-02-16T10:32:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/2732963893 learned_addr learned my addr 172.21.15.138:0/2732963893 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/2732963893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac00a0e0 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55792cae7820 tx=0x7fbfac003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbe9bfff640 1 -- 172.21.15.138:0/2732963893 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfac010a20 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbe9bfff640 1 -- 172.21.15.138:0/2732963893 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac010b80 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55792caedef0 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbe9bfff640 1 -- 172.21.15.138:0/2732963893 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfac010ea0 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.923+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55792caee380 con 0x55792cae6a40 2024-02-16T10:32:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe9bfff640 1 -- 172.21.15.138:0/2732963893 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfac01a480 con 0x55792cae6a40 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe9bfff640 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 0x7fbe94036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 Processor -- start 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe9bfff640 1 -- 172.21.15.138:0/2732963893 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fbfac049f90 con 0x55792cae6a40 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 0x7fbe94036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 -- start start 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x55792cad1f00 con 0x55792cad3520 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 0x7fbe94036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbfac02e5a0 tx=0x7fbfac02e530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbbae6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36984/0 (socket says 172.21.15.138:36984) 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbbae6640 1 -- 172.21.15.138:0/1253223100 learned_addr learned my addr 172.21.15.138:0/1253223100 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:01.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbbae6640 1 -- 172.21.15.138:0/1253223100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55792cad2040 con 0x55792cad3520 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40e2d40 tx=0x7fbfb40d0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe03fff640 1 -- 172.21.15.138:0/1253223100 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40b33f0 con 0x55792cad3520 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55792cad22f0 con 0x55792cad3520 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe03fff640 1 -- 172.21.15.138:0/1253223100 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40b3550 con 0x55792cad3520 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbe03fff640 1 -- 172.21.15.138:0/1253223100 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40c5b70 con 0x55792cad3520 2024-02-16T10:32:01.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.927+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55792cad2780 con 0x55792cad3520 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbe03fff640 1 -- 172.21.15.138:0/1253223100 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fbfb40e0030 con 0x55792cad3520 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbe03fff640 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 0x7fbdf8036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbe03fff640 1 -- 172.21.15.138:0/1253223100 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fbfb40f7d00 con 0x55792cad3520 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbb2e5640 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 0x7fbdf8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbe01ffb640 20 reqs_thread_entry: start 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 0x55792cb10860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55792cb10e70 con 0x55792cb0e470 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbb2e5640 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 0x7fbdf8036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55792cae2af0 tx=0x7fbfa4001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 0x55792cb10860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbc2e7640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 0x55792cb10860 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/1394573516 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbfac016020 con 0x55792cb0e470 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55792cb11350 con 0x55792cb0e470 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbc2e7640 1 -- 172.21.15.138:0/1394573516 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbfac016020 con 0x55792cb0e470 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 0x55792cb153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:3 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55792cb15b50 con 0x55792cb12f30 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 0x55792cb153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbbae6640 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 0x55792cb153c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbbae6640 1 -- 172.21.15.138:0/1394573516 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(3 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbfb40cd070 con 0x55792cb12f30 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 msgr2=0x7fbe94036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 0x7fbe94036770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbfac02e5a0 tx=0x7fbfac02e530 comp rx=0 tx=0).stop 2024-02-16T10:32:01.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 msgr2=0x55792caed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55792cae7820 tx=0x7fbfac003380 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 shutdown_connections 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbe940342b0 0x7fbe94036770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/2732963893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cae6a40 0x55792caed9b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.931+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 >> 172.21.15.138:0/2732963893 conn(0x55792c9e7df0 msgr2=0x55792cae0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 shutdown_connections 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/2732963893 wait complete. 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 msgr2=0x7fbdf8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 0x7fbdf8036770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55792cae2af0 tx=0x7fbfa4001330 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 msgr2=0x55792cad19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40e2d40 tx=0x7fbfb40d0c00 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 shutdown_connections 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbdf80342b0 0x7fbdf8036770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1253223100 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792cad3520 0x55792cad19c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 >> 172.21.15.138:0/1253223100 conn(0x55792cafc340 msgr2=0x55792cafcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 shutdown_connections 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1253223100 wait complete. 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 msgr2=0x55792cb10860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 0x55792cb10860 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 msgr2=0x55792cb153c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 0x55792cb153c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 msgr2=0x7fbea4036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 0x7fbea4036770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40d0f20 tx=0x7fbfb40d0eb0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 msgr2=0x55792cad99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40aa5a0 tx=0x7fbfb40180e0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 shutdown_connections 2024-02-16T10:32:01.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x55792cb12f30 0x55792cb153c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x55792cb0e470 0x55792cb10860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fbea40342b0 0x7fbea4036770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 --2- 172.21.15.138:0/1394573516 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55792c9e74d0 0x55792cad99c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 >> 172.21.15.138:0/1394573516 conn(0x55792c9e2da0 msgr2=0x55792cacc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 shutdown_connections 2024-02-16T10:32:01.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:01.935+0000 7fbfbdfcb980 1 -- 172.21.15.138:0/1394573516 wait complete. 2024-02-16T10:32:01.948 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"813c5b9c-efe5-457a-a257-626d766e0618","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","zones":[{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-02-16T10:32:01.949 DEBUG:tasks.util.rgw: json result: {'id': '813c5b9c-efe5-457a-a257-626d766e0618', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'zones': [{'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-02-16T10:32:01.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T10:32:01.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-02-16T10:32:01.949 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-02-16T10:32:02.024 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:02.024 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:02.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.019+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.019+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.019+0000 7f51e7a9b980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56085a956d90 0x56085a959180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.019+0000 7f51e7a9b980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56085a89caf0 con 0x56085a952880 2024-02-16T10:32:02.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.019+0000 7f51e7a9b980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x56085a863d30 con 0x56085a956d90 2024-02-16T10:32:02.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56085a956d90 0x56085a959180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x56085a956d90 0x56085a959180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36992/0 (socket says 172.21.15.138:36992) 2024-02-16T10:32:02.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 -- 172.21.15.138:0/3659045996 learned_addr learned my addr 172.21.15.138:0/3659045996 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 -- 172.21.15.138:0/3659045996 >> v1:172.21.15.107:6789/0 conn(0x56085a952880 legacy=0x56085a952c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 -- 172.21.15.138:0/3659045996 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56085a95a6d0 con 0x56085a956d90 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e4db5640 1 --2- 172.21.15.138:0/3659045996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a956d90 0x56085a959180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f51d000a4e0 tx=0x7f51d001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3146ad6a692c5621 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51dffff640 1 -- 172.21.15.138:0/3659045996 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d00aa540 con 0x56085a956d90 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51dffff640 1 -- 172.21.15.138:0/3659045996 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00a6070 con 0x56085a956d90 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51dffff640 1 -- 172.21.15.138:0/3659045996 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d00aa850 con 0x56085a956d90 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3659045996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a956d90 msgr2=0x56085a959180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3659045996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a956d90 0x56085a959180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f51d000a4e0 tx=0x7f51d001b090 comp rx=0 tx=0).stop 2024-02-16T10:32:02.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3659045996 shutdown_connections 2024-02-16T10:32:02.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3659045996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a956d90 0x56085a959180 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3659045996 >> 172.21.15.138:0/3659045996 conn(0x56085a8c5fd0 msgr2=0x56085a8c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3659045996 shutdown_connections 2024-02-16T10:32:02.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.023+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3659045996 wait complete. 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e7a9b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e7a9b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56085a860fc0 con 0x56085a952880 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:36998/0 (socket says 172.21.15.138:36998) 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e55b6640 1 -- 172.21.15.138:0/1383711999 learned_addr learned my addr 172.21.15.138:0/1383711999 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e55b6640 1 -- 172.21.15.138:0/1383711999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d000a1c0 con 0x56085a952880 2024-02-16T10:32:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.039+0000 7f51e55b6640 1 --2- 172.21.15.138:0/1383711999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001d10 tx=0x7f51e000b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe835dd4cb2bc91 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d3606640 1 -- 172.21.15.138:0/1383711999 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e0014070 con 0x56085a952880 2024-02-16T10:32:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d3606640 1 -- 172.21.15.138:0/1383711999 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e000f560 con 0x56085a952880 2024-02-16T10:32:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d3606640 1 -- 172.21.15.138:0/1383711999 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e000f840 con 0x56085a952880 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1383711999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 msgr2=0x56085aa3ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1383711999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001d10 tx=0x7f51e000b5c0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1383711999 shutdown_connections 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1383711999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa3ca00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1383711999 >> 172.21.15.138:0/1383711999 conn(0x56085a8c5fd0 msgr2=0x56085aa38590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1383711999 shutdown_connections 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1383711999 wait complete. 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56085a85c7a0 con 0x56085a952880 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37002/0 (socket says 172.21.15.138:37002) 2024-02-16T10:32:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e55b6640 1 -- 172.21.15.138:0/3259600912 learned_addr learned my addr 172.21.15.138:0/3259600912 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e55b6640 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56085a89caf0 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e55b6640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x56085aa3d890 tx=0x7f51e0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d1e03640 1 -- 172.21.15.138:0/3259600912 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e0014050 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d1e03640 1 -- 172.21.15.138:0/3259600912 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0001520 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56085aa43e50 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f50d1e03640 1 -- 172.21.15.138:0/3259600912 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e001bad0 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56085aa44360 con 0x56085a952880 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.043+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56085a7f4f20 con 0x56085aa50a70 2024-02-16T10:32:02.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50d1e03640 1 -- 172.21.15.138:0/3259600912 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f51e0022020 con 0x56085a952880 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50d1e03640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 0x7f50cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50d1e03640 1 -- 172.21.15.138:0/3259600912 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f51e0048dd0 con 0x56085a952880 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e55b6640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 0x7f50cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37016/0 (socket says 172.21.15.138:37016) 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 -- 172.21.15.138:0/10531953 learned_addr learned my addr 172.21.15.138:0/10531953 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e55b6640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 0x7f50cc036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001fd0 tx=0x7f51e0001e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 -- 172.21.15.138:0/10531953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56085aa513d0 con 0x56085aa50a70 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 --2- 172.21.15.138:0/10531953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f51d800a440 tx=0x7f51d800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dff8da7b15cad75 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50cb7fe640 1 -- 172.21.15.138:0/10531953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d8008850 con 0x56085aa50a70 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50cb7fe640 1 -- 172.21.15.138:0/10531953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80089d0 con 0x56085aa50a70 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f50cb7fe640 1 -- 172.21.15.138:0/10531953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d8008cb0 con 0x56085aa50a70 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- 172.21.15.138:0/10531953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 msgr2=0x56085aa50e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/10531953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f51d800a440 tx=0x7f51d800a900 comp rx=0 tx=0).stop 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- 172.21.15.138:0/10531953 shutdown_connections 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/10531953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa50e90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- 172.21.15.138:0/10531953 >> 172.21.15.138:0/10531953 conn(0x56085a956d90 msgr2=0x56085aa4bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- 172.21.15.138:0/10531953 shutdown_connections 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- 172.21.15.138:0/10531953 wait complete. 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e7a9b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56085a7e8790 con 0x56085aa50a70 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37026/0 (socket says 172.21.15.138:37026) 2024-02-16T10:32:02.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 -- 172.21.15.138:0/97975700 learned_addr learned my addr 172.21.15.138:0/97975700 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.047+0000 7f51e5db7640 1 -- 172.21.15.138:0/97975700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8005cd0 con 0x56085aa50a70 2024-02-16T10:32:02.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e5db7640 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x56085aa51850 tx=0x7f51d8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 -- 172.21.15.138:0/97975700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d8013aa0 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 -- 172.21.15.138:0/97975700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8013c00 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56085aa57e80 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56085aa582b0 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 -- 172.21.15.138:0/97975700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51d8013ea0 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 -- 172.21.15.138:0/97975700 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f51d8028460 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 0x7f50bc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 Processor -- start 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50c9ffb640 1 -- 172.21.15.138:0/97975700 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f51d80499b0 con 0x56085aa50a70 2024-02-16T10:32:02.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e5db7640 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 0x7f50bc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- start start 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56085aa71eb0 con 0x56085aa71550 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e5db7640 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 0x7f50bc036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f51d8011af0 tx=0x7f51d8011a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e55b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37036/0 (socket says 172.21.15.138:37036) 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e55b6640 1 -- 172.21.15.138:0/1690734082 learned_addr learned my addr 172.21.15.138:0/1690734082 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e55b6640 1 -- 172.21.15.138:0/1690734082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56085aa71ff0 con 0x56085aa71550 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e55b6640 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f51e0047140 tx=0x7f51e00470a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50a9fe3640 1 -- 172.21.15.138:0/1690734082 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e000e370 con 0x56085aa71550 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56085aa72940 con 0x56085aa71550 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f50a9fe3640 1 -- 172.21.15.138:0/1690734082 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e00243d0 con 0x56085aa71550 2024-02-16T10:32:02.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.051+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56085aa72dd0 con 0x56085aa71550 2024-02-16T10:32:02.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f50a9fe3640 1 -- 172.21.15.138:0/1690734082 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51e0018cb0 con 0x56085aa71550 2024-02-16T10:32:02.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f50a9fe3640 1 -- 172.21.15.138:0/1690734082 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f51e0038040 con 0x56085aa71550 2024-02-16T10:32:02.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f50a9fe3640 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 0x7f50280367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f50a9fe3640 1 -- 172.21.15.138:0/1690734082 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f51e0046d10 con 0x56085aa71550 2024-02-16T10:32:02.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e4db5640 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 0x7f50280367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f50237fe640 20 reqs_thread_entry: start 2024-02-16T10:32:02.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 0x56085aa78910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56085aa78e50 con 0x56085aa76520 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e4db5640 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 0x7f50280367c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51d00ab000 tx=0x7f51d00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e5db7640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 0x56085aa78910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e5db7640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 0x56085aa78910 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e5db7640 1 -- 172.21.15.138:0/3259600912 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f51d8024020 con 0x56085aa76520 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 0x56085aa7ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:2 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56085aa7d440 con 0x56085aa7a840 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e55b6640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 0x56085aa7ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e55b6640 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 0x56085aa7ccb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e55b6640 1 -- 172.21.15.138:0/3259600912 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(2 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f51e0042070 con 0x56085aa7a840 2024-02-16T10:32:02.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.055+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:3 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56085aa81f40 con 0x56085aa7a840 2024-02-16T10:32:02.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e55b6640 1 -- 172.21.15.138:0/3259600912 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(3 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [stat,call,call,writefull 0~421] v33'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7f51e0042070 con 0x56085aa7a840 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 msgr2=0x7f50bc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 0x7f50bc036770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f51d8011af0 tx=0x7f51d8011a40 comp rx=0 tx=0).stop 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 msgr2=0x56085aa57940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x56085aa51850 tx=0x7f51d8003000 comp rx=0 tx=0).stop 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 shutdown_connections 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50bc0342b0 0x7f50bc036770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/97975700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa50a70 0x56085aa57940 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 >> 172.21.15.138:0/97975700 conn(0x56085a956d90 msgr2=0x56085aa4ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 shutdown_connections 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/97975700 wait complete. 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 msgr2=0x7f50280367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 0x7f50280367c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f51d00ab000 tx=0x7f51d00a5000 comp rx=0 tx=0).stop 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 msgr2=0x56085aa71970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f51e0047140 tx=0x7f51e00470a0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 shutdown_connections 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f5028034300 0x7f50280367c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/1690734082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085aa71550 0x56085aa71970 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 >> 172.21.15.138:0/1690734082 conn(0x56085aa662d0 msgr2=0x56085aa66cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 shutdown_connections 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/1690734082 wait complete. 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 msgr2=0x56085aa78910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 0x56085aa78910 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 msgr2=0x56085aa7ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 0x56085aa7ccb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 msgr2=0x7f50cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 0x7f50cc036770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f51e0001fd0 tx=0x7f51e0001e60 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 msgr2=0x56085aa43910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x56085aa3d890 tx=0x7f51e0000bd0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 shutdown_connections 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x56085aa7a840 0x56085aa7ccb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x56085aa76520 0x56085aa78910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f50cc0342b0 0x7f50cc036770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 --2- 172.21.15.138:0/3259600912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56085a952880 0x56085aa43910 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 >> 172.21.15.138:0/3259600912 conn(0x56085a8c5fd0 msgr2=0x56085aa370a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 shutdown_connections 2024-02-16T10:32:02.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.059+0000 7f51e7a9b980 1 -- 172.21.15.138:0/3259600912 wait complete. 2024-02-16T10:32:02.076 INFO:teuthology.orchestra.run.smithi138.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-02-16T10:32:02.076 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-02-16T10:32:02.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T10:32:02.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-02-16T10:32:02.077 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-02-16T10:32:02.158 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:02.159 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:02.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea552bc980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640fd4041b0 0x5640fd4027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea552bc980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5640fd3d9af0 con 0x5640fd402cf0 2024-02-16T10:32:02.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea552bc980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5640fd3a0d30 con 0x5640fd4041b0 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea52dd7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640fd4041b0 0x5640fd4027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea525d6640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x5640fd402cf0 0x5640fd4956d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:40476/0 (socket says 172.21.15.138:40476) 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea52dd7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5640fd4041b0 0x5640fd4027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37052/0 (socket says 172.21.15.138:37052) 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea525d6640 1 -- 172.21.15.138:0/3908183627 learned_addr learned my addr 172.21.15.138:0/3908183627 (peer_addr_for_me v1:172.21.15.138:0/0) 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea52dd7640 1 -- 172.21.15.138:0/3908183627 >> v1:172.21.15.107:6789/0 conn(0x5640fd402cf0 legacy=0x5640fd4956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.155+0000 7fea52dd7640 1 -- 172.21.15.138:0/3908183627 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fd403100 con 0x5640fd4041b0 2024-02-16T10:32:02.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3908183627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd4041b0 0x5640fd4027b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00a480 tx=0x7fea4c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54f19a2c2ff4dd2 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea51dd5640 1 -- 172.21.15.138:0/3908183627 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aa400 con 0x5640fd4041b0 2024-02-16T10:32:02.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea51dd5640 1 -- 172.21.15.138:0/3908183627 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0a6050 con 0x5640fd4041b0 2024-02-16T10:32:02.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea51dd5640 1 -- 172.21.15.138:0/3908183627 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0aa6b0 con 0x5640fd4041b0 2024-02-16T10:32:02.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 -- 172.21.15.138:0/3908183627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd4041b0 msgr2=0x5640fd4027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 --2- 172.21.15.138:0/3908183627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd4041b0 0x5640fd4027b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00a480 tx=0x7fea4c01b220 comp rx=0 tx=0).stop 2024-02-16T10:32:02.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 -- 172.21.15.138:0/3908183627 shutdown_connections 2024-02-16T10:32:02.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 --2- 172.21.15.138:0/3908183627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd4041b0 0x5640fd4027b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 -- 172.21.15.138:0/3908183627 >> 172.21.15.138:0/3908183627 conn(0x5640fd488fa0 msgr2=0x5640fd48b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 -- 172.21.15.138:0/3908183627 shutdown_connections 2024-02-16T10:32:02.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.159+0000 7fea552bc980 1 -- 172.21.15.138:0/3908183627 wait complete. 2024-02-16T10:32:02.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fd39dfc0 con 0x5640fd402cf0 2024-02-16T10:32:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37054/0 (socket says 172.21.15.138:37054) 2024-02-16T10:32:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea52dd7640 1 -- 172.21.15.138:0/832045353 learned_addr learned my addr 172.21.15.138:0/832045353 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea52dd7640 1 -- 172.21.15.138:0/832045353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c005d30 con 0x5640fd402cf0 2024-02-16T10:32:02.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea52dd7640 1 --2- 172.21.15.138:0/832045353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fea4c018eb0 tx=0x7fea4c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcab081f4ea3dd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fe940e09640 1 -- 172.21.15.138:0/832045353 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c00a2b0 con 0x5640fd402cf0 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fe940e09640 1 -- 172.21.15.138:0/832045353 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0b4410 con 0x5640fd402cf0 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fe940e09640 1 -- 172.21.15.138:0/832045353 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0b46b0 con 0x5640fd402cf0 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- 172.21.15.138:0/832045353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 msgr2=0x5640fd57a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 --2- 172.21.15.138:0/832045353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fea4c018eb0 tx=0x7fea4c003030 comp rx=0 tx=0).stop 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- 172.21.15.138:0/832045353 shutdown_connections 2024-02-16T10:32:02.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 --2- 172.21.15.138:0/832045353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd57a010 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- 172.21.15.138:0/832045353 >> 172.21.15.138:0/832045353 conn(0x5640fd488fa0 msgr2=0x5640fd575ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- 172.21.15.138:0/832045353 shutdown_connections 2024-02-16T10:32:02.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.175+0000 7fea552bc980 1 -- 172.21.15.138:0/832045353 wait complete. 2024-02-16T10:32:02.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fd3997a0 con 0x5640fd402cf0 2024-02-16T10:32:02.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37068/0 (socket says 172.21.15.138:37068) 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 -- 172.21.15.138:0/3566330009 learned_addr learned my addr 172.21.15.138:0/3566330009 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fd403100 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fea4c018eb0 tx=0x7fea4c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 -- 172.21.15.138:0/3566330009 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0be540 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640fd5813a0 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 -- 172.21.15.138:0/3566330009 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0be6a0 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 -- 172.21.15.138:0/3566330009 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0be940 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640fd5818b0 con 0x5640fd402cf0 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea552bc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fd331f20 con 0x5640fd58df80 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 -- 172.21.15.138:0/3566330009 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea4c0b1070 con 0x5640fd402cf0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea535d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea535d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37082/0 (socket says 172.21.15.138:37082) 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea535d8640 1 -- 172.21.15.138:0/1034742371 learned_addr learned my addr 172.21.15.138:0/1034742371 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 0x7fe938036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fe93f606640 1 -- 172.21.15.138:0/3566330009 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fea4c0e4280 con 0x5640fd402cf0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 0x7fe938036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea535d8640 1 -- 172.21.15.138:0/1034742371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fd58e8e0 con 0x5640fd58df80 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.179+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 0x7fe938036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01b050 tx=0x7fea4c0c2e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 --2- 172.21.15.138:0/1034742371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a430 tx=0x7fea4400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4454de10ae2beef5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe93d602640 1 -- 172.21.15.138:0/1034742371 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4400f6e0 con 0x5640fd58df80 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe93d602640 1 -- 172.21.15.138:0/1034742371 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400f860 con 0x5640fd58df80 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe93d602640 1 -- 172.21.15.138:0/1034742371 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4400fb40 con 0x5640fd58df80 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/1034742371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 msgr2=0x5640fd58e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 --2- 172.21.15.138:0/1034742371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a430 tx=0x7fea4400a8f0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/1034742371 shutdown_connections 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 --2- 172.21.15.138:0/1034742371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd58e3a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/1034742371 >> 172.21.15.138:0/1034742371 conn(0x5640fd4041b0 msgr2=0x5640fd5893f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/1034742371 shutdown_connections 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/1034742371 wait complete. 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fd325790 con 0x5640fd58df80 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37084/0 (socket says 172.21.15.138:37084) 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 -- 172.21.15.138:0/155165117 learned_addr learned my addr 172.21.15.138:0/155165117 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 -- 172.21.15.138:0/155165117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4400a0e0 con 0x5640fd58df80 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea535d8640 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fea44000f90 tx=0x7fea44003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea44010920 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640fd595490 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea44010aa0 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea44010dc0 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.183+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640fd595920 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea4401a480 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe9377fe640 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 0x7fe92c036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fea4404a0c0 con 0x5640fd58df80 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea525d6640 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 0x7fe92c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 Processor -- start 2024-02-16T10:32:02.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 -- start start 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea525d6640 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 0x7fe92c036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fea3c000f70 tx=0x7fea3c001240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640fd5af480 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea52dd7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:37090/0 (socket says 172.21.15.138:37090) 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea52dd7640 1 -- 172.21.15.138:0/910032984 learned_addr learned my addr 172.21.15.138:0/910032984 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea52dd7640 1 -- 172.21.15.138:0/910032984 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640fd5af5c0 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea52dd7640 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0e2600 tx=0x7fea4c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe912ffd640 1 -- 172.21.15.138:0/910032984 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0c75e0 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640fd5aff20 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe912ffd640 1 -- 172.21.15.138:0/910032984 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0d5070 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640fd5b0350 con 0x5640fd5aeb20 2024-02-16T10:32:02.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe912ffd640 1 -- 172.21.15.138:0/910032984 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea4c0e2430 con 0x5640fd5aeb20 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.187+0000 7fe912ffd640 1 -- 172.21.15.138:0/910032984 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fea4c0d7030 con 0x5640fd5aeb20 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fe912ffd640 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 0x7fe88c036720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fe912ffd640 1 -- 172.21.15.138:0/910032984 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fea4c0eed00 con 0x5640fd5aeb20 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea525d6640 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 0x7fe88c036720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fe910ff9640 20 reqs_thread_entry: start 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 0x5640fd5b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea525d6640 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 0x7fe88c036720 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5640fd58a030 tx=0x7fea3c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5b6430 con 0x5640fd5b3b00 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 0x5640fd5b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 0x5640fd5b5ef0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 -- 172.21.15.138:0/3566330009 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fea44016020 con 0x5640fd5b3b00 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5b7c40 con 0x5640fd5b3b00 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 -- 172.21.15.138:0/3566330009 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~875 out=875b] v0'0 uv6 ondisk = 0) v8 ==== 232+0+923 (crc 0 0 0) 0x7fea44016020 con 0x5640fd5b3b00 2024-02-16T10:32:02.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5b6e40 con 0x5640fd5b3b00 2024-02-16T10:32:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 -- 172.21.15.138:0/3566330009 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fea44016020 con 0x5640fd5b3b00 2024-02-16T10:32:02.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5b71f0 con 0x5640fd5b3b00 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea535d8640 1 -- 172.21.15.138:0/3566330009 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fea44016020 con 0x5640fd5b3b00 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 0x5640fd5bb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5bbb90 con 0x5640fd5b8fb0 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 0x5640fd5bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea52dd7640 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 0x5640fd5bb400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea52dd7640 1 -- 172.21.15.138:0/3566330009 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7fea4c0c3020 con 0x5640fd5b8fb0 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x5640fd331d10 con 0x5640fd58df80 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fe9377fe640 1 -- 172.21.15.138:0/155165117 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea44024c70 con 0x5640fd58df80 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.191+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:6 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~922 in=922b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5640fd5c06c0 con 0x5640fd5b3b00 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea535d8640 1 -- 172.21.15.138:0/3566330009 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(6 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [stat,call,call,writefull 0~922] v33'7 uv7 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7fea44034020 con 0x5640fd5b3b00 2024-02-16T10:32:02.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 msgr2=0x7fe92c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 0x7fe92c036770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fea3c000f70 tx=0x7fea3c001240 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 msgr2=0x5640fd594f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fea44000f90 tx=0x7fea44003380 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 shutdown_connections 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe92c0342b0 0x7fe92c036770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/155165117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd58df80 0x5640fd594f50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 >> 172.21.15.138:0/155165117 conn(0x5640fd4041b0 msgr2=0x5640fd5881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 shutdown_connections 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/155165117 wait complete. 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 msgr2=0x7fe88c036720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 0x7fe88c036720 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5640fd58a030 tx=0x7fea3c00f000 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 msgr2=0x5640fd5aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0e2600 tx=0x7fea4c009f70 comp rx=0 tx=0).stop 2024-02-16T10:32:02.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 shutdown_connections 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe88c034260 0x7fe88c036720 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/910032984 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd5aeb20 0x5640fd5aef40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 >> 172.21.15.138:0/910032984 conn(0x5640fd5a3830 msgr2=0x5640fd5a4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 shutdown_connections 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/910032984 wait complete. 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 msgr2=0x5640fd5b5ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 0x5640fd5b5ef0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 msgr2=0x5640fd5bb400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 0x5640fd5bb400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 msgr2=0x7fe938036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 0x7fe938036770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea4c01b050 tx=0x7fea4c0c2e90 comp rx=0 tx=0).stop 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 msgr2=0x5640fd580e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:02.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fea4c018eb0 tx=0x7fea4c018020 comp rx=0 tx=0).stop 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 shutdown_connections 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x5640fd5b8fb0 0x5640fd5bb400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5640fd5b3b00 0x5640fd5b5ef0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe9380342b0 0x7fe938036770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 --2- 172.21.15.138:0/3566330009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5640fd402cf0 0x5640fd580e60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 >> 172.21.15.138:0/3566330009 conn(0x5640fd488fa0 msgr2=0x5640fd5746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 shutdown_connections 2024-02-16T10:32:02.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:02.195+0000 7fea552bc980 1 -- 172.21.15.138:0/3566330009 wait complete. 2024-02-16T10:32:02.211 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"56ab4e6d-2e06-4b6b-ad50-3371060fac3a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-02-16T10:32:02.211 DEBUG:tasks.util.rgw: json result: {'id': '56ab4e6d-2e06-4b6b-ad50-3371060fac3a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-02-16T10:32:02.215 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks/radosgw_admin.py", line 1133, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000003ded8e9e76a71822-0065cf39a2-4227-default4227-default-default 2024-02-16T10:32:02.545 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2fe278560e52440eaf78739548c05c4b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_6a4516ad3eca4b7cf7d93b64055992bfc2113285/qa/tasks/radosgw_admin.py", line 1133, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000003ded8e9e76a71822-0065cf39a2-4227-default4227-default-default 2024-02-16T10:32:02.547 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-02-16T10:32:02.555 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-02-16T10:32:02.556 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:32:02.559 INFO:tasks.rgw.client.0.smithi138.stdout:2024-02-16T10:32:02.551+0000 7fa7a4cf3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28279) UID: 0 2024-02-16T10:32:02.559 INFO:tasks.rgw.client.0.smithi138.stdout:2024-02-16T10:32:02.551+0000 7fa7a853ba40 -1 shutting down 2024-02-16T10:32:06.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-02-16T10:32:08.658 INFO:tasks.rgw.client.0:Stopped 2024-02-16T10:32:08.658 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-02-16T10:32:08.664 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/vault-root-token 2024-02-16T10:32:08.718 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-02-16T10:32:08.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-02-16T10:32:08.718 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-02-16T10:32:08.798 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-02-16T10:32:08.798 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-02-16T10:32:08.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f160584d980 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5650712917d0 0x565071291bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f160584d980 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5650711dbb50 con 0x5650712920f0 2024-02-16T10:32:08.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f160584d980 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x5650711a2d30 con 0x5650712917d0 2024-02-16T10:32:08.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1603368640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5650712917d0 0x565071291bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1603368640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x5650712917d0 0x565071291bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43198/0 (socket says 172.21.15.138:43198) 2024-02-16T10:32:08.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1603368640 1 -- 172.21.15.138:0/1022282976 learned_addr learned my addr 172.21.15.138:0/1022282976 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1602b67640 1 --1- 172.21.15.138:0/1022282976 >> v1:172.21.15.107:6789/0 conn(0x5650712920f0 0x565071292aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.138:34280/0 (socket says 172.21.15.138:34280) 2024-02-16T10:32:08.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1603368640 1 -- 172.21.15.138:0/1022282976 >> v1:172.21.15.107:6789/0 conn(0x5650712920f0 legacy=0x565071292aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:08.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.795+0000 7f1603368640 1 -- 172.21.15.138:0/1022282976 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650712932d0 con 0x5650712917d0 2024-02-16T10:32:08.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f1603368640 1 --2- 172.21.15.138:0/1022282976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x565071291bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f15f400a4e0 tx=0x7f15f401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d918a19fdbd7076d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f1602366640 1 -- 172.21.15.138:0/1022282976 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40aa540 con 0x5650712917d0 2024-02-16T10:32:08.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f1602366640 1 -- 172.21.15.138:0/1022282976 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40a6070 con 0x5650712917d0 2024-02-16T10:32:08.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f1602366640 1 -- 172.21.15.138:0/1022282976 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40aa850 con 0x5650712917d0 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 -- 172.21.15.138:0/1022282976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 msgr2=0x565071291bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 --2- 172.21.15.138:0/1022282976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x565071291bb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f15f400a4e0 tx=0x7f15f401b090 comp rx=0 tx=0).stop 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 -- 172.21.15.138:0/1022282976 shutdown_connections 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 --2- 172.21.15.138:0/1022282976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x565071291bb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 -- 172.21.15.138:0/1022282976 >> 172.21.15.138:0/1022282976 conn(0x565071204ef0 msgr2=0x565071205300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:08.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 -- 172.21.15.138:0/1022282976 shutdown_connections 2024-02-16T10:32:08.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.799+0000 7f160584d980 1 -- 172.21.15.138:0/1022282976 wait complete. 2024-02-16T10:32:08.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f160584d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f160584d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507119ffc0 con 0x5650712917d0 2024-02-16T10:32:08.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f1603368640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f1603368640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43212/0 (socket says 172.21.15.138:43212) 2024-02-16T10:32:08.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.815+0000 7f1603368640 1 -- 172.21.15.138:0/1394443853 learned_addr learned my addr 172.21.15.138:0/1394443853 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 -- 172.21.15.138:0/1394443853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f400a1c0 con 0x5650712917d0 2024-02-16T10:32:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 --2- 172.21.15.138:0/1394443853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15f4019740 tx=0x7f15f40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4bce7a6493c221 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f14f160a640 1 -- 172.21.15.138:0/1394443853 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40aa6f0 con 0x5650712917d0 2024-02-16T10:32:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f14f160a640 1 -- 172.21.15.138:0/1394443853 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40aa850 con 0x5650712917d0 2024-02-16T10:32:08.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f14f160a640 1 -- 172.21.15.138:0/1394443853 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40aaaf0 con 0x5650712917d0 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- 172.21.15.138:0/1394443853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 msgr2=0x56507137bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 --2- 172.21.15.138:0/1394443853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15f4019740 tx=0x7f15f40033b0 comp rx=0 tx=0).stop 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- 172.21.15.138:0/1394443853 shutdown_connections 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 --2- 172.21.15.138:0/1394443853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712917d0 0x56507137bde0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- 172.21.15.138:0/1394443853 >> 172.21.15.138:0/1394443853 conn(0x565071204ef0 msgr2=0x565071377970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:08.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- 172.21.15.138:0/1394443853 shutdown_connections 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- 172.21.15.138:0/1394443853 wait complete. 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f160584d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507119b7a0 con 0x5650712920f0 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43224/0 (socket says 172.21.15.138:43224) 2024-02-16T10:32:08.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 -- 172.21.15.138:0/4212329173 learned_addr learned my addr 172.21.15.138:0/4212329173 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650712932d0 con 0x5650712920f0 2024-02-16T10:32:08.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.819+0000 7f1603368640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15f4019740 tx=0x7f15f4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 -- 172.21.15.138:0/4212329173 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40c3070 con 0x5650712920f0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 -- 172.21.15.138:0/4212329173 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40b5570 con 0x5650712920f0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565071383300 con 0x5650712920f0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 -- 172.21.15.138:0/4212329173 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f40b5810 con 0x5650712920f0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650713837b0 con 0x5650712920f0 2024-02-16T10:32:08.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 -- 172.21.15.138:0/4212329173 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f15f40a8070 con 0x5650712920f0 2024-02-16T10:32:08.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 0x7f14e8036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f14efe07640 1 -- 172.21.15.138:0/4212329173 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f15f40e3be0 con 0x5650712920f0 2024-02-16T10:32:08.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1602b67640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 0x7f14e8036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 0x565071389e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56507138a380 con 0x565071387a50 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1603b69640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 0x565071389e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1602b67640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 0x7f14e8036810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f15f8001e50 tx=0x7f15f80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1603b69640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 0x565071389e40 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1603b69640 1 -- 172.21.15.138:0/4212329173 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15fc0083f0 con 0x565071387a50 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56507138a770 con 0x565071387a50 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f1603b69640 1 -- 172.21.15.138:0/4212329173 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f15fc0083f0 con 0x565071387a50 2024-02-16T10:32:08.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.823+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56507138c020 con 0x565071387a50 2024-02-16T10:32:08.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 -- 172.21.15.138:0/4212329173 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [call out=48b,read 0~922 out=922b] v0'0 uv7 ondisk = 0) v8 ==== 232+0+970 (crc 0 0 0) 0x7f15fc0083f0 con 0x565071387a50 2024-02-16T10:32:08.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56507138b2e0 con 0x565071387a50 2024-02-16T10:32:08.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 -- 172.21.15.138:0/4212329173 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f15fc0083f0 con 0x565071387a50 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 0x56507138f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:5 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56507138f8e0 con 0x7f15fc00e000 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603368640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 0x56507138f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603368640 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 0x56507138f3a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603368640 1 -- 172.21.15.138:0/4212329173 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(5 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc00e000 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x565071133f20 con 0x56507139d680 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43226/0 (socket says 172.21.15.138:43226) 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 -- 172.21.15.138:0/1432297733 learned_addr learned my addr 172.21.15.138:0/1432297733 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 -- 172.21.15.138:0/1432297733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56507139dfe0 con 0x56507139d680 2024-02-16T10:32:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f1603b69640 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x565071383fc0 tx=0x7f15fc00e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f14ed602640 1 -- 172.21.15.138:0/1432297733 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc00f040 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f14ed602640 1 -- 172.21.15.138:0/1432297733 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc019550 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56507139e230 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f14ed602640 1 -- 172.21.15.138:0/1432297733 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc0197f0 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.827+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56507139ed80 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14ed602640 1 -- 172.21.15.138:0/1432297733 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f15fc019950 con 0x56507139d680 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14ed602640 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 0x7f14dc0367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14ed602640 1 -- 172.21.15.138:0/1432297733 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f15fc04b5a0 con 0x56507139d680 2024-02-16T10:32:08.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603368640 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 0x7f14dc0367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603368640 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 0x7f14dc0367c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f15f401b930 tx=0x7f15f40b43a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x565071127790 con 0x5650713aa5c0 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43232/0 (socket says 172.21.15.138:43232) 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603b69640 1 -- 172.21.15.138:0/1575057761 learned_addr learned my addr 172.21.15.138:0/1575057761 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603b69640 1 -- 172.21.15.138:0/1575057761 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650713aaf20 con 0x5650713aa5c0 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f1603b69640 1 --2- 172.21.15.138:0/1575057761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f15fc049820 tx=0x7f15fc02a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af39484ef6a6156 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14e6ffd640 1 -- 172.21.15.138:0/1575057761 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc048070 con 0x5650713aa5c0 2024-02-16T10:32:08.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14e6ffd640 1 -- 172.21.15.138:0/1575057761 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc03b560 con 0x5650713aa5c0 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f14e6ffd640 1 -- 172.21.15.138:0/1575057761 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc018520 con 0x5650713aa5c0 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- 172.21.15.138:0/1575057761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 msgr2=0x5650713aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 --2- 172.21.15.138:0/1575057761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f15fc049820 tx=0x7f15fc02a350 comp rx=0 tx=0).stop 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- 172.21.15.138:0/1575057761 shutdown_connections 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 --2- 172.21.15.138:0/1575057761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713aa9e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- 172.21.15.138:0/1575057761 >> 172.21.15.138:0/1575057761 conn(0x5650713a51e0 msgr2=0x5650713a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- 172.21.15.138:0/1575057761 shutdown_connections 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.831+0000 7f160584d980 1 -- 172.21.15.138:0/1575057761 wait complete. 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 Processor -- start 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 -- start start 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650713b19b0 con 0x5650713aa5c0 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603b69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.138:43234/0 (socket says 172.21.15.138:43234) 2024-02-16T10:32:08.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 learned_addr learned my addr 172.21.15.138:0/1427076119 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-16T10:32:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56507139ed80 con 0x5650713aa5c0 2024-02-16T10:32:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603b69640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0486f0 tx=0x7f15fc0497b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 -- 172.21.15.138:0/1427076119 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc015ed0 con 0x5650713aa5c0 2024-02-16T10:32:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650713b1bb0 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 -- 172.21.15.138:0/1427076119 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc015730 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 -- 172.21.15.138:0/1427076119 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15fc0159d0 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650713b2040 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 -- 172.21.15.138:0/1427076119 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f15fc048070 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14cc0342b0 0x7f14cc036770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f14e57fa640 1 -- 172.21.15.138:0/1427076119 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f15fc00c0b0 con 0x5650713aa5c0 2024-02-16T10:32:08.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1603368640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14cc0342b0 0x7f14cc036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5650713bcae0 0x5650713befa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713bf6f0 con 0x5650713bcae0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.835+0000 7f1602b67640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5650713bcae0 0x5650713befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14cc0342b0 0x7f14cc036770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15f40c7b70 tx=0x7f15f40da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5650713bcae0 0x5650713befa0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 realm 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713bbf40 con 0x5650713bcae0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c0130 con 0x5650713bcae0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713bfdc0 con 0x5650713bcae0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:08.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:5 5.19 5:9e4f2f30:::zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c0ef0 con 0x5650713bcae0 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 5 ==== osd_op_reply(5 zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a [read 0~922 out=922b] v0'0 uv7 ondisk = 0) v8 ==== 190+0+922 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 rados_obj.operate() r=0 bl.length=922 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 20 searching for the correct realm 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5650713c2e40 0x5650713c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650713c2e40 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603b69640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5650713c2e40 0x5650713c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603b69640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5650713c2e40 0x5650713c52d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc012070 con 0x5650713c2e40 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603b69640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc03b050 0x7f15fc0358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x7f15fc03b050 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc03b050 0x7f15fc0358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc03b050 0x7f15fc0358a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x5650712917d0 0x7f15f40c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:08.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.839+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650712917d0 2024-02-16T10:32:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x5650712917d0 0x7f15f40c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x5650712917d0 0x7f15f40c67f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 8 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c59a0 con 0x5650712917d0 2024-02-16T10:32:08.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.843+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 9 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650712917d0 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 10 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 11 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 12 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v33'7 uv7 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.847+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650712917d0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=112b] v33'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 13 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650712917d0 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650712917d0 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713c2e40 2024-02-16T10:32:08.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.851+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650712917d0 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x5650713bcae0 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 14 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f15f802d040 con 0x7f15fc03b050 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-02-16T10:32:08.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got zone_info.56ab4e6d-2e06-4b6b-ad50-3371060fac3a 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got default.zone. 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got zone_names.default 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c18e0 con 0x5650713bcae0 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c2130 con 0x5650713bcae0 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 16 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=0 bl.length=46 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:40 5.d 5:b733ac54:::zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c5de0 con 0x7f15fc03b050 2024-02-16T10:32:08.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 8 ==== osd_op_reply(40 zonegroup_info.813c5b9c-efe5-457a-a257-626d766e0618 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=0 bl.length=421 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 zone default found 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 4 Realm: () 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 4 ZoneGroup: default (813c5b9c-efe5-457a-a257-626d766e0618) 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 4 Zone: default (56ab4e6d-2e06-4b6b-ad50-3371060fac3a) 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 zonegroup default 2024-02-16T10:32:08.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c6140 con 0x5650712917d0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c7ed0 con 0x5650713c2e40 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados->read ofs=0 len=0 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c82c0 con 0x5650713c2e40 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 rados_obj.operate() r=-2 bl.length=0 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 started sync module instance, tier type = 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 20 started zone id=56ab4e6d-2e06-4b6b-ad50-3371060fac3a (name=default) with tier type = 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.855+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c77b0 con 0x7f15fc03b050 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 9 ==== osd_op_reply(44 notify.0 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f40b47c0 con 0x7f15fc03b050 2024-02-16T10:32:08.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903497159440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c7b60 con 0x7f15fc03b050 2024-02-16T10:32:08.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c90a0 con 0x5650713bcae0 2024-02-16T10:32:08.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903497159440] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 17 ==== osd_op_reply(46 notify.1 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903497164512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c9450 con 0x5650713bcae0 2024-02-16T10:32:08.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.859+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c9dc0 con 0x5650713c2e40 2024-02-16T10:32:08.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903497164512] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 12 ==== osd_op_reply(48 notify.2 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903497165568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c9dc0 con 0x5650713c2e40 2024-02-16T10:32:08.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713ca7c0 con 0x7f15fc03b050 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 11 ==== osd_op_reply(50 notify.3 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903497171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cb010 con 0x7f15fc03b050 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.863+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cbab0 con 0x5650713bcae0 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903497165568] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903497171680] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 19 ==== osd_op_reply(52 notify.4 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903497173872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c9920 con 0x5650713bcae0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cc300 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903497173872] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 9 ==== osd_op_reply(54 notify.5 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903497176464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cc260 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.867+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713ccbd0 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.871+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 10 ==== osd_op_reply(56 notify.6 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.871+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903497176464] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.871+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903497180976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713ccb50 con 0x5650712917d0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.871+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cd530 con 0x5650712917d0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903497180976] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 13 ==== osd_op_reply(58 notify.7 [create] v33'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903497178480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cd4f0 con 0x5650712917d0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=0 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=1 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=2 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=3 2024-02-16T10:32:08.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=4 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=5 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=6 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903497178480] v33'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 20 add_watcher() i=7 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 2 all 8 watchers are set, enabling cache 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d0970 con 0x5650713bcae0 2024-02-16T10:32:08.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.875+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903497183776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cdeb0 con 0x5650713bcae0 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903497183776] v33'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f14b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f160584d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f160584d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d8fe0 con 0x5650713bcae0 2024-02-16T10:32:08.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.879+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d9480 con 0x5650712917d0 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d9880 con 0x5650713c2e40 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d9db0 con 0x5650713bcae0 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'241 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.883+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713da2e0 con 0x7f15fc03b050 2024-02-16T10:32:08.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'77 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713da810 con 0x5650713c2e40 2024-02-16T10:32:08.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dacb0 con 0x5650713bcae0 2024-02-16T10:32:08.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.887+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dacb0 con 0x5650712917d0 2024-02-16T10:32:08.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.891+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'52 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.891+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dacb0 con 0x7f15fc03b050 2024-02-16T10:32:08.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.891+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.891+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713db1e0 con 0x5650713c2e40 2024-02-16T10:32:08.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.895+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.895+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713db1e0 con 0x7f15fc03b050 2024-02-16T10:32:08.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.895+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'78 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.895+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713db710 con 0x5650712917d0 2024-02-16T10:32:08.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.899+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.899+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713db710 con 0x7f15fc03b050 2024-02-16T10:32:08.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.899+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.899+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650712917d0 2024-02-16T10:32:08.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'59 uv41 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713bcae0 2024-02-16T10:32:08.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'242 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'73 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.903+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x7f15fc03b050 2024-02-16T10:32:08.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.907+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'79 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.907+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.907+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.907+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713bcae0 2024-02-16T10:32:08.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.911+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.911+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713bcae0 2024-02-16T10:32:08.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.911+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'243 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.911+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'74 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x7f15fc03b050 2024-02-16T10:32:08.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.915+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'26 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.919+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650712917d0 2024-02-16T10:32:08.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.923+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.923+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.923+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.923+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650712917d0 2024-02-16T10:32:08.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.927+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'53 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.927+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650713c2e40 2024-02-16T10:32:08.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.931+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'75 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.931+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x5650712917d0 2024-02-16T10:32:08.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.931+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'60 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.931+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713dabb0 con 0x7f15fc03b050 2024-02-16T10:32:08.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f14b8fe1640 20 reqs_thread_entry: start 2024-02-16T10:32:08.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 20 init_complete bucket index max shards: 11 2024-02-16T10:32:08.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 20 Filter name: none 2024-02-16T10:32:08.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f14327fc640 20 reqs_thread_entry: start 2024-02-16T10:32:08.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-02-16T10:32:08.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:94 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 26 ==== osd_op_reply(94 gc.24 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:95 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 27 ==== osd_op_reply(95 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:96 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 28 ==== osd_op_reply(96 gc.24 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:97 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 29 ==== osd_op_reply(97 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.935+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:98 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 30 ==== osd_op_reply(98 gc.24 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:99 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 31 ==== osd_op_reply(99 gc.24 [call] v33'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-02-16T10:32:08.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:100 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 32 ==== osd_op_reply(100 gc.25 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:101 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 33 ==== osd_op_reply(101 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:102 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 34 ==== osd_op_reply(102 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:103 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 35 ==== osd_op_reply(103 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:104 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 36 ==== osd_op_reply(104 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.939+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:105 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 37 ==== osd_op_reply(105 gc.25 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-02-16T10:32:08.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:106 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 22 ==== osd_op_reply(106 gc.26 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:107 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 23 ==== osd_op_reply(107 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.943+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:108 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:08.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 24 ==== osd_op_reply(108 gc.26 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:109 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 25 ==== osd_op_reply(109 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:110 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 26 ==== osd_op_reply(110 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 27 ==== osd_op_reply(111 gc.26 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-02-16T10:32:08.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.947+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:112 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 38 ==== osd_op_reply(112 gc.27 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:113 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 39 ==== osd_op_reply(113 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 40 ==== osd_op_reply(114 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 41 ==== osd_op_reply(115 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 42 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:117 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 43 ==== osd_op_reply(117 gc.27 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-02-16T10:32:08.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.951+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 28 ==== osd_op_reply(118 gc.28 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 29 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:120 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 30 ==== osd_op_reply(120 gc.28 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:121 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 31 ==== osd_op_reply(121 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.955+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:122 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 32 ==== osd_op_reply(122 gc.28 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:123 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 33 ==== osd_op_reply(123 gc.28 [call] v33'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-02-16T10:32:08.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.959+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:124 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 44 ==== osd_op_reply(124 gc.29 [call] v33'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:125 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 45 ==== osd_op_reply(125 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:126 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 46 ==== osd_op_reply(126 gc.29 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:127 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 47 ==== osd_op_reply(127 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:128 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 48 ==== osd_op_reply(128 gc.29 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:129 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 49 ==== osd_op_reply(129 gc.29 [call] v33'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-02-16T10:32:08.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.963+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:130 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 34 ==== osd_op_reply(130 gc.30 [call] v33'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:131 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 35 ==== osd_op_reply(131 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:132 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:08.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 36 ==== osd_op_reply(132 gc.30 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.967+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:133 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 37 ==== osd_op_reply(133 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:134 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 38 ==== osd_op_reply(134 gc.30 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:135 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 39 ==== osd_op_reply(135 gc.30 [call] v33'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-02-16T10:32:08.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.971+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:136 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:08.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 20 ==== osd_op_reply(136 gc.31 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:137 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:08.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 21 ==== osd_op_reply(137 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:138 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 22 ==== osd_op_reply(138 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:139 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 23 ==== osd_op_reply(139 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:140 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 24 ==== osd_op_reply(140 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.975+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:141 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 25 ==== osd_op_reply(141 gc.31 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:08.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-02-16T10:32:08.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:142 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:08.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 29 ==== osd_op_reply(142 gc.0 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:143 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:08.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 30 ==== osd_op_reply(143 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.979+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:144 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 31 ==== osd_op_reply(144 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:145 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 32 ==== osd_op_reply(145 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:146 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 33 ==== osd_op_reply(146 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:147 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:08.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 34 ==== osd_op_reply(147 gc.0 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:08.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-02-16T10:32:08.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.983+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:148 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 40 ==== osd_op_reply(148 gc.1 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:149 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 41 ==== osd_op_reply(149 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:150 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:08.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 42 ==== osd_op_reply(150 gc.1 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.987+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:151 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 43 ==== osd_op_reply(151 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:08.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:152 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 44 ==== osd_op_reply(152 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:153 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:08.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 45 ==== osd_op_reply(153 gc.1 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:08.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-02-16T10:32:08.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.991+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:154 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 50 ==== osd_op_reply(154 gc.2 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:155 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 51 ==== osd_op_reply(155 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:156 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 52 ==== osd_op_reply(156 gc.2 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:08.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:157 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 53 ==== osd_op_reply(157 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:158 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 54 ==== osd_op_reply(158 gc.2 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:159 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 55 ==== osd_op_reply(159 gc.2 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-02-16T10:32:09.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.995+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:160 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 35 ==== osd_op_reply(160 gc.3 [call] v33'244 uv244 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:161 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 36 ==== osd_op_reply(161 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:162 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 37 ==== osd_op_reply(162 gc.3 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:163 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 38 ==== osd_op_reply(163 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:164 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 39 ==== osd_op_reply(164 gc.3 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:08.999+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:165 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 40 ==== osd_op_reply(165 gc.3 [call] v33'245 uv245 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-02-16T10:32:09.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:166 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 26 ==== osd_op_reply(166 gc.4 [call] v33'80 uv80 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:167 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 27 ==== osd_op_reply(167 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:168 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 28 ==== osd_op_reply(168 gc.4 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:169 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 29 ==== osd_op_reply(169 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:170 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 30 ==== osd_op_reply(170 gc.4 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.003+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:171 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 31 ==== osd_op_reply(171 gc.4 [call] v33'81 uv81 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-02-16T10:32:09.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:172 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 56 ==== osd_op_reply(172 gc.5 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:173 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 57 ==== osd_op_reply(173 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:174 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 58 ==== osd_op_reply(174 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:175 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 59 ==== osd_op_reply(175 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:176 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.007+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 60 ==== osd_op_reply(176 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.011+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.011+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:177 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.011+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 61 ==== osd_op_reply(177 gc.5 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.011+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-02-16T10:32:09.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.011+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:178 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 41 ==== osd_op_reply(178 gc.6 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:179 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 42 ==== osd_op_reply(179 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:180 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 43 ==== osd_op_reply(180 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:181 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 44 ==== osd_op_reply(181 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:182 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 45 ==== osd_op_reply(182 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.015+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:183 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 46 ==== osd_op_reply(183 gc.6 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-02-16T10:32:09.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:184 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 46 ==== osd_op_reply(184 gc.7 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:185 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.019+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 47 ==== osd_op_reply(185 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:186 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:09.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 48 ==== osd_op_reply(186 gc.7 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:187 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 49 ==== osd_op_reply(187 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:188 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 50 ==== osd_op_reply(188 gc.7 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.023+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:189 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.027+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 51 ==== osd_op_reply(189 gc.7 [call] v33'57 uv57 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.027+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-02-16T10:32:09.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.027+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:190 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.027+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 32 ==== osd_op_reply(190 gc.8 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.027+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:191 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 33 ==== osd_op_reply(191 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:192 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 34 ==== osd_op_reply(192 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:193 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 35 ==== osd_op_reply(193 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:194 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 36 ==== osd_op_reply(194 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.031+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:195 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 37 ==== osd_op_reply(195 gc.8 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-02-16T10:32:09.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:196 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 62 ==== osd_op_reply(196 gc.9 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:197 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 63 ==== osd_op_reply(197 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:198 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 64 ==== osd_op_reply(198 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:199 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 65 ==== osd_op_reply(199 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.035+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:200 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 66 ==== osd_op_reply(200 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:201 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 67 ==== osd_op_reply(201 gc.9 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-02-16T10:32:09.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:202 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.039+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 38 ==== osd_op_reply(202 gc.10 [call] v33'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:203 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 39 ==== osd_op_reply(203 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:204 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 40 ==== osd_op_reply(204 gc.10 [call out=24b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:205 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 41 ==== osd_op_reply(205 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:206 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 42 ==== osd_op_reply(206 gc.10 [call out=15b] v0'0 uv82 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.043+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:207 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.047+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 43 ==== osd_op_reply(207 gc.10 [call] v33'83 uv83 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.047+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-02-16T10:32:09.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.047+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:208 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.047+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 52 ==== osd_op_reply(208 gc.11 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.047+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:209 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 53 ==== osd_op_reply(209 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:210 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 54 ==== osd_op_reply(210 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:211 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 55 ==== osd_op_reply(211 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:212 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 56 ==== osd_op_reply(212 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.051+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:213 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.055+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 57 ==== osd_op_reply(213 gc.11 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.055+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-02-16T10:32:09.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.055+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:214 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.055+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 44 ==== osd_op_reply(214 gc.12 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.055+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:215 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 45 ==== osd_op_reply(215 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:216 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 46 ==== osd_op_reply(216 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:217 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 47 ==== osd_op_reply(217 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:218 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 48 ==== osd_op_reply(218 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:219 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 49 ==== osd_op_reply(219 gc.12 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-02-16T10:32:09.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.059+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:220 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 58 ==== osd_op_reply(220 gc.13 [call] v33'63 uv63 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:221 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 59 ==== osd_op_reply(221 gc.13 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:222 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650712917d0 2024-02-16T10:32:09.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 60 ==== osd_op_reply(222 gc.13 [call out=24b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.063+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:223 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 61 ==== osd_op_reply(223 gc.13 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:224 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 62 ==== osd_op_reply(224 gc.13 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:225 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650712917d0 2024-02-16T10:32:09.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 63 ==== osd_op_reply(225 gc.13 [call] v33'64 uv64 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-02-16T10:32:09.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.067+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:226 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 47 ==== osd_op_reply(226 gc.14 [call] v33'246 uv246 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:227 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 48 ==== osd_op_reply(227 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:228 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 49 ==== osd_op_reply(228 gc.14 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:229 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 50 ==== osd_op_reply(229 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:230 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 51 ==== osd_op_reply(230 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.071+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:231 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.075+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 52 ==== osd_op_reply(231 gc.14 [call] v33'247 uv247 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.075+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-02-16T10:32:09.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.075+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:232 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 68 ==== osd_op_reply(232 gc.15 [call] v33'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:233 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 69 ==== osd_op_reply(233 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:234 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 70 ==== osd_op_reply(234 gc.15 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:235 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 71 ==== osd_op_reply(235 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:236 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 72 ==== osd_op_reply(236 gc.15 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.079+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:237 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 73 ==== osd_op_reply(237 gc.15 [call] v33'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-02-16T10:32:09.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:238 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 50 ==== osd_op_reply(238 gc.16 [call] v33'84 uv84 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:239 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 51 ==== osd_op_reply(239 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.083+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:240 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 52 ==== osd_op_reply(240 gc.16 [call out=24b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:241 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 53 ==== osd_op_reply(241 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:242 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 54 ==== osd_op_reply(242 gc.16 [call out=15b] v0'0 uv84 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:243 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 55 ==== osd_op_reply(243 gc.16 [call] v33'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-02-16T10:32:09.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.087+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:244 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 74 ==== osd_op_reply(244 gc.17 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:245 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 75 ==== osd_op_reply(245 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:246 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 76 ==== osd_op_reply(246 gc.17 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:247 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 77 ==== osd_op_reply(247 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:248 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 78 ==== osd_op_reply(248 gc.17 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.091+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:249 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.095+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 79 ==== osd_op_reply(249 gc.17 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.095+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-02-16T10:32:09.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.095+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:250 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.095+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 53 ==== osd_op_reply(250 gc.18 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:251 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 54 ==== osd_op_reply(251 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:252 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 55 ==== osd_op_reply(252 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:253 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 56 ==== osd_op_reply(253 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:254 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 57 ==== osd_op_reply(254 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:255 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 58 ==== osd_op_reply(255 gc.18 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-02-16T10:32:09.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.099+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:256 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 59 ==== osd_op_reply(256 gc.19 [call] v33'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:257 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 60 ==== osd_op_reply(257 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:258 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713bcae0 2024-02-16T10:32:09.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 61 ==== osd_op_reply(258 gc.19 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:259 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 62 ==== osd_op_reply(259 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:260 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 63 ==== osd_op_reply(260 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.103+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:261 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713bcae0 2024-02-16T10:32:09.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.107+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 64 ==== osd_op_reply(261 gc.19 [call] v33'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.107+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-02-16T10:32:09.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.107+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:262 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 80 ==== osd_op_reply(262 gc.20 [call] v33'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:263 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 81 ==== osd_op_reply(263 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:264 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 82 ==== osd_op_reply(264 gc.20 [call out=24b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:265 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 83 ==== osd_op_reply(265 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:266 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 84 ==== osd_op_reply(266 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.111+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:267 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.115+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 85 ==== osd_op_reply(267 gc.20 [call] v33'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.115+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-02-16T10:32:09.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.115+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:268 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.115+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 56 ==== osd_op_reply(268 gc.21 [call] v33'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.115+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:269 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 57 ==== osd_op_reply(269 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:270 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x7f15fc03b050 2024-02-16T10:32:09.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 58 ==== osd_op_reply(270 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:271 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 59 ==== osd_op_reply(271 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:272 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 60 ==== osd_op_reply(272 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:273 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x7f15fc03b050 2024-02-16T10:32:09.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 61 ==== osd_op_reply(273 gc.21 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-02-16T10:32:09.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.119+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:274 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 86 ==== osd_op_reply(274 gc.22 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:275 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 87 ==== osd_op_reply(275 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:276 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 88 ==== osd_op_reply(276 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:277 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 89 ==== osd_op_reply(277 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:278 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 90 ==== osd_op_reply(278 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.123+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:279 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 91 ==== osd_op_reply(279 gc.22 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-02-16T10:32:09.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:280 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 92 ==== osd_op_reply(280 gc.23 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:281 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 93 ==== osd_op_reply(281 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:282 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713d6940 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 94 ==== osd_op_reply(282 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:283 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 95 ==== osd_op_reply(283 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:284 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.127+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 96 ==== osd_op_reply(284 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.131+0000 7f160584d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-02-16T10:32:09.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.131+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:285 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713f6e80 con 0x5650713c2e40 2024-02-16T10:32:09.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.131+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 97 ==== osd_op_reply(285 gc.23 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.131+0000 7f14b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-02-16T10:32:09.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.131+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903497183776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713b67c0 con 0x5650713bcae0 2024-02-16T10:32:09.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 65 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94903497183776] v33'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903497159440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cd1f0 con 0x7f15fc03b050 2024-02-16T10:32:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 62 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94903497159440] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f160584d980 20 remove_watcher() i=0 2024-02-16T10:32:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f160584d980 2 removed watcher, disabling cache 2024-02-16T10:32:09.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.135+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903497164512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c7310 con 0x5650713bcae0 2024-02-16T10:32:09.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.139+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 66 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94903497164512] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.139+0000 7f160584d980 20 remove_watcher() i=1 2024-02-16T10:32:09.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.139+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903497165568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c7310 con 0x5650713c2e40 2024-02-16T10:32:09.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f1603b69640 1 -- 172.21.15.138:0/1427076119 <== osd.3 v2:172.21.15.138:6800/756089529 98 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94903497165568] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15fc05f040 con 0x5650713c2e40 2024-02-16T10:32:09.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f160584d980 20 remove_watcher() i=2 2024-02-16T10:32:09.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903497171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c8b80 con 0x7f15fc03b050 2024-02-16T10:32:09.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f1603368640 1 -- 172.21.15.138:0/1427076119 <== osd.2 v2:172.21.15.138:6815/3134970710 63 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94903497171680] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f4109040 con 0x7f15fc03b050 2024-02-16T10:32:09.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f160584d980 20 remove_watcher() i=3 2024-02-16T10:32:09.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.143+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903497173872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713c8b80 con 0x5650713bcae0 2024-02-16T10:32:09.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.147+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.1 v2:172.21.15.138:6802/802812406 67 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94903497173872] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650713bcae0 2024-02-16T10:32:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.147+0000 7f160584d980 20 remove_watcher() i=4 2024-02-16T10:32:09.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.147+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903497176464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cab70 con 0x5650712917d0 2024-02-16T10:32:09.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 64 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94903497176464] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f160584d980 20 remove_watcher() i=5 2024-02-16T10:32:09.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903497180976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cb590 con 0x5650712917d0 2024-02-16T10:32:09.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 65 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94903497180976] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f160584d980 20 remove_watcher() i=6 2024-02-16T10:32:09.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.151+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903497178480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5650713cc730 con 0x5650712917d0 2024-02-16T10:32:09.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 <== osd.0 v2:172.21.15.107:6800/1630367885 66 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94903497178480] v33'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f15f800f6a0 con 0x5650712917d0 2024-02-16T10:32:09.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 20 remove_watcher() i=7 2024-02-16T10:32:09.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x5650712917d0 msgr2=0x7f15f40c67f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x5650712917d0 0x7f15f40c67f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5650713bcae0 msgr2=0x5650713befa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x5650713bcae0 0x5650713befa0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc03b050 msgr2=0x7f15fc0358a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc03b050 0x7f15fc0358a0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5650713c2e40 msgr2=0x5650713c52d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x5650713c2e40 0x5650713c52d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14cc0342b0 msgr2=0x7f14cc036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14cc0342b0 0x7f14cc036770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15f40c7b70 tx=0x7f15f40da000 comp rx=0 tx=0).stop 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 msgr2=0x5650713b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f1602b67640 1 -- 172.21.15.138:0/1427076119 reap_dead start 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0486f0 tx=0x7f15fc0497b0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 shutdown_connections 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1427076119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650713aa5c0 0x5650713b1470 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 >> 172.21.15.138:0/1427076119 conn(0x5650713a51e0 msgr2=0x5650713a60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 shutdown_connections 2024-02-16T10:32:09.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1427076119 wait complete. 2024-02-16T10:32:09.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 msgr2=0x7f14dc0367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 0x7f14dc0367c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f15f401b930 tx=0x7f15f40b43a0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 msgr2=0x56507139daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x565071383fc0 tx=0x7f15fc00e900 comp rx=0 tx=0).stop 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 shutdown_connections 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14dc034300 0x7f14dc0367c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 --2- 172.21.15.138:0/1432297733 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56507139d680 0x56507139daa0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.155+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 >> 172.21.15.138:0/1432297733 conn(0x565071392490 msgr2=0x565071392fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 shutdown_connections 2024-02-16T10:32:09.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/1432297733 wait complete. 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 msgr2=0x565071389e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 0x565071389e40 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 msgr2=0x56507138f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 0x56507138f3a0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 msgr2=0x7f14e8036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 0x7f14e8036810 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f15f8001e50 tx=0x7f15f80013b0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 msgr2=0x565071382dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15f4019740 tx=0x7f15f4017e30 comp rx=0 tx=0).stop 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 shutdown_connections 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f15fc00e000 0x56507138f3a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x565071387a50 0x565071389e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f14e8034350 0x7f14e8036810 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 --2- 172.21.15.138:0/4212329173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5650712920f0 0x565071382dc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 >> 172.21.15.138:0/4212329173 conn(0x565071204ef0 msgr2=0x565071376480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 shutdown_connections 2024-02-16T10:32:09.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-16T10:32:09.159+0000 7f160584d980 1 -- 172.21.15.138:0/4212329173 wait complete. 2024-02-16T10:32:09.179 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-16T10:32:09.188 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-16T10:32:09.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:09.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d74a2640 1 Processor -- start 2024-02-16T10:32:09.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d74a2640 1 -- start start 2024-02-16T10:32:09.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d74a2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79d006f8b0 0x7f79d012c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d74a2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d0072450 con 0x7f79d012c750 2024-02-16T10:32:09.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d74a2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d012cb60 con 0x7f79d006f8b0 2024-02-16T10:32:09.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d523e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79d006f8b0 0x7f79d012c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d4a3d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f79d012c750 0x7f79d0128690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41076/0 (socket says 172.21.15.107:41076) 2024-02-16T10:32:09.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.311+0000 7f79d4a3d640 1 -- 172.21.15.107:0/1000239129 learned_addr learned my addr 172.21.15.107:0/1000239129 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:09.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d523e640 1 -- 172.21.15.107:0/1000239129 >> v1:172.21.15.107:6789/0 conn(0x7f79d012c750 legacy=0x7f79d0128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79c7fff640 1 -- 172.21.15.107:0/1000239129 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179427226 0 0) 0x7f79d0072450 con 0x7f79d012c750 2024-02-16T10:32:09.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d523e640 1 -- 172.21.15.107:0/1000239129 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d012bed0 con 0x7f79d006f8b0 2024-02-16T10:32:09.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d523e640 1 --2- 172.21.15.107:0/1000239129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d012c210 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009740 tx=0x7f79cc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca0b4be82f52d5d server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79c7fff640 1 -- 172.21.15.107:0/1000239129 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79cc0ab530 con 0x7f79d006f8b0 2024-02-16T10:32:09.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79c7fff640 1 -- 172.21.15.107:0/1000239129 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc0a7050 con 0x7f79d006f8b0 2024-02-16T10:32:09.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79c7fff640 1 -- 172.21.15.107:0/1000239129 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79cc0ab7e0 con 0x7f79d006f8b0 2024-02-16T10:32:09.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 -- 172.21.15.107:0/1000239129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 msgr2=0x7f79d012c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 --2- 172.21.15.107:0/1000239129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d012c210 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009740 tx=0x7f79cc01c370 comp rx=0 tx=0).stop 2024-02-16T10:32:09.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 -- 172.21.15.107:0/1000239129 shutdown_connections 2024-02-16T10:32:09.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 --2- 172.21.15.107:0/1000239129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d012c210 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 -- 172.21.15.107:0/1000239129 >> 172.21.15.107:0/1000239129 conn(0x7f79d009a1c0 msgr2=0x7f79d009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 -- 172.21.15.107:0/1000239129 shutdown_connections 2024-02-16T10:32:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.315+0000 7f79d74a2640 1 -- 172.21.15.107:0/1000239129 wait complete. 2024-02-16T10:32:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 Processor -- start 2024-02-16T10:32:09.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 -- start start 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d012b600 con 0x7f79d006f8b0 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d523e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d523e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50424/0 (socket says 172.21.15.107:50424) 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d523e640 1 -- 172.21.15.107:0/952086628 learned_addr learned my addr 172.21.15.107:0/952086628 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:09.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d523e640 1 -- 172.21.15.107:0/952086628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009420 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d523e640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f79cc019fa0 tx=0x7f79cc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79cc0abe20 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d01134c0 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79cc004160 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d0116dc0 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d0115550 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79cc0b2050 con 0x7f79d006f8b0 2024-02-16T10:32:09.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d0115cb0 con 0x7f79d006f8b0 2024-02-16T10:32:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 0x7f79b4037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f79cc0e2c10 con 0x7f79d006f8b0 2024-02-16T10:32:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.319+0000 7f79d4a3d640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 0x7f79b4037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.323+0000 7f79d4a3d640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 0x7f79b4037e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007fd0 tx=0x7f79c0007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.323+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f79cc003620 con 0x7f79d006f8b0 2024-02-16T10:32:09.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.479+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79d0062980 con 0x7f79b40359c0 2024-02-16T10:32:09.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.555+0000 7f79c5ffb640 1 -- 172.21.15.107:0/952086628 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673523 (secure 0 0 0) 0x7f79d0062980 con 0x7f79b40359c0 2024-02-16T10:32:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:09.575 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:09.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 msgr2=0x7f79b4037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 0x7f79b4037e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f79c0007fd0 tx=0x7f79c0007920 comp rx=0 tx=0).stop 2024-02-16T10:32:09.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 msgr2=0x7f79d01c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f79cc019fa0 tx=0x7f79cc01abb0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 shutdown_connections 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f79b40359c0 0x7f79b4037e80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 --2- 172.21.15.107:0/952086628 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79d006f8b0 0x7f79d01c5880 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 >> 172.21.15.107:0/952086628 conn(0x7f79d009a1c0 msgr2=0x7f79d0126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 shutdown_connections 2024-02-16T10:32:09.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.563+0000 7f79d74a2640 1 -- 172.21.15.107:0/952086628 wait complete. 2024-02-16T10:32:09.591 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-02-16T10:32:07.860266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3804,"num_read_kb":3447,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1179,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":381,"num_read_kb":364,"num_write":117,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005741"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916908+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:31:06.916908+0000","last_peered":"2024-02-16T10:31:06.916908+0000","last_clean":"2024-02-16T10:31:06.916908+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:31:06.916908+0000","last_undegraded":"2024-02-16T10:31:06.916908+0000","last_fullsized":"2024-02-16T10:31:06.916908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354394+0000","last_change":"2024-02-16T10:30:28.072642+0000","last_active":"2024-02-16T10:31:55.354394+0000","last_peered":"2024-02-16T10:31:55.354394+0000","last_clean":"2024-02-16T10:31:55.354394+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:31:55.354394+0000","last_undegraded":"2024-02-16T10:31:55.354394+0000","last_fullsized":"2024-02-16T10:31:55.354394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929412+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:31:06.929412+0000","last_peered":"2024-02-16T10:31:06.929412+0000","last_clean":"2024-02-16T10:31:06.929412+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:31:06.929412+0000","last_undegraded":"2024-02-16T10:31:06.929412+0000","last_fullsized":"2024-02-16T10:31:06.929412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918157+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918157+0000","last_peered":"2024-02-16T10:31:06.918157+0000","last_clean":"2024-02-16T10:31:06.918157+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918157+0000","last_undegraded":"2024-02-16T10:31:06.918157+0000","last_fullsized":"2024-02-16T10:31:06.918157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:41.510090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976695+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:31:11.976695+0000","last_peered":"2024-02-16T10:31:11.976695+0000","last_clean":"2024-02-16T10:31:11.976695+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:31:11.976695+0000","last_undegraded":"2024-02-16T10:31:11.976695+0000","last_fullsized":"2024-02-16T10:31:11.976695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:13.252426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920793+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920793+0000","last_peered":"2024-02-16T10:31:06.920793+0000","last_clean":"2024-02-16T10:31:06.920793+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920793+0000","last_undegraded":"2024-02-16T10:31:06.920793+0000","last_fullsized":"2024-02-16T10:31:06.920793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:41.339005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914702+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:31:06.914702+0000","last_peered":"2024-02-16T10:31:06.914702+0000","last_clean":"2024-02-16T10:31:06.914702+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:31:06.914702+0000","last_undegraded":"2024-02-16T10:31:06.914702+0000","last_fullsized":"2024-02-16T10:31:06.914702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920918+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.920918+0000","last_peered":"2024-02-16T10:31:06.920918+0000","last_clean":"2024-02-16T10:31:06.920918+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.920918+0000","last_undegraded":"2024-02-16T10:31:06.920918+0000","last_fullsized":"2024-02-16T10:31:06.920918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:09.881305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.503530+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.503530+0000","last_peered":"2024-02-16T10:31:54.503530+0000","last_clean":"2024-02-16T10:31:54.503530+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.503530+0000","last_undegraded":"2024-02-16T10:31:54.503530+0000","last_fullsized":"2024-02-16T10:31:54.503530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:17.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003130+0000","last_change":"2024-02-16T10:30:28.081973+0000","last_active":"2024-02-16T10:32:01.003130+0000","last_peered":"2024-02-16T10:32:01.003130+0000","last_clean":"2024-02-16T10:32:01.003130+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:01.003130+0000","last_undegraded":"2024-02-16T10:32:01.003130+0000","last_fullsized":"2024-02-16T10:32:01.003130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908534+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908534+0000","last_peered":"2024-02-16T10:31:06.908534+0000","last_clean":"2024-02-16T10:31:06.908534+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908534+0000","last_undegraded":"2024-02-16T10:31:06.908534+0000","last_fullsized":"2024-02-16T10:31:06.908534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925777+0000","last_change":"2024-02-16T10:30:28.083981+0000","last_active":"2024-02-16T10:31:06.925777+0000","last_peered":"2024-02-16T10:31:06.925777+0000","last_clean":"2024-02-16T10:31:06.925777+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:31:06.925777+0000","last_undegraded":"2024-02-16T10:31:06.925777+0000","last_fullsized":"2024-02-16T10:31:06.925777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:38.936680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916403+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.916403+0000","last_peered":"2024-02-16T10:31:06.916403+0000","last_clean":"2024-02-16T10:31:06.916403+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.916403+0000","last_undegraded":"2024-02-16T10:31:06.916403+0000","last_fullsized":"2024-02-16T10:31:06.916403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:03.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354647+0000","last_change":"2024-02-16T10:30:28.078739+0000","last_active":"2024-02-16T10:31:55.354647+0000","last_peered":"2024-02-16T10:31:55.354647+0000","last_clean":"2024-02-16T10:31:55.354647+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:31:55.354647+0000","last_undegraded":"2024-02-16T10:31:55.354647+0000","last_fullsized":"2024-02-16T10:31:55.354647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925042+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925042+0000","last_peered":"2024-02-16T10:31:06.925042+0000","last_clean":"2024-02-16T10:31:06.925042+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925042+0000","last_undegraded":"2024-02-16T10:31:06.925042+0000","last_fullsized":"2024-02-16T10:31:06.925042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686117+0000","last_change":"2024-02-16T10:30:28.063141+0000","last_active":"2024-02-16T10:31:12.686117+0000","last_peered":"2024-02-16T10:31:12.686117+0000","last_clean":"2024-02-16T10:31:12.686117+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:31:12.686117+0000","last_undegraded":"2024-02-16T10:31:12.686117+0000","last_fullsized":"2024-02-16T10:31:12.686117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915013+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:31:06.915013+0000","last_peered":"2024-02-16T10:31:06.915013+0000","last_clean":"2024-02-16T10:31:06.915013+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:31:06.915013+0000","last_undegraded":"2024-02-16T10:31:06.915013+0000","last_fullsized":"2024-02-16T10:31:06.915013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:03.383909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929156+0000","last_change":"2024-02-16T10:30:26.098135+0000","last_active":"2024-02-16T10:31:06.929156+0000","last_peered":"2024-02-16T10:31:06.929156+0000","last_clean":"2024-02-16T10:31:06.929156+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:31:06.929156+0000","last_undegraded":"2024-02-16T10:31:06.929156+0000","last_fullsized":"2024-02-16T10:31:06.929156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915167+0000","last_change":"2024-02-16T10:30:28.080080+0000","last_active":"2024-02-16T10:31:06.915167+0000","last_peered":"2024-02-16T10:31:06.915167+0000","last_clean":"2024-02-16T10:31:06.915167+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:31:06.915167+0000","last_undegraded":"2024-02-16T10:31:06.915167+0000","last_fullsized":"2024-02-16T10:31:06.915167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.994634+0000","last_change":"2024-02-16T10:30:26.086548+0000","last_active":"2024-02-16T10:32:00.994634+0000","last_peered":"2024-02-16T10:32:00.994634+0000","last_clean":"2024-02-16T10:32:00.994634+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:00.994634+0000","last_undegraded":"2024-02-16T10:32:00.994634+0000","last_fullsized":"2024-02-16T10:32:00.994634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366482+0000","last_change":"2024-02-16T10:30:28.082308+0000","last_active":"2024-02-16T10:31:55.366482+0000","last_peered":"2024-02-16T10:31:55.366482+0000","last_clean":"2024-02-16T10:31:55.366482+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:31:55.366482+0000","last_undegraded":"2024-02-16T10:31:55.366482+0000","last_fullsized":"2024-02-16T10:31:55.366482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926645+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:31:06.926645+0000","last_peered":"2024-02-16T10:31:06.926645+0000","last_clean":"2024-02-16T10:31:06.926645+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:31:06.926645+0000","last_undegraded":"2024-02-16T10:31:06.926645+0000","last_fullsized":"2024-02-16T10:31:06.926645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927940+0000","last_change":"2024-02-16T10:30:28.066522+0000","last_active":"2024-02-16T10:31:06.927940+0000","last_peered":"2024-02-16T10:31:06.927940+0000","last_clean":"2024-02-16T10:31:06.927940+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:31:06.927940+0000","last_undegraded":"2024-02-16T10:31:06.927940+0000","last_fullsized":"2024-02-16T10:31:06.927940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925646+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:31:06.925646+0000","last_peered":"2024-02-16T10:31:06.925646+0000","last_clean":"2024-02-16T10:31:06.925646+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:31:06.925646+0000","last_undegraded":"2024-02-16T10:31:06.925646+0000","last_fullsized":"2024-02-16T10:31:06.925646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.655926+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.655926+0000","last_peered":"2024-02-16T10:31:11.655926+0000","last_clean":"2024-02-16T10:31:11.655926+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.655926+0000","last_undegraded":"2024-02-16T10:31:11.655926+0000","last_fullsized":"2024-02-16T10:31:11.655926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927666+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:31:06.927666+0000","last_peered":"2024-02-16T10:31:06.927666+0000","last_clean":"2024-02-16T10:31:06.927666+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:31:06.927666+0000","last_undegraded":"2024-02-16T10:31:06.927666+0000","last_fullsized":"2024-02-16T10:31:06.927666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657215+0000","last_change":"2024-02-16T10:30:28.084327+0000","last_active":"2024-02-16T10:31:11.657215+0000","last_peered":"2024-02-16T10:31:11.657215+0000","last_clean":"2024-02-16T10:31:11.657215+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:31:11.657215+0000","last_undegraded":"2024-02-16T10:31:11.657215+0000","last_fullsized":"2024-02-16T10:31:11.657215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:06.450863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919484+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:31:06.919484+0000","last_peered":"2024-02-16T10:31:06.919484+0000","last_clean":"2024-02-16T10:31:06.919484+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:31:06.919484+0000","last_undegraded":"2024-02-16T10:31:06.919484+0000","last_fullsized":"2024-02-16T10:31:06.919484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:40:58.824376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.985103+0000","last_change":"2024-02-16T10:30:36.142641+0000","last_active":"2024-02-16T10:32:00.985103+0000","last_peered":"2024-02-16T10:32:00.985103+0000","last_clean":"2024-02-16T10:32:00.985103+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:00.985103+0000","last_undegraded":"2024-02-16T10:32:00.985103+0000","last_fullsized":"2024-02-16T10:32:00.985103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:21.049073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.684138+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:31:12.684138+0000","last_peered":"2024-02-16T10:31:12.684138+0000","last_clean":"2024-02-16T10:31:12.684138+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:31:12.684138+0000","last_undegraded":"2024-02-16T10:31:12.684138+0000","last_fullsized":"2024-02-16T10:31:12.684138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:54.640122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919653+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:31:06.919653+0000","last_peered":"2024-02-16T10:31:06.919653+0000","last_clean":"2024-02-16T10:31:06.919653+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:31:06.919653+0000","last_undegraded":"2024-02-16T10:31:06.919653+0000","last_fullsized":"2024-02-16T10:31:06.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.559382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.938309+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.938309+0000","last_peered":"2024-02-16T10:31:06.938309+0000","last_clean":"2024-02-16T10:31:06.938309+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.938309+0000","last_undegraded":"2024-02-16T10:31:06.938309+0000","last_fullsized":"2024-02-16T10:31:06.938309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:35.001597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.310393+0000","last_change":"2024-02-16T10:30:32.121571+0000","last_active":"2024-02-16T10:31:55.310393+0000","last_peered":"2024-02-16T10:31:55.310393+0000","last_clean":"2024-02-16T10:31:55.310393+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:31:55.310393+0000","last_undegraded":"2024-02-16T10:31:55.310393+0000","last_fullsized":"2024-02-16T10:31:55.310393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:46.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928644+0000","last_change":"2024-02-16T10:30:34.125614+0000","last_active":"2024-02-16T10:31:06.928644+0000","last_peered":"2024-02-16T10:31:06.928644+0000","last_clean":"2024-02-16T10:31:06.928644+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:31:06.928644+0000","last_undegraded":"2024-02-16T10:31:06.928644+0000","last_fullsized":"2024-02-16T10:31:06.928644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.441324+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:49.441324+0000","last_peered":"2024-02-16T10:31:49.441324+0000","last_clean":"2024-02-16T10:31:49.441324+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:49.441324+0000","last_undegraded":"2024-02-16T10:31:49.441324+0000","last_fullsized":"2024-02-16T10:31:49.441324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:28.899004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996497+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:11.996497+0000","last_peered":"2024-02-16T10:31:11.996497+0000","last_clean":"2024-02-16T10:31:11.996497+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:11.996497+0000","last_undegraded":"2024-02-16T10:31:11.996497+0000","last_fullsized":"2024-02-16T10:31:11.996497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:02.014700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907578+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:31:06.907578+0000","last_peered":"2024-02-16T10:31:06.907578+0000","last_clean":"2024-02-16T10:31:06.907578+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:31:06.907578+0000","last_undegraded":"2024-02-16T10:31:06.907578+0000","last_fullsized":"2024-02-16T10:31:06.907578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932531+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:06.932531+0000","last_peered":"2024-02-16T10:31:06.932531+0000","last_clean":"2024-02-16T10:31:06.932531+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:06.932531+0000","last_undegraded":"2024-02-16T10:31:06.932531+0000","last_fullsized":"2024-02-16T10:31:06.932531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:01.288368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927053+0000","last_change":"2024-02-16T10:30:32.097568+0000","last_active":"2024-02-16T10:31:06.927053+0000","last_peered":"2024-02-16T10:31:06.927053+0000","last_clean":"2024-02-16T10:31:06.927053+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:31:06.927053+0000","last_undegraded":"2024-02-16T10:31:06.927053+0000","last_fullsized":"2024-02-16T10:31:06.927053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:48.421929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926352+0000","last_change":"2024-02-16T10:30:34.132449+0000","last_active":"2024-02-16T10:31:06.926352+0000","last_peered":"2024-02-16T10:31:06.926352+0000","last_clean":"2024-02-16T10:31:06.926352+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:31:06.926352+0000","last_undegraded":"2024-02-16T10:31:06.926352+0000","last_fullsized":"2024-02-16T10:31:06.926352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924189+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924189+0000","last_peered":"2024-02-16T10:31:06.924189+0000","last_clean":"2024-02-16T10:31:06.924189+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924189+0000","last_undegraded":"2024-02-16T10:31:06.924189+0000","last_fullsized":"2024-02-16T10:31:06.924189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003292+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.003292+0000","last_peered":"2024-02-16T10:32:01.003292+0000","last_clean":"2024-02-16T10:32:01.003292+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.003292+0000","last_undegraded":"2024-02-16T10:32:01.003292+0000","last_fullsized":"2024-02-16T10:32:01.003292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:16.057698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915976+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:31:06.915976+0000","last_peered":"2024-02-16T10:31:06.915976+0000","last_clean":"2024-02-16T10:31:06.915976+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:31:06.915976+0000","last_undegraded":"2024-02-16T10:31:06.915976+0000","last_fullsized":"2024-02-16T10:31:06.915976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:43.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932467+0000","last_change":"2024-02-16T10:30:30.080558+0000","last_active":"2024-02-16T10:31:06.932467+0000","last_peered":"2024-02-16T10:31:06.932467+0000","last_clean":"2024-02-16T10:31:06.932467+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:31:06.932467+0000","last_undegraded":"2024-02-16T10:31:06.932467+0000","last_fullsized":"2024-02-16T10:31:06.932467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914049+0000","last_change":"2024-02-16T10:30:32.096519+0000","last_active":"2024-02-16T10:31:06.914049+0000","last_peered":"2024-02-16T10:31:06.914049+0000","last_clean":"2024-02-16T10:31:06.914049+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:31:06.914049+0000","last_undegraded":"2024-02-16T10:31:06.914049+0000","last_fullsized":"2024-02-16T10:31:06.914049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:11.152738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.255838+0000","last_change":"2024-02-16T10:30:34.141896+0000","last_active":"2024-02-16T10:32:01.255838+0000","last_peered":"2024-02-16T10:32:01.255838+0000","last_clean":"2024-02-16T10:32:01.255838+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:01.255838+0000","last_undegraded":"2024-02-16T10:32:01.255838+0000","last_fullsized":"2024-02-16T10:32:01.255838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911474+0000","last_change":"2024-02-16T10:30:36.135895+0000","last_active":"2024-02-16T10:31:06.911474+0000","last_peered":"2024-02-16T10:31:06.911474+0000","last_clean":"2024-02-16T10:31:06.911474+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:31:06.911474+0000","last_undegraded":"2024-02-16T10:31:06.911474+0000","last_fullsized":"2024-02-16T10:31:06.911474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:52.487219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003499+0000","last_change":"2024-02-16T10:30:28.088671+0000","last_active":"2024-02-16T10:32:01.003499+0000","last_peered":"2024-02-16T10:32:01.003499+0000","last_clean":"2024-02-16T10:32:01.003499+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:01.003499+0000","last_undegraded":"2024-02-16T10:32:01.003499+0000","last_fullsized":"2024-02-16T10:32:01.003499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915727+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:31:06.915727+0000","last_peered":"2024-02-16T10:31:06.915727+0000","last_clean":"2024-02-16T10:31:06.915727+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:31:06.915727+0000","last_undegraded":"2024-02-16T10:31:06.915727+0000","last_fullsized":"2024-02-16T10:31:06.915727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:23.730310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928540+0000","last_change":"2024-02-16T10:30:30.101708+0000","last_active":"2024-02-16T10:31:06.928540+0000","last_peered":"2024-02-16T10:31:06.928540+0000","last_clean":"2024-02-16T10:31:06.928540+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:31:06.928540+0000","last_undegraded":"2024-02-16T10:31:06.928540+0000","last_fullsized":"2024-02-16T10:31:06.928540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:12.591167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.302243+0000","last_change":"2024-02-16T10:30:32.098362+0000","last_active":"2024-02-16T10:31:55.302243+0000","last_peered":"2024-02-16T10:31:55.302243+0000","last_clean":"2024-02-16T10:31:55.302243+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:31:55.302243+0000","last_undegraded":"2024-02-16T10:31:55.302243+0000","last_fullsized":"2024-02-16T10:31:55.302243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:06.260410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.263475+0000","last_change":"2024-02-16T10:30:34.123300+0000","last_active":"2024-02-16T10:32:01.263475+0000","last_peered":"2024-02-16T10:32:01.263475+0000","last_clean":"2024-02-16T10:32:01.263475+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:01.263475+0000","last_undegraded":"2024-02-16T10:32:01.263475+0000","last_fullsized":"2024-02-16T10:32:01.263475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914537+0000","last_change":"2024-02-16T10:30:28.076250+0000","last_active":"2024-02-16T10:31:06.914537+0000","last_peered":"2024-02-16T10:31:06.914537+0000","last_clean":"2024-02-16T10:31:06.914537+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:31:06.914537+0000","last_undegraded":"2024-02-16T10:31:06.914537+0000","last_fullsized":"2024-02-16T10:31:06.914537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:55.536607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916055+0000","last_change":"2024-02-16T10:30:26.085100+0000","last_active":"2024-02-16T10:31:06.916055+0000","last_peered":"2024-02-16T10:31:06.916055+0000","last_clean":"2024-02-16T10:31:06.916055+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:31:06.916055+0000","last_undegraded":"2024-02-16T10:31:06.916055+0000","last_fullsized":"2024-02-16T10:31:06.916055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914345+0000","last_change":"2024-02-16T10:30:30.090540+0000","last_active":"2024-02-16T10:31:06.914345+0000","last_peered":"2024-02-16T10:31:06.914345+0000","last_clean":"2024-02-16T10:31:06.914345+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:31:06.914345+0000","last_undegraded":"2024-02-16T10:31:06.914345+0000","last_fullsized":"2024-02-16T10:31:06.914345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:57.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.316729+0000","last_change":"2024-02-16T10:30:32.090733+0000","last_active":"2024-02-16T10:31:55.316729+0000","last_peered":"2024-02-16T10:31:55.316729+0000","last_clean":"2024-02-16T10:31:55.316729+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:31:55.316729+0000","last_undegraded":"2024-02-16T10:31:55.316729+0000","last_fullsized":"2024-02-16T10:31:55.316729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:14.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927184+0000","last_change":"2024-02-16T10:30:34.130521+0000","last_active":"2024-02-16T10:31:06.927184+0000","last_peered":"2024-02-16T10:31:06.927184+0000","last_clean":"2024-02-16T10:31:06.927184+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:31:06.927184+0000","last_undegraded":"2024-02-16T10:31:06.927184+0000","last_fullsized":"2024-02-16T10:31:06.927184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:16.619978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.089594+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:31:55.089594+0000","last_peered":"2024-02-16T10:31:55.089594+0000","last_clean":"2024-02-16T10:31:55.089594+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:31:55.089594+0000","last_undegraded":"2024-02-16T10:31:55.089594+0000","last_fullsized":"2024-02-16T10:31:55.089594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:35.549647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.355411+0000","last_change":"2024-02-16T10:30:28.072768+0000","last_active":"2024-02-16T10:31:55.355411+0000","last_peered":"2024-02-16T10:31:55.355411+0000","last_clean":"2024-02-16T10:31:55.355411+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:31:55.355411+0000","last_undegraded":"2024-02-16T10:31:55.355411+0000","last_fullsized":"2024-02-16T10:31:55.355411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921914+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:31:06.921914+0000","last_peered":"2024-02-16T10:31:06.921914+0000","last_clean":"2024-02-16T10:31:06.921914+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:31:06.921914+0000","last_undegraded":"2024-02-16T10:31:06.921914+0000","last_fullsized":"2024-02-16T10:31:06.921914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925241+0000","last_change":"2024-02-16T10:30:30.092397+0000","last_active":"2024-02-16T10:31:06.925241+0000","last_peered":"2024-02-16T10:31:06.925241+0000","last_clean":"2024-02-16T10:31:06.925241+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:31:06.925241+0000","last_undegraded":"2024-02-16T10:31:06.925241+0000","last_fullsized":"2024-02-16T10:31:06.925241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:17:37.092874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.287165+0000","last_change":"2024-02-16T10:30:32.120960+0000","last_active":"2024-02-16T10:31:55.287165+0000","last_peered":"2024-02-16T10:31:55.287165+0000","last_clean":"2024-02-16T10:31:55.287165+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:31:55.287165+0000","last_undegraded":"2024-02-16T10:31:55.287165+0000","last_fullsized":"2024-02-16T10:31:55.287165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:15.954493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925210+0000","last_change":"2024-02-16T10:30:34.135930+0000","last_active":"2024-02-16T10:31:06.925210+0000","last_peered":"2024-02-16T10:31:06.925210+0000","last_clean":"2024-02-16T10:31:06.925210+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:31:06.925210+0000","last_undegraded":"2024-02-16T10:31:06.925210+0000","last_fullsized":"2024-02-16T10:31:06.925210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.305924+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:31:49.305924+0000","last_peered":"2024-02-16T10:31:49.305924+0000","last_clean":"2024-02-16T10:31:49.305924+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:31:49.305924+0000","last_undegraded":"2024-02-16T10:31:49.305924+0000","last_fullsized":"2024-02-16T10:31:49.305924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.201148+0000","last_change":"2024-02-16T10:30:28.064067+0000","last_active":"2024-02-16T10:31:11.201148+0000","last_peered":"2024-02-16T10:31:11.201148+0000","last_clean":"2024-02-16T10:31:11.201148+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:31:11.201148+0000","last_undegraded":"2024-02-16T10:31:11.201148+0000","last_fullsized":"2024-02-16T10:31:11.201148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:05.987067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927937+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:31:06.927937+0000","last_peered":"2024-02-16T10:31:06.927937+0000","last_clean":"2024-02-16T10:31:06.927937+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:31:06.927937+0000","last_undegraded":"2024-02-16T10:31:06.927937+0000","last_fullsized":"2024-02-16T10:31:06.927937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:20.023353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926646+0000","last_change":"2024-02-16T10:30:30.080329+0000","last_active":"2024-02-16T10:31:06.926646+0000","last_peered":"2024-02-16T10:31:06.926646+0000","last_clean":"2024-02-16T10:31:06.926646+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:31:06.926646+0000","last_undegraded":"2024-02-16T10:31:06.926646+0000","last_fullsized":"2024-02-16T10:31:06.926646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:30.180346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.319591+0000","last_change":"2024-02-16T10:30:32.116257+0000","last_active":"2024-02-16T10:31:55.319591+0000","last_peered":"2024-02-16T10:31:55.319591+0000","last_clean":"2024-02-16T10:31:55.319591+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:31:55.319591+0000","last_undegraded":"2024-02-16T10:31:55.319591+0000","last_fullsized":"2024-02-16T10:31:55.319591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:52.854962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.265989+0000","last_change":"2024-02-16T10:30:34.135819+0000","last_active":"2024-02-16T10:32:01.265989+0000","last_peered":"2024-02-16T10:32:01.265989+0000","last_clean":"2024-02-16T10:32:01.265989+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:01.265989+0000","last_undegraded":"2024-02-16T10:32:01.265989+0000","last_fullsized":"2024-02-16T10:32:01.265989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927141+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:31:06.927141+0000","last_peered":"2024-02-16T10:31:06.927141+0000","last_clean":"2024-02-16T10:31:06.927141+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:31:06.927141+0000","last_undegraded":"2024-02-16T10:31:06.927141+0000","last_fullsized":"2024-02-16T10:31:06.927141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:55.920641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657202+0000","last_change":"2024-02-16T10:30:28.068604+0000","last_active":"2024-02-16T10:31:11.657202+0000","last_peered":"2024-02-16T10:31:11.657202+0000","last_clean":"2024-02-16T10:31:11.657202+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:31:11.657202+0000","last_undegraded":"2024-02-16T10:31:11.657202+0000","last_fullsized":"2024-02-16T10:31:11.657202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924328+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:31:06.924328+0000","last_peered":"2024-02-16T10:31:06.924328+0000","last_clean":"2024-02-16T10:31:06.924328+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:31:06.924328+0000","last_undegraded":"2024-02-16T10:31:06.924328+0000","last_fullsized":"2024-02-16T10:31:06.924328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:56.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926096+0000","last_change":"2024-02-16T10:30:30.081734+0000","last_active":"2024-02-16T10:31:06.926096+0000","last_peered":"2024-02-16T10:31:06.926096+0000","last_clean":"2024-02-16T10:31:06.926096+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:31:06.926096+0000","last_undegraded":"2024-02-16T10:31:06.926096+0000","last_fullsized":"2024-02-16T10:31:06.926096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:06.703746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.937216+0000","last_change":"2024-02-16T10:30:32.122915+0000","last_active":"2024-02-16T10:32:00.937216+0000","last_peered":"2024-02-16T10:32:00.937216+0000","last_clean":"2024-02-16T10:32:00.937216+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:00.937216+0000","last_undegraded":"2024-02-16T10:32:00.937216+0000","last_fullsized":"2024-02-16T10:32:00.937216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:06.755062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924769+0000","last_change":"2024-02-16T10:30:34.118800+0000","last_active":"2024-02-16T10:31:06.924769+0000","last_peered":"2024-02-16T10:31:06.924769+0000","last_clean":"2024-02-16T10:31:06.924769+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:31:06.924769+0000","last_undegraded":"2024-02-16T10:31:06.924769+0000","last_fullsized":"2024-02-16T10:31:06.924769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929435+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:31:06.929435+0000","last_peered":"2024-02-16T10:31:06.929435+0000","last_clean":"2024-02-16T10:31:06.929435+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:31:06.929435+0000","last_undegraded":"2024-02-16T10:31:06.929435+0000","last_fullsized":"2024-02-16T10:31:06.929435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:56.882445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.683838+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:31:12.683838+0000","last_peered":"2024-02-16T10:31:12.683838+0000","last_clean":"2024-02-16T10:31:12.683838+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:31:12.683838+0000","last_undegraded":"2024-02-16T10:31:12.683838+0000","last_fullsized":"2024-02-16T10:31:12.683838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:52.232418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926917+0000","last_change":"2024-02-16T10:30:26.098753+0000","last_active":"2024-02-16T10:31:06.926917+0000","last_peered":"2024-02-16T10:31:06.926917+0000","last_clean":"2024-02-16T10:31:06.926917+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:31:06.926917+0000","last_undegraded":"2024-02-16T10:31:06.926917+0000","last_fullsized":"2024-02-16T10:31:06.926917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.061106+0000","last_change":"2024-02-16T10:30:30.080515+0000","last_active":"2024-02-16T10:32:02.061106+0000","last_peered":"2024-02-16T10:32:02.061106+0000","last_clean":"2024-02-16T10:32:02.061106+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:02.061106+0000","last_undegraded":"2024-02-16T10:32:02.061106+0000","last_fullsized":"2024-02-16T10:32:02.061106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:03.555320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.292402+0000","last_change":"2024-02-16T10:30:32.094520+0000","last_active":"2024-02-16T10:31:55.292402+0000","last_peered":"2024-02-16T10:31:55.292402+0000","last_clean":"2024-02-16T10:31:55.292402+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:31:55.292402+0000","last_undegraded":"2024-02-16T10:31:55.292402+0000","last_fullsized":"2024-02-16T10:31:55.292402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:31.069304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.933898+0000","last_change":"2024-02-16T10:30:34.141827+0000","last_active":"2024-02-16T10:31:06.933898+0000","last_peered":"2024-02-16T10:31:06.933898+0000","last_clean":"2024-02-16T10:31:06.933898+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:31:06.933898+0000","last_undegraded":"2024-02-16T10:31:06.933898+0000","last_fullsized":"2024-02-16T10:31:06.933898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:38.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911244+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:31:06.911244+0000","last_peered":"2024-02-16T10:31:06.911244+0000","last_clean":"2024-02-16T10:31:06.911244+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:31:06.911244+0000","last_undegraded":"2024-02-16T10:31:06.911244+0000","last_fullsized":"2024-02-16T10:31:06.911244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:00.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.202587+0000","last_change":"2024-02-16T10:30:28.086917+0000","last_active":"2024-02-16T10:31:11.202587+0000","last_peered":"2024-02-16T10:31:11.202587+0000","last_clean":"2024-02-16T10:31:11.202587+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:31:11.202587+0000","last_undegraded":"2024-02-16T10:31:11.202587+0000","last_fullsized":"2024-02-16T10:31:11.202587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:44.394736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921051+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:31:06.921051+0000","last_peered":"2024-02-16T10:31:06.921051+0000","last_clean":"2024-02-16T10:31:06.921051+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:31:06.921051+0000","last_undegraded":"2024-02-16T10:31:06.921051+0000","last_fullsized":"2024-02-16T10:31:06.921051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926662+0000","last_change":"2024-02-16T10:30:30.082304+0000","last_active":"2024-02-16T10:31:06.926662+0000","last_peered":"2024-02-16T10:31:06.926662+0000","last_clean":"2024-02-16T10:31:06.926662+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:31:06.926662+0000","last_undegraded":"2024-02-16T10:31:06.926662+0000","last_fullsized":"2024-02-16T10:31:06.926662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:59.066509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.335445+0000","last_change":"2024-02-16T10:30:32.091187+0000","last_active":"2024-02-16T10:31:55.335445+0000","last_peered":"2024-02-16T10:31:55.335445+0000","last_clean":"2024-02-16T10:31:55.335445+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:31:55.335445+0000","last_undegraded":"2024-02-16T10:31:55.335445+0000","last_fullsized":"2024-02-16T10:31:55.335445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:59.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.257093+0000","last_change":"2024-02-16T10:30:34.129069+0000","last_active":"2024-02-16T10:32:01.257093+0000","last_peered":"2024-02-16T10:32:01.257093+0000","last_clean":"2024-02-16T10:32:01.257093+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:01.257093+0000","last_undegraded":"2024-02-16T10:32:01.257093+0000","last_fullsized":"2024-02-16T10:32:01.257093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:33.083249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.374319+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:31:55.374319+0000","last_peered":"2024-02-16T10:31:55.374319+0000","last_clean":"2024-02-16T10:31:55.374319+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:31:55.374319+0000","last_undegraded":"2024-02-16T10:31:55.374319+0000","last_fullsized":"2024-02-16T10:31:55.374319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922972+0000","last_change":"2024-02-16T10:30:28.063099+0000","last_active":"2024-02-16T10:31:06.922972+0000","last_peered":"2024-02-16T10:31:06.922972+0000","last_clean":"2024-02-16T10:31:06.922972+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:31:06.922972+0000","last_undegraded":"2024-02-16T10:31:06.922972+0000","last_fullsized":"2024-02-16T10:31:06.922972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.987828+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:31:11.987828+0000","last_peered":"2024-02-16T10:31:11.987828+0000","last_clean":"2024-02-16T10:31:11.987828+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:31:11.987828+0000","last_undegraded":"2024-02-16T10:31:11.987828+0000","last_fullsized":"2024-02-16T10:31:11.987828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:21.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193502+0000","last_change":"2024-02-16T10:30:30.090962+0000","last_active":"2024-02-16T10:32:02.193502+0000","last_peered":"2024-02-16T10:32:02.193502+0000","last_clean":"2024-02-16T10:32:02.193502+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:02.193502+0000","last_undegraded":"2024-02-16T10:32:02.193502+0000","last_fullsized":"2024-02-16T10:32:02.193502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:08.415016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928037+0000","last_change":"2024-02-16T10:30:32.123949+0000","last_active":"2024-02-16T10:31:06.928037+0000","last_peered":"2024-02-16T10:31:06.928037+0000","last_clean":"2024-02-16T10:31:06.928037+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:31:06.928037+0000","last_undegraded":"2024-02-16T10:31:06.928037+0000","last_fullsized":"2024-02-16T10:31:06.928037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:03.303232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.259237+0000","last_change":"2024-02-16T10:30:34.117090+0000","last_active":"2024-02-16T10:32:01.259237+0000","last_peered":"2024-02-16T10:32:01.259237+0000","last_clean":"2024-02-16T10:32:01.259237+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:01.259237+0000","last_undegraded":"2024-02-16T10:32:01.259237+0000","last_fullsized":"2024-02-16T10:32:01.259237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908544+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:31:06.908544+0000","last_peered":"2024-02-16T10:31:06.908544+0000","last_clean":"2024-02-16T10:31:06.908544+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:31:06.908544+0000","last_undegraded":"2024-02-16T10:31:06.908544+0000","last_fullsized":"2024-02-16T10:31:06.908544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:36.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497874+0000","last_change":"2024-02-16T10:30:28.085134+0000","last_active":"2024-02-16T10:31:54.497874+0000","last_peered":"2024-02-16T10:31:54.497874+0000","last_clean":"2024-02-16T10:31:54.497874+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:31:54.497874+0000","last_undegraded":"2024-02-16T10:31:54.497874+0000","last_fullsized":"2024-02-16T10:31:54.497874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:01.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913722+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:31:06.913722+0000","last_peered":"2024-02-16T10:31:06.913722+0000","last_clean":"2024-02-16T10:31:06.913722+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:31:06.913722+0000","last_undegraded":"2024-02-16T10:31:06.913722+0000","last_fullsized":"2024-02-16T10:31:06.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:18.440901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929645+0000","last_change":"2024-02-16T10:30:30.102962+0000","last_active":"2024-02-16T10:31:06.929645+0000","last_peered":"2024-02-16T10:31:06.929645+0000","last_clean":"2024-02-16T10:31:06.929645+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:31:06.929645+0000","last_undegraded":"2024-02-16T10:31:06.929645+0000","last_fullsized":"2024-02-16T10:31:06.929645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:37:30.267642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.312265+0000","last_change":"2024-02-16T10:30:32.094067+0000","last_active":"2024-02-16T10:31:55.312265+0000","last_peered":"2024-02-16T10:31:55.312265+0000","last_clean":"2024-02-16T10:31:55.312265+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:31:55.312265+0000","last_undegraded":"2024-02-16T10:31:55.312265+0000","last_fullsized":"2024-02-16T10:31:55.312265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:49.917930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913640+0000","last_change":"2024-02-16T10:30:34.143148+0000","last_active":"2024-02-16T10:31:06.913640+0000","last_peered":"2024-02-16T10:31:06.913640+0000","last_clean":"2024-02-16T10:31:06.913640+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:31:06.913640+0000","last_undegraded":"2024-02-16T10:31:06.913640+0000","last_fullsized":"2024-02-16T10:31:06.913640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:03.500298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919017+0000","last_change":"2024-02-16T10:30:36.124467+0000","last_active":"2024-02-16T10:31:06.919017+0000","last_peered":"2024-02-16T10:31:06.919017+0000","last_clean":"2024-02-16T10:31:06.919017+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:31:06.919017+0000","last_undegraded":"2024-02-16T10:31:06.919017+0000","last_fullsized":"2024-02-16T10:31:06.919017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:10.069376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.009909+0000","last_change":"2024-02-16T10:30:28.084181+0000","last_active":"2024-02-16T10:31:12.009909+0000","last_peered":"2024-02-16T10:31:12.009909+0000","last_clean":"2024-02-16T10:31:12.009909+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:31:12.009909+0000","last_undegraded":"2024-02-16T10:31:12.009909+0000","last_fullsized":"2024-02-16T10:31:12.009909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:30.459984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911425+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:31:06.911425+0000","last_peered":"2024-02-16T10:31:06.911425+0000","last_clean":"2024-02-16T10:31:06.911425+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:31:06.911425+0000","last_undegraded":"2024-02-16T10:31:06.911425+0000","last_fullsized":"2024-02-16T10:31:06.911425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920241+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:31:06.920241+0000","last_peered":"2024-02-16T10:31:06.920241+0000","last_clean":"2024-02-16T10:31:06.920241+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:31:06.920241+0000","last_undegraded":"2024-02-16T10:31:06.920241+0000","last_fullsized":"2024-02-16T10:31:06.920241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919063+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:31:06.919063+0000","last_peered":"2024-02-16T10:31:06.919063+0000","last_clean":"2024-02-16T10:31:06.919063+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:31:06.919063+0000","last_undegraded":"2024-02-16T10:31:06.919063+0000","last_fullsized":"2024-02-16T10:31:06.919063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.376276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929597+0000","last_change":"2024-02-16T10:30:30.091282+0000","last_active":"2024-02-16T10:31:06.929597+0000","last_peered":"2024-02-16T10:31:06.929597+0000","last_clean":"2024-02-16T10:31:06.929597+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:31:06.929597+0000","last_undegraded":"2024-02-16T10:31:06.929597+0000","last_fullsized":"2024-02-16T10:31:06.929597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:45.940628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.963490+0000","last_change":"2024-02-16T10:30:32.125750+0000","last_active":"2024-02-16T10:32:00.963490+0000","last_peered":"2024-02-16T10:32:00.963490+0000","last_clean":"2024-02-16T10:32:00.963490+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:00.963490+0000","last_undegraded":"2024-02-16T10:32:00.963490+0000","last_fullsized":"2024-02-16T10:32:00.963490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:57:39.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":72,"num_read_kb":76,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927452+0000","last_change":"2024-02-16T10:30:34.135655+0000","last_active":"2024-02-16T10:31:06.927452+0000","last_peered":"2024-02-16T10:31:06.927452+0000","last_clean":"2024-02-16T10:31:06.927452+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:31:06.927452+0000","last_undegraded":"2024-02-16T10:31:06.927452+0000","last_fullsized":"2024-02-16T10:31:06.927452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:22.389333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.026066+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:01.026066+0000","last_peered":"2024-02-16T10:32:01.026066+0000","last_clean":"2024-02-16T10:32:01.026066+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:01.026066+0000","last_undegraded":"2024-02-16T10:32:01.026066+0000","last_fullsized":"2024-02-16T10:32:01.026066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:51.053720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.685163+0000","last_change":"2024-02-16T10:30:28.069523+0000","last_active":"2024-02-16T10:31:12.685163+0000","last_peered":"2024-02-16T10:31:12.685163+0000","last_clean":"2024-02-16T10:31:12.685163+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:31:12.685163+0000","last_undegraded":"2024-02-16T10:31:12.685163+0000","last_fullsized":"2024-02-16T10:31:12.685163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:45.890737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912556+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:31:06.912556+0000","last_peered":"2024-02-16T10:31:06.912556+0000","last_clean":"2024-02-16T10:31:06.912556+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:31:06.912556+0000","last_undegraded":"2024-02-16T10:31:06.912556+0000","last_fullsized":"2024-02-16T10:31:06.912556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.966566+0000","last_change":"2024-02-16T10:30:26.098916+0000","last_active":"2024-02-16T10:31:11.966566+0000","last_peered":"2024-02-16T10:31:11.966566+0000","last_clean":"2024-02-16T10:31:11.966566+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:31:11.966566+0000","last_undegraded":"2024-02-16T10:31:11.966566+0000","last_fullsized":"2024-02-16T10:31:11.966566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934263+0000","last_change":"2024-02-16T10:30:30.102474+0000","last_active":"2024-02-16T10:31:06.934263+0000","last_peered":"2024-02-16T10:31:06.934263+0000","last_clean":"2024-02-16T10:31:06.934263+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:31:06.934263+0000","last_undegraded":"2024-02-16T10:31:06.934263+0000","last_fullsized":"2024-02-16T10:31:06.934263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:06.503438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.250178+0000","last_change":"2024-02-16T10:30:32.096480+0000","last_active":"2024-02-16T10:32:01.250178+0000","last_peered":"2024-02-16T10:32:01.250178+0000","last_clean":"2024-02-16T10:32:01.250178+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:01.250178+0000","last_undegraded":"2024-02-16T10:32:01.250178+0000","last_fullsized":"2024-02-16T10:32:01.250178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:13.908498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923579+0000","last_change":"2024-02-16T10:30:34.141970+0000","last_active":"2024-02-16T10:31:06.923579+0000","last_peered":"2024-02-16T10:31:06.923579+0000","last_clean":"2024-02-16T10:31:06.923579+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:31:06.923579+0000","last_undegraded":"2024-02-16T10:31:06.923579+0000","last_fullsized":"2024-02-16T10:31:06.923579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:53.614440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.457111+0000","last_change":"2024-02-16T10:30:36.139509+0000","last_active":"2024-02-16T10:31:49.457111+0000","last_peered":"2024-02-16T10:31:49.457111+0000","last_clean":"2024-02-16T10:31:49.457111+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:31:49.457111+0000","last_undegraded":"2024-02-16T10:31:49.457111+0000","last_fullsized":"2024-02-16T10:31:49.457111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:50.619455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003297+0000","last_change":"2024-02-16T10:30:28.079105+0000","last_active":"2024-02-16T10:32:01.003297+0000","last_peered":"2024-02-16T10:32:01.003297+0000","last_clean":"2024-02-16T10:32:01.003297+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:01.003297+0000","last_undegraded":"2024-02-16T10:32:01.003297+0000","last_fullsized":"2024-02-16T10:32:01.003297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908820+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:31:06.908820+0000","last_peered":"2024-02-16T10:31:06.908820+0000","last_clean":"2024-02-16T10:31:06.908820+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:31:06.908820+0000","last_undegraded":"2024-02-16T10:31:06.908820+0000","last_fullsized":"2024-02-16T10:31:06.908820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924324+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:31:06.924324+0000","last_peered":"2024-02-16T10:31:06.924324+0000","last_clean":"2024-02-16T10:31:06.924324+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:31:06.924324+0000","last_undegraded":"2024-02-16T10:31:06.924324+0000","last_fullsized":"2024-02-16T10:31:06.924324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915764+0000","last_change":"2024-02-16T10:30:30.078068+0000","last_active":"2024-02-16T10:31:06.915764+0000","last_peered":"2024-02-16T10:31:06.915764+0000","last_clean":"2024-02-16T10:31:06.915764+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:31:06.915764+0000","last_undegraded":"2024-02-16T10:31:06.915764+0000","last_fullsized":"2024-02-16T10:31:06.915764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:40.026302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.261541+0000","last_change":"2024-02-16T10:30:32.091702+0000","last_active":"2024-02-16T10:32:00.261541+0000","last_peered":"2024-02-16T10:32:00.261541+0000","last_clean":"2024-02-16T10:32:00.261541+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:00.261541+0000","last_undegraded":"2024-02-16T10:32:00.261541+0000","last_fullsized":"2024-02-16T10:32:00.261541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:33.175979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927804+0000","last_change":"2024-02-16T10:30:34.138200+0000","last_active":"2024-02-16T10:31:06.927804+0000","last_peered":"2024-02-16T10:31:06.927804+0000","last_clean":"2024-02-16T10:31:06.927804+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:31:06.927804+0000","last_undegraded":"2024-02-16T10:31:06.927804+0000","last_fullsized":"2024-02-16T10:31:06.927804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:20.815431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917885+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:31:06.917885+0000","last_peered":"2024-02-16T10:31:06.917885+0000","last_clean":"2024-02-16T10:31:06.917885+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:31:06.917885+0000","last_undegraded":"2024-02-16T10:31:06.917885+0000","last_fullsized":"2024-02-16T10:31:06.917885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:08.274614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.205515+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:31:11.205515+0000","last_peered":"2024-02-16T10:31:11.205515+0000","last_clean":"2024-02-16T10:31:11.205515+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:31:11.205515+0000","last_undegraded":"2024-02-16T10:31:11.205515+0000","last_fullsized":"2024-02-16T10:31:11.205515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915962+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:31:06.915962+0000","last_peered":"2024-02-16T10:31:06.915962+0000","last_clean":"2024-02-16T10:31:06.915962+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:31:06.915962+0000","last_undegraded":"2024-02-16T10:31:06.915962+0000","last_fullsized":"2024-02-16T10:31:06.915962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912749+0000","last_change":"2024-02-16T10:30:26.084253+0000","last_active":"2024-02-16T10:31:06.912749+0000","last_peered":"2024-02-16T10:31:06.912749+0000","last_clean":"2024-02-16T10:31:06.912749+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:31:06.912749+0000","last_undegraded":"2024-02-16T10:31:06.912749+0000","last_fullsized":"2024-02-16T10:31:06.912749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927392+0000","last_change":"2024-02-16T10:30:30.080063+0000","last_active":"2024-02-16T10:31:06.927392+0000","last_peered":"2024-02-16T10:31:06.927392+0000","last_clean":"2024-02-16T10:31:06.927392+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:31:06.927392+0000","last_undegraded":"2024-02-16T10:31:06.927392+0000","last_fullsized":"2024-02-16T10:31:06.927392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:12.944183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928152+0000","last_change":"2024-02-16T10:30:32.125409+0000","last_active":"2024-02-16T10:31:06.928152+0000","last_peered":"2024-02-16T10:31:06.928152+0000","last_clean":"2024-02-16T10:31:06.928152+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:31:06.928152+0000","last_undegraded":"2024-02-16T10:31:06.928152+0000","last_fullsized":"2024-02-16T10:31:06.928152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:35:51.048004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934645+0000","last_change":"2024-02-16T10:30:34.141949+0000","last_active":"2024-02-16T10:31:06.934645+0000","last_peered":"2024-02-16T10:31:06.934645+0000","last_clean":"2024-02-16T10:31:06.934645+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:31:06.934645+0000","last_undegraded":"2024-02-16T10:31:06.934645+0000","last_fullsized":"2024-02-16T10:31:06.934645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:14:10.316154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.339887+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:31:55.339887+0000","last_peered":"2024-02-16T10:31:55.339887+0000","last_clean":"2024-02-16T10:31:55.339887+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:31:55.339887+0000","last_undegraded":"2024-02-16T10:31:55.339887+0000","last_fullsized":"2024-02-16T10:31:55.339887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:25.468581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354549+0000","last_change":"2024-02-16T10:30:28.065872+0000","last_active":"2024-02-16T10:31:55.354549+0000","last_peered":"2024-02-16T10:31:55.354549+0000","last_clean":"2024-02-16T10:31:55.354549+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:31:55.354549+0000","last_undegraded":"2024-02-16T10:31:55.354549+0000","last_fullsized":"2024-02-16T10:31:55.354549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914991+0000","last_change":"2024-02-16T10:30:26.087305+0000","last_active":"2024-02-16T10:31:06.914991+0000","last_peered":"2024-02-16T10:31:06.914991+0000","last_clean":"2024-02-16T10:31:06.914991+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:31:06.914991+0000","last_undegraded":"2024-02-16T10:31:06.914991+0000","last_fullsized":"2024-02-16T10:31:06.914991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927469+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:31:06.927469+0000","last_peered":"2024-02-16T10:31:06.927469+0000","last_clean":"2024-02-16T10:31:06.927469+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:31:06.927469+0000","last_undegraded":"2024-02-16T10:31:06.927469+0000","last_fullsized":"2024-02-16T10:31:06.927469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926744+0000","last_change":"2024-02-16T10:30:30.079568+0000","last_active":"2024-02-16T10:31:06.926744+0000","last_peered":"2024-02-16T10:31:06.926744+0000","last_clean":"2024-02-16T10:31:06.926744+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:31:06.926744+0000","last_undegraded":"2024-02-16T10:31:06.926744+0000","last_fullsized":"2024-02-16T10:31:06.926744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:12.104297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.981370+0000","last_change":"2024-02-16T10:30:32.088251+0000","last_active":"2024-02-16T10:32:00.981370+0000","last_peered":"2024-02-16T10:32:00.981370+0000","last_clean":"2024-02-16T10:32:00.981370+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:00.981370+0000","last_undegraded":"2024-02-16T10:32:00.981370+0000","last_fullsized":"2024-02-16T10:32:00.981370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:58.667315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906656+0000","last_change":"2024-02-16T10:30:34.119623+0000","last_active":"2024-02-16T10:31:06.906656+0000","last_peered":"2024-02-16T10:31:06.906656+0000","last_clean":"2024-02-16T10:31:06.906656+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:31:06.906656+0000","last_undegraded":"2024-02-16T10:31:06.906656+0000","last_fullsized":"2024-02-16T10:31:06.906656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:22.098837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.337862+0000","last_change":"2024-02-16T10:30:36.121926+0000","last_active":"2024-02-16T10:31:55.337862+0000","last_peered":"2024-02-16T10:31:55.337862+0000","last_clean":"2024-02-16T10:31:55.337862+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:31:55.337862+0000","last_undegraded":"2024-02-16T10:31:55.337862+0000","last_fullsized":"2024-02-16T10:31:55.337862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:27:43.916489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919422+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:31:06.919422+0000","last_peered":"2024-02-16T10:31:06.919422+0000","last_clean":"2024-02-16T10:31:06.919422+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:31:06.919422+0000","last_undegraded":"2024-02-16T10:31:06.919422+0000","last_fullsized":"2024-02-16T10:31:06.919422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:27:43.149715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929126+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:31:06.929126+0000","last_peered":"2024-02-16T10:31:06.929126+0000","last_clean":"2024-02-16T10:31:06.929126+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:31:06.929126+0000","last_undegraded":"2024-02-16T10:31:06.929126+0000","last_fullsized":"2024-02-16T10:31:06.929126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926258+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:31:06.926258+0000","last_peered":"2024-02-16T10:31:06.926258+0000","last_clean":"2024-02-16T10:31:06.926258+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:31:06.926258+0000","last_undegraded":"2024-02-16T10:31:06.926258+0000","last_fullsized":"2024-02-16T10:31:06.926258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915178+0000","last_change":"2024-02-16T10:30:30.100081+0000","last_active":"2024-02-16T10:31:06.915178+0000","last_peered":"2024-02-16T10:31:06.915178+0000","last_clean":"2024-02-16T10:31:06.915178+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:31:06.915178+0000","last_undegraded":"2024-02-16T10:31:06.915178+0000","last_fullsized":"2024-02-16T10:31:06.915178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:04.710974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911662+0000","last_change":"2024-02-16T10:30:32.101750+0000","last_active":"2024-02-16T10:31:06.911662+0000","last_peered":"2024-02-16T10:31:06.911662+0000","last_clean":"2024-02-16T10:31:06.911662+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:31:06.911662+0000","last_undegraded":"2024-02-16T10:31:06.911662+0000","last_fullsized":"2024-02-16T10:31:06.911662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:20.084891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.253565+0000","last_change":"2024-02-16T10:30:34.111985+0000","last_active":"2024-02-16T10:32:01.253565+0000","last_peered":"2024-02-16T10:32:01.253565+0000","last_clean":"2024-02-16T10:32:01.253565+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:01.253565+0000","last_undegraded":"2024-02-16T10:32:01.253565+0000","last_fullsized":"2024-02-16T10:32:01.253565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932415+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:31:06.932415+0000","last_peered":"2024-02-16T10:31:06.932415+0000","last_clean":"2024-02-16T10:31:06.932415+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:31:06.932415+0000","last_undegraded":"2024-02-16T10:31:06.932415+0000","last_fullsized":"2024-02-16T10:31:06.932415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:46.560489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922019+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:06.922019+0000","last_peered":"2024-02-16T10:31:06.922019+0000","last_clean":"2024-02-16T10:31:06.922019+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:06.922019+0000","last_undegraded":"2024-02-16T10:31:06.922019+0000","last_fullsized":"2024-02-16T10:31:06.922019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:17.413905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936126+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:31:06.936126+0000","last_peered":"2024-02-16T10:31:06.936126+0000","last_clean":"2024-02-16T10:31:06.936126+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:31:06.936126+0000","last_undegraded":"2024-02-16T10:31:06.936126+0000","last_fullsized":"2024-02-16T10:31:06.936126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:27.417317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928021+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:31:06.928021+0000","last_peered":"2024-02-16T10:31:06.928021+0000","last_clean":"2024-02-16T10:31:06.928021+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:31:06.928021+0000","last_undegraded":"2024-02-16T10:31:06.928021+0000","last_fullsized":"2024-02-16T10:31:06.928021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915715+0000","last_change":"2024-02-16T10:30:30.097705+0000","last_active":"2024-02-16T10:31:06.915715+0000","last_peered":"2024-02-16T10:31:06.915715+0000","last_clean":"2024-02-16T10:31:06.915715+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:31:06.915715+0000","last_undegraded":"2024-02-16T10:31:06.915715+0000","last_fullsized":"2024-02-16T10:31:06.915715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:01.461744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920148+0000","last_change":"2024-02-16T10:30:32.121333+0000","last_active":"2024-02-16T10:31:06.920148+0000","last_peered":"2024-02-16T10:31:06.920148+0000","last_clean":"2024-02-16T10:31:06.920148+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:31:06.920148+0000","last_undegraded":"2024-02-16T10:31:06.920148+0000","last_fullsized":"2024-02-16T10:31:06.920148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:10.723393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.261495+0000","last_change":"2024-02-16T10:30:34.123666+0000","last_active":"2024-02-16T10:32:01.261495+0000","last_peered":"2024-02-16T10:32:01.261495+0000","last_clean":"2024-02-16T10:32:01.261495+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:01.261495+0000","last_undegraded":"2024-02-16T10:32:01.261495+0000","last_fullsized":"2024-02-16T10:32:01.261495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:37.246851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924998+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:31:06.924998+0000","last_peered":"2024-02-16T10:31:06.924998+0000","last_clean":"2024-02-16T10:31:06.924998+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:31:06.924998+0000","last_undegraded":"2024-02-16T10:31:06.924998+0000","last_fullsized":"2024-02-16T10:31:06.924998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907950+0000","last_change":"2024-02-16T10:30:28.059745+0000","last_active":"2024-02-16T10:31:06.907950+0000","last_peered":"2024-02-16T10:31:06.907950+0000","last_clean":"2024-02-16T10:31:06.907950+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:31:06.907950+0000","last_undegraded":"2024-02-16T10:31:06.907950+0000","last_fullsized":"2024-02-16T10:31:06.907950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:20.455470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926582+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:31:06.926582+0000","last_peered":"2024-02-16T10:31:06.926582+0000","last_clean":"2024-02-16T10:31:06.926582+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:31:06.926582+0000","last_undegraded":"2024-02-16T10:31:06.926582+0000","last_fullsized":"2024-02-16T10:31:06.926582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934928+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:31:06.934928+0000","last_peered":"2024-02-16T10:31:06.934928+0000","last_clean":"2024-02-16T10:31:06.934928+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:31:06.934928+0000","last_undegraded":"2024-02-16T10:31:06.934928+0000","last_fullsized":"2024-02-16T10:31:06.934928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912208+0000","last_change":"2024-02-16T10:30:30.090784+0000","last_active":"2024-02-16T10:31:06.912208+0000","last_peered":"2024-02-16T10:31:06.912208+0000","last_clean":"2024-02-16T10:31:06.912208+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:31:06.912208+0000","last_undegraded":"2024-02-16T10:31:06.912208+0000","last_fullsized":"2024-02-16T10:31:06.912208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:16.786621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.945908+0000","last_change":"2024-02-16T10:30:32.086049+0000","last_active":"2024-02-16T10:32:00.945908+0000","last_peered":"2024-02-16T10:32:00.945908+0000","last_clean":"2024-02-16T10:32:00.945908+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:00.945908+0000","last_undegraded":"2024-02-16T10:32:00.945908+0000","last_fullsized":"2024-02-16T10:32:00.945908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:07.411102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924423+0000","last_change":"2024-02-16T10:30:34.118806+0000","last_active":"2024-02-16T10:31:06.924423+0000","last_peered":"2024-02-16T10:31:06.924423+0000","last_clean":"2024-02-16T10:31:06.924423+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:31:06.924423+0000","last_undegraded":"2024-02-16T10:31:06.924423+0000","last_fullsized":"2024-02-16T10:31:06.924423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917565+0000","last_change":"2024-02-16T10:30:36.134096+0000","last_active":"2024-02-16T10:31:06.917565+0000","last_peered":"2024-02-16T10:31:06.917565+0000","last_clean":"2024-02-16T10:31:06.917565+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:31:06.917565+0000","last_undegraded":"2024-02-16T10:31:06.917565+0000","last_fullsized":"2024-02-16T10:31:06.917565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:20.709724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915771+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:31:06.915771+0000","last_peered":"2024-02-16T10:31:06.915771+0000","last_clean":"2024-02-16T10:31:06.915771+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:31:06.915771+0000","last_undegraded":"2024-02-16T10:31:06.915771+0000","last_fullsized":"2024-02-16T10:31:06.915771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:31.149744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003456+0000","last_change":"2024-02-16T10:30:28.065560+0000","last_active":"2024-02-16T10:32:01.003456+0000","last_peered":"2024-02-16T10:32:01.003456+0000","last_clean":"2024-02-16T10:32:01.003456+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:01.003456+0000","last_undegraded":"2024-02-16T10:32:01.003456+0000","last_fullsized":"2024-02-16T10:32:01.003456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924689+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:31:06.924689+0000","last_peered":"2024-02-16T10:31:06.924689+0000","last_clean":"2024-02-16T10:31:06.924689+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:31:06.924689+0000","last_undegraded":"2024-02-16T10:31:06.924689+0000","last_fullsized":"2024-02-16T10:31:06.924689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:04.250123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912078+0000","last_change":"2024-02-16T10:30:30.099282+0000","last_active":"2024-02-16T10:31:06.912078+0000","last_peered":"2024-02-16T10:31:06.912078+0000","last_clean":"2024-02-16T10:31:06.912078+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:31:06.912078+0000","last_undegraded":"2024-02-16T10:31:06.912078+0000","last_fullsized":"2024-02-16T10:31:06.912078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:05.396237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.318143+0000","last_change":"2024-02-16T10:30:32.117290+0000","last_active":"2024-02-16T10:31:55.318143+0000","last_peered":"2024-02-16T10:31:55.318143+0000","last_clean":"2024-02-16T10:31:55.318143+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:31:55.318143+0000","last_undegraded":"2024-02-16T10:31:55.318143+0000","last_fullsized":"2024-02-16T10:31:55.318143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:10.257963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914793+0000","last_change":"2024-02-16T10:30:34.138222+0000","last_active":"2024-02-16T10:31:06.914793+0000","last_peered":"2024-02-16T10:31:06.914793+0000","last_clean":"2024-02-16T10:31:06.914793+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:31:06.914793+0000","last_undegraded":"2024-02-16T10:31:06.914793+0000","last_fullsized":"2024-02-16T10:31:06.914793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927061+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:31:06.927061+0000","last_peered":"2024-02-16T10:31:06.927061+0000","last_clean":"2024-02-16T10:31:06.927061+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:31:06.927061+0000","last_undegraded":"2024-02-16T10:31:06.927061+0000","last_fullsized":"2024-02-16T10:31:06.927061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:29.115943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686067+0000","last_change":"2024-02-16T10:30:28.065164+0000","last_active":"2024-02-16T10:31:12.686067+0000","last_peered":"2024-02-16T10:31:12.686067+0000","last_clean":"2024-02-16T10:31:12.686067+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:31:12.686067+0000","last_undegraded":"2024-02-16T10:31:12.686067+0000","last_fullsized":"2024-02-16T10:31:12.686067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915272+0000","last_change":"2024-02-16T10:30:26.089582+0000","last_active":"2024-02-16T10:31:06.915272+0000","last_peered":"2024-02-16T10:31:06.915272+0000","last_clean":"2024-02-16T10:31:06.915272+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:31:06.915272+0000","last_undegraded":"2024-02-16T10:31:06.915272+0000","last_fullsized":"2024-02-16T10:31:06.915272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918652+0000","last_change":"2024-02-16T10:30:30.101510+0000","last_active":"2024-02-16T10:31:06.918652+0000","last_peered":"2024-02-16T10:31:06.918652+0000","last_clean":"2024-02-16T10:31:06.918652+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:31:06.918652+0000","last_undegraded":"2024-02-16T10:31:06.918652+0000","last_fullsized":"2024-02-16T10:31:06.918652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:18.360523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:47.841019+0000","last_change":"2024-02-16T10:30:32.096419+0000","last_active":"2024-02-16T10:31:47.841019+0000","last_peered":"2024-02-16T10:31:47.841019+0000","last_clean":"2024-02-16T10:31:47.841019+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:31:47.841019+0000","last_undegraded":"2024-02-16T10:31:47.841019+0000","last_fullsized":"2024-02-16T10:31:47.841019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:42.963873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908228+0000","last_change":"2024-02-16T10:30:34.143222+0000","last_active":"2024-02-16T10:31:06.908228+0000","last_peered":"2024-02-16T10:31:06.908228+0000","last_clean":"2024-02-16T10:31:06.908228+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:31:06.908228+0000","last_undegraded":"2024-02-16T10:31:06.908228+0000","last_fullsized":"2024-02-16T10:31:06.908228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:15.922444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926743+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926743+0000","last_peered":"2024-02-16T10:31:06.926743+0000","last_clean":"2024-02-16T10:31:06.926743+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926743+0000","last_undegraded":"2024-02-16T10:31:06.926743+0000","last_fullsized":"2024-02-16T10:31:06.926743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:59.110103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.998018+0000","last_change":"2024-02-16T10:30:28.063758+0000","last_active":"2024-02-16T10:31:11.998018+0000","last_peered":"2024-02-16T10:31:11.998018+0000","last_clean":"2024-02-16T10:31:11.998018+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:31:11.998018+0000","last_undegraded":"2024-02-16T10:31:11.998018+0000","last_fullsized":"2024-02-16T10:31:11.998018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922326+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:31:06.922326+0000","last_peered":"2024-02-16T10:31:06.922326+0000","last_clean":"2024-02-16T10:31:06.922326+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:31:06.922326+0000","last_undegraded":"2024-02-16T10:31:06.922326+0000","last_fullsized":"2024-02-16T10:31:06.922326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908145+0000","last_change":"2024-02-16T10:30:30.080008+0000","last_active":"2024-02-16T10:31:06.908145+0000","last_peered":"2024-02-16T10:31:06.908145+0000","last_clean":"2024-02-16T10:31:06.908145+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:31:06.908145+0000","last_undegraded":"2024-02-16T10:31:06.908145+0000","last_fullsized":"2024-02-16T10:31:06.908145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:54.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.738535+0000","last_change":"2024-02-16T10:30:32.092783+0000","last_active":"2024-02-16T10:32:00.738535+0000","last_peered":"2024-02-16T10:32:00.738535+0000","last_clean":"2024-02-16T10:32:00.738535+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:00.738535+0000","last_undegraded":"2024-02-16T10:32:00.738535+0000","last_fullsized":"2024-02-16T10:32:00.738535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:45.366198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911478+0000","last_change":"2024-02-16T10:30:34.111884+0000","last_active":"2024-02-16T10:31:06.911478+0000","last_peered":"2024-02-16T10:31:06.911478+0000","last_clean":"2024-02-16T10:31:06.911478+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:31:06.911478+0000","last_undegraded":"2024-02-16T10:31:06.911478+0000","last_fullsized":"2024-02-16T10:31:06.911478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922646+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922646+0000","last_peered":"2024-02-16T10:31:06.922646+0000","last_clean":"2024-02-16T10:31:06.922646+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922646+0000","last_undegraded":"2024-02-16T10:31:06.922646+0000","last_fullsized":"2024-02-16T10:31:06.922646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:05.173479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003196+0000","last_change":"2024-02-16T10:30:28.083725+0000","last_active":"2024-02-16T10:32:01.003196+0000","last_peered":"2024-02-16T10:32:01.003196+0000","last_clean":"2024-02-16T10:32:01.003196+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:01.003196+0000","last_undegraded":"2024-02-16T10:32:01.003196+0000","last_fullsized":"2024-02-16T10:32:01.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:08:02.265809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928210+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:31:06.928210+0000","last_peered":"2024-02-16T10:31:06.928210+0000","last_clean":"2024-02-16T10:31:06.928210+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:31:06.928210+0000","last_undegraded":"2024-02-16T10:31:06.928210+0000","last_fullsized":"2024-02-16T10:31:06.928210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915480+0000","last_change":"2024-02-16T10:30:30.096518+0000","last_active":"2024-02-16T10:31:06.915480+0000","last_peered":"2024-02-16T10:31:06.915480+0000","last_clean":"2024-02-16T10:31:06.915480+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:31:06.915480+0000","last_undegraded":"2024-02-16T10:31:06.915480+0000","last_fullsized":"2024-02-16T10:31:06.915480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:33.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.296534+0000","last_change":"2024-02-16T10:30:32.090307+0000","last_active":"2024-02-16T10:31:55.296534+0000","last_peered":"2024-02-16T10:31:55.296534+0000","last_clean":"2024-02-16T10:31:55.296534+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:31:55.296534+0000","last_undegraded":"2024-02-16T10:31:55.296534+0000","last_fullsized":"2024-02-16T10:31:55.296534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:14.119162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911888+0000","last_change":"2024-02-16T10:30:34.119744+0000","last_active":"2024-02-16T10:31:06.911888+0000","last_peered":"2024-02-16T10:31:06.911888+0000","last_clean":"2024-02-16T10:31:06.911888+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:31:06.911888+0000","last_undegraded":"2024-02-16T10:31:06.911888+0000","last_fullsized":"2024-02-16T10:31:06.911888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:56.895959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498313+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:31:54.498313+0000","last_peered":"2024-02-16T10:31:54.498313+0000","last_clean":"2024-02-16T10:31:54.498313+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:31:54.498313+0000","last_undegraded":"2024-02-16T10:31:54.498313+0000","last_fullsized":"2024-02-16T10:31:54.498313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:27.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912785+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:31:06.912785+0000","last_peered":"2024-02-16T10:31:06.912785+0000","last_clean":"2024-02-16T10:31:06.912785+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:31:06.912785+0000","last_undegraded":"2024-02-16T10:31:06.912785+0000","last_fullsized":"2024-02-16T10:31:06.912785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:54.625844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936294+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:06.936294+0000","last_peered":"2024-02-16T10:31:06.936294+0000","last_clean":"2024-02-16T10:31:06.936294+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:06.936294+0000","last_undegraded":"2024-02-16T10:31:06.936294+0000","last_fullsized":"2024-02-16T10:31:06.936294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:44.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.941425+0000","last_change":"2024-02-16T10:30:32.092432+0000","last_active":"2024-02-16T10:32:00.941425+0000","last_peered":"2024-02-16T10:32:00.941425+0000","last_clean":"2024-02-16T10:32:00.941425+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:00.941425+0000","last_undegraded":"2024-02-16T10:32:00.941425+0000","last_fullsized":"2024-02-16T10:32:00.941425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:34.487177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913394+0000","last_change":"2024-02-16T10:30:34.119818+0000","last_active":"2024-02-16T10:31:06.913394+0000","last_peered":"2024-02-16T10:31:06.913394+0000","last_clean":"2024-02-16T10:31:06.913394+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:31:06.913394+0000","last_undegraded":"2024-02-16T10:31:06.913394+0000","last_fullsized":"2024-02-16T10:31:06.913394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:36.501122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.987273+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:00.987273+0000","last_peered":"2024-02-16T10:32:00.987273+0000","last_clean":"2024-02-16T10:32:00.987273+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:00.987273+0000","last_undegraded":"2024-02-16T10:32:00.987273+0000","last_fullsized":"2024-02-16T10:32:00.987273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930607+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:31:06.930607+0000","last_peered":"2024-02-16T10:31:06.930607+0000","last_clean":"2024-02-16T10:31:06.930607+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:31:06.930607+0000","last_undegraded":"2024-02-16T10:31:06.930607+0000","last_fullsized":"2024-02-16T10:31:06.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911567+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:31:06.911567+0000","last_peered":"2024-02-16T10:31:06.911567+0000","last_clean":"2024-02-16T10:31:06.911567+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:31:06.911567+0000","last_undegraded":"2024-02-16T10:31:06.911567+0000","last_fullsized":"2024-02-16T10:31:06.911567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:36.991486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917057+0000","last_change":"2024-02-16T10:30:30.075709+0000","last_active":"2024-02-16T10:31:06.917057+0000","last_peered":"2024-02-16T10:31:06.917057+0000","last_clean":"2024-02-16T10:31:06.917057+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:31:06.917057+0000","last_undegraded":"2024-02-16T10:31:06.917057+0000","last_fullsized":"2024-02-16T10:31:06.917057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:26.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.297577+0000","last_change":"2024-02-16T10:30:32.122498+0000","last_active":"2024-02-16T10:31:55.297577+0000","last_peered":"2024-02-16T10:31:55.297577+0000","last_clean":"2024-02-16T10:31:55.297577+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:31:55.297577+0000","last_undegraded":"2024-02-16T10:31:55.297577+0000","last_fullsized":"2024-02-16T10:31:55.297577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:17.677726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925017+0000","last_change":"2024-02-16T10:30:34.125516+0000","last_active":"2024-02-16T10:31:06.925017+0000","last_peered":"2024-02-16T10:31:06.925017+0000","last_clean":"2024-02-16T10:31:06.925017+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:31:06.925017+0000","last_undegraded":"2024-02-16T10:31:06.925017+0000","last_fullsized":"2024-02-16T10:31:06.925017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914711+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914711+0000","last_peered":"2024-02-16T10:31:06.914711+0000","last_clean":"2024-02-16T10:31:06.914711+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914711+0000","last_undegraded":"2024-02-16T10:31:06.914711+0000","last_fullsized":"2024-02-16T10:31:06.914711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:24.665857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354694+0000","last_change":"2024-02-16T10:30:28.087170+0000","last_active":"2024-02-16T10:31:55.354694+0000","last_peered":"2024-02-16T10:31:55.354694+0000","last_clean":"2024-02-16T10:31:55.354694+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:31:55.354694+0000","last_undegraded":"2024-02-16T10:31:55.354694+0000","last_fullsized":"2024-02-16T10:31:55.354694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:43.039912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912283+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912283+0000","last_peered":"2024-02-16T10:31:06.912283+0000","last_clean":"2024-02-16T10:31:06.912283+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912283+0000","last_undegraded":"2024-02-16T10:31:06.912283+0000","last_fullsized":"2024-02-16T10:31:06.912283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915313+0000","last_change":"2024-02-16T10:30:30.076018+0000","last_active":"2024-02-16T10:31:06.915313+0000","last_peered":"2024-02-16T10:31:06.915313+0000","last_clean":"2024-02-16T10:31:06.915313+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:31:06.915313+0000","last_undegraded":"2024-02-16T10:31:06.915313+0000","last_fullsized":"2024-02-16T10:31:06.915313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:08.463191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.324566+0000","last_change":"2024-02-16T10:30:32.119391+0000","last_active":"2024-02-16T10:31:55.324566+0000","last_peered":"2024-02-16T10:31:55.324566+0000","last_clean":"2024-02-16T10:31:55.324566+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:31:55.324566+0000","last_undegraded":"2024-02-16T10:31:55.324566+0000","last_fullsized":"2024-02-16T10:31:55.324566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:54.882014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927434+0000","last_change":"2024-02-16T10:30:34.124775+0000","last_active":"2024-02-16T10:31:06.927434+0000","last_peered":"2024-02-16T10:31:06.927434+0000","last_clean":"2024-02-16T10:31:06.927434+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:31:06.927434+0000","last_undegraded":"2024-02-16T10:31:06.927434+0000","last_fullsized":"2024-02-16T10:31:06.927434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:35.295960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917230+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917230+0000","last_peered":"2024-02-16T10:31:06.917230+0000","last_clean":"2024-02-16T10:31:06.917230+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917230+0000","last_undegraded":"2024-02-16T10:31:06.917230+0000","last_fullsized":"2024-02-16T10:31:06.917230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.882409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930153+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930153+0000","last_peered":"2024-02-16T10:31:06.930153+0000","last_clean":"2024-02-16T10:31:06.930153+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930153+0000","last_undegraded":"2024-02-16T10:31:06.930153+0000","last_fullsized":"2024-02-16T10:31:06.930153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.163010+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.163010+0000","last_peered":"2024-02-16T10:31:11.163010+0000","last_clean":"2024-02-16T10:31:11.163010+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.163010+0000","last_undegraded":"2024-02-16T10:31:11.163010+0000","last_fullsized":"2024-02-16T10:31:11.163010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:31.255409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925657+0000","last_change":"2024-02-16T10:30:30.091253+0000","last_active":"2024-02-16T10:31:06.925657+0000","last_peered":"2024-02-16T10:31:06.925657+0000","last_clean":"2024-02-16T10:31:06.925657+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:31:06.925657+0000","last_undegraded":"2024-02-16T10:31:06.925657+0000","last_fullsized":"2024-02-16T10:31:06.925657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:43.522418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930647+0000","last_change":"2024-02-16T10:30:32.123357+0000","last_active":"2024-02-16T10:31:06.930647+0000","last_peered":"2024-02-16T10:31:06.930647+0000","last_clean":"2024-02-16T10:31:06.930647+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:31:06.930647+0000","last_undegraded":"2024-02-16T10:31:06.930647+0000","last_fullsized":"2024-02-16T10:31:06.930647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:56:50.568670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.251519+0000","last_change":"2024-02-16T10:30:34.143270+0000","last_active":"2024-02-16T10:32:01.251519+0000","last_peered":"2024-02-16T10:32:01.251519+0000","last_clean":"2024-02-16T10:32:01.251519+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:01.251519+0000","last_undegraded":"2024-02-16T10:32:01.251519+0000","last_fullsized":"2024-02-16T10:32:01.251519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:51.931876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913269+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913269+0000","last_peered":"2024-02-16T10:31:06.913269+0000","last_clean":"2024-02-16T10:31:06.913269+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913269+0000","last_undegraded":"2024-02-16T10:31:06.913269+0000","last_fullsized":"2024-02-16T10:31:06.913269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:47:45.661564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913938+0000","last_change":"2024-02-16T10:30:28.068653+0000","last_active":"2024-02-16T10:31:06.913938+0000","last_peered":"2024-02-16T10:31:06.913938+0000","last_clean":"2024-02-16T10:31:06.913938+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:31:06.913938+0000","last_undegraded":"2024-02-16T10:31:06.913938+0000","last_fullsized":"2024-02-16T10:31:06.913938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:19.170808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.971149+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.971149+0000","last_peered":"2024-02-16T10:31:11.971149+0000","last_clean":"2024-02-16T10:31:11.971149+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.971149+0000","last_undegraded":"2024-02-16T10:31:11.971149+0000","last_fullsized":"2024-02-16T10:31:11.971149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912004+0000","last_change":"2024-02-16T10:30:30.097916+0000","last_active":"2024-02-16T10:31:06.912004+0000","last_peered":"2024-02-16T10:31:06.912004+0000","last_clean":"2024-02-16T10:31:06.912004+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:31:06.912004+0000","last_undegraded":"2024-02-16T10:31:06.912004+0000","last_fullsized":"2024-02-16T10:31:06.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:31.161114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.284137+0000","last_change":"2024-02-16T10:30:32.097289+0000","last_active":"2024-02-16T10:31:55.284137+0000","last_peered":"2024-02-16T10:31:55.284137+0000","last_clean":"2024-02-16T10:31:55.284137+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:31:55.284137+0000","last_undegraded":"2024-02-16T10:31:55.284137+0000","last_fullsized":"2024-02-16T10:31:55.284137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:01.486352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923897+0000","last_change":"2024-02-16T10:30:34.135806+0000","last_active":"2024-02-16T10:31:06.923897+0000","last_peered":"2024-02-16T10:31:06.923897+0000","last_clean":"2024-02-16T10:31:06.923897+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:31:06.923897+0000","last_undegraded":"2024-02-16T10:31:06.923897+0000","last_fullsized":"2024-02-16T10:31:06.923897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.688719+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.688719+0000","last_peered":"2024-02-16T10:31:12.688719+0000","last_clean":"2024-02-16T10:31:12.688719+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.688719+0000","last_undegraded":"2024-02-16T10:31:12.688719+0000","last_fullsized":"2024-02-16T10:31:12.688719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'13","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003577+0000","last_change":"2024-02-16T10:30:28.068349+0000","last_active":"2024-02-16T10:32:01.003577+0000","last_peered":"2024-02-16T10:32:01.003577+0000","last_clean":"2024-02-16T10:32:01.003577+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:01.003577+0000","last_undegraded":"2024-02-16T10:32:01.003577+0000","last_fullsized":"2024-02-16T10:32:01.003577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926497+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926497+0000","last_peered":"2024-02-16T10:31:06.926497+0000","last_clean":"2024-02-16T10:31:06.926497+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926497+0000","last_undegraded":"2024-02-16T10:31:06.926497+0000","last_fullsized":"2024-02-16T10:31:06.926497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:35.881032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914335+0000","last_change":"2024-02-16T10:30:30.074767+0000","last_active":"2024-02-16T10:31:06.914335+0000","last_peered":"2024-02-16T10:31:06.914335+0000","last_clean":"2024-02-16T10:31:06.914335+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:31:06.914335+0000","last_undegraded":"2024-02-16T10:31:06.914335+0000","last_fullsized":"2024-02-16T10:31:06.914335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:17.473427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.286151+0000","last_change":"2024-02-16T10:30:32.089195+0000","last_active":"2024-02-16T10:31:55.286151+0000","last_peered":"2024-02-16T10:31:55.286151+0000","last_clean":"2024-02-16T10:31:55.286151+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:31:55.286151+0000","last_undegraded":"2024-02-16T10:31:55.286151+0000","last_fullsized":"2024-02-16T10:31:55.286151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:43.979549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914695+0000","last_change":"2024-02-16T10:30:34.138612+0000","last_active":"2024-02-16T10:31:06.914695+0000","last_peered":"2024-02-16T10:31:06.914695+0000","last_clean":"2024-02-16T10:31:06.914695+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:31:06.914695+0000","last_undegraded":"2024-02-16T10:31:06.914695+0000","last_fullsized":"2024-02-16T10:31:06.914695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:16.947910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931060+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931060+0000","last_peered":"2024-02-16T10:31:06.931060+0000","last_clean":"2024-02-16T10:31:06.931060+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931060+0000","last_undegraded":"2024-02-16T10:31:06.931060+0000","last_fullsized":"2024-02-16T10:31:06.931060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:04.374041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498061+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.498061+0000","last_peered":"2024-02-16T10:31:54.498061+0000","last_clean":"2024-02-16T10:31:54.498061+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.498061+0000","last_undegraded":"2024-02-16T10:31:54.498061+0000","last_fullsized":"2024-02-16T10:31:54.498061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.347024+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:31:55.347024+0000","last_peered":"2024-02-16T10:31:55.347024+0000","last_clean":"2024-02-16T10:31:55.347024+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:31:55.347024+0000","last_undegraded":"2024-02-16T10:31:55.347024+0000","last_fullsized":"2024-02-16T10:31:55.347024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:13.928686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.910958+0000","last_change":"2024-02-16T10:30:30.098954+0000","last_active":"2024-02-16T10:31:06.910958+0000","last_peered":"2024-02-16T10:31:06.910958+0000","last_clean":"2024-02-16T10:31:06.910958+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:31:06.910958+0000","last_undegraded":"2024-02-16T10:31:06.910958+0000","last_fullsized":"2024-02-16T10:31:06.910958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.320914+0000","last_change":"2024-02-16T10:30:32.120059+0000","last_active":"2024-02-16T10:31:55.320914+0000","last_peered":"2024-02-16T10:31:55.320914+0000","last_clean":"2024-02-16T10:31:55.320914+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:31:55.320914+0000","last_undegraded":"2024-02-16T10:31:55.320914+0000","last_fullsized":"2024-02-16T10:31:55.320914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:54.720052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915718+0000","last_change":"2024-02-16T10:30:34.139182+0000","last_active":"2024-02-16T10:31:06.915718+0000","last_peered":"2024-02-16T10:31:06.915718+0000","last_clean":"2024-02-16T10:31:06.915718+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:31:06.915718+0000","last_undegraded":"2024-02-16T10:31:06.915718+0000","last_fullsized":"2024-02-16T10:31:06.915718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:33.233363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.660952+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.660952+0000","last_peered":"2024-02-16T10:31:11.660952+0000","last_clean":"2024-02-16T10:31:11.660952+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.660952+0000","last_undegraded":"2024-02-16T10:31:11.660952+0000","last_fullsized":"2024-02-16T10:31:11.660952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:08.234713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.002993+0000","last_change":"2024-02-16T10:30:28.068221+0000","last_active":"2024-02-16T10:32:01.002993+0000","last_peered":"2024-02-16T10:32:01.002993+0000","last_clean":"2024-02-16T10:32:01.002993+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:01.002993+0000","last_undegraded":"2024-02-16T10:32:01.002993+0000","last_fullsized":"2024-02-16T10:32:01.002993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:33.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928894+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:31:06.928894+0000","last_peered":"2024-02-16T10:31:06.928894+0000","last_clean":"2024-02-16T10:31:06.928894+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:31:06.928894+0000","last_undegraded":"2024-02-16T10:31:06.928894+0000","last_fullsized":"2024-02-16T10:31:06.928894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'7","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193889+0000","last_change":"2024-02-16T10:30:30.090010+0000","last_active":"2024-02-16T10:32:02.193889+0000","last_peered":"2024-02-16T10:32:02.193889+0000","last_clean":"2024-02-16T10:32:02.193889+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:02.193889+0000","last_undegraded":"2024-02-16T10:32:02.193889+0000","last_fullsized":"2024-02-16T10:32:02.193889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:04.245545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.974431+0000","last_change":"2024-02-16T10:30:32.120625+0000","last_active":"2024-02-16T10:32:00.974431+0000","last_peered":"2024-02-16T10:32:00.974431+0000","last_clean":"2024-02-16T10:32:00.974431+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:00.974431+0000","last_undegraded":"2024-02-16T10:32:00.974431+0000","last_fullsized":"2024-02-16T10:32:00.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:00:10.689555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926215+0000","last_change":"2024-02-16T10:30:34.104811+0000","last_active":"2024-02-16T10:31:06.926215+0000","last_peered":"2024-02-16T10:31:06.926215+0000","last_clean":"2024-02-16T10:31:06.926215+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:31:06.926215+0000","last_undegraded":"2024-02-16T10:31:06.926215+0000","last_fullsized":"2024-02-16T10:31:06.926215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:05.490555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923461+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923461+0000","last_peered":"2024-02-16T10:31:06.923461+0000","last_clean":"2024-02-16T10:31:06.923461+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923461+0000","last_undegraded":"2024-02-16T10:31:06.923461+0000","last_fullsized":"2024-02-16T10:31:06.923461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:05.711450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930585+0000","last_change":"2024-02-16T10:30:28.085439+0000","last_active":"2024-02-16T10:31:06.930585+0000","last_peered":"2024-02-16T10:31:06.930585+0000","last_clean":"2024-02-16T10:31:06.930585+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:31:06.930585+0000","last_undegraded":"2024-02-16T10:31:06.930585+0000","last_fullsized":"2024-02-16T10:31:06.930585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:24.178735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906798+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:31:06.906798+0000","last_peered":"2024-02-16T10:31:06.906798+0000","last_clean":"2024-02-16T10:31:06.906798+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:31:06.906798+0000","last_undegraded":"2024-02-16T10:31:06.906798+0000","last_fullsized":"2024-02-16T10:31:06.906798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354785+0000","last_change":"2024-02-16T10:30:28.066897+0000","last_active":"2024-02-16T10:31:55.354785+0000","last_peered":"2024-02-16T10:31:55.354785+0000","last_clean":"2024-02-16T10:31:55.354785+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:31:55.354785+0000","last_undegraded":"2024-02-16T10:31:55.354785+0000","last_fullsized":"2024-02-16T10:31:55.354785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924256+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:31:06.924256+0000","last_peered":"2024-02-16T10:31:06.924256+0000","last_clean":"2024-02-16T10:31:06.924256+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:31:06.924256+0000","last_undegraded":"2024-02-16T10:31:06.924256+0000","last_fullsized":"2024-02-16T10:31:06.924256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497934+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:31:54.497934+0000","last_peered":"2024-02-16T10:31:54.497934+0000","last_clean":"2024-02-16T10:31:54.497934+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:31:54.497934+0000","last_undegraded":"2024-02-16T10:31:54.497934+0000","last_fullsized":"2024-02-16T10:31:54.497934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:39.952356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918764+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:31:06.918764+0000","last_peered":"2024-02-16T10:31:06.918764+0000","last_clean":"2024-02-16T10:31:06.918764+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:31:06.918764+0000","last_undegraded":"2024-02-16T10:31:06.918764+0000","last_fullsized":"2024-02-16T10:31:06.918764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:44:00.902889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.367527+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:31:55.367527+0000","last_peered":"2024-02-16T10:31:55.367527+0000","last_clean":"2024-02-16T10:31:55.367527+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:31:55.367527+0000","last_undegraded":"2024-02-16T10:31:55.367527+0000","last_fullsized":"2024-02-16T10:31:55.367527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927369+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:31:06.927369+0000","last_peered":"2024-02-16T10:31:06.927369+0000","last_clean":"2024-02-16T10:31:06.927369+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:31:06.927369+0000","last_undegraded":"2024-02-16T10:31:06.927369+0000","last_fullsized":"2024-02-16T10:31:06.927369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003265+0000","last_change":"2024-02-16T10:30:28.070344+0000","last_active":"2024-02-16T10:32:01.003265+0000","last_peered":"2024-02-16T10:32:01.003265+0000","last_clean":"2024-02-16T10:32:01.003265+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:01.003265+0000","last_undegraded":"2024-02-16T10:32:01.003265+0000","last_fullsized":"2024-02-16T10:32:01.003265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929450+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:31:06.929450+0000","last_peered":"2024-02-16T10:31:06.929450+0000","last_clean":"2024-02-16T10:31:06.929450+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:31:06.929450+0000","last_undegraded":"2024-02-16T10:31:06.929450+0000","last_fullsized":"2024-02-16T10:31:06.929450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922892+0000","last_change":"2024-02-16T10:30:28.084698+0000","last_active":"2024-02-16T10:31:06.922892+0000","last_peered":"2024-02-16T10:31:06.922892+0000","last_clean":"2024-02-16T10:31:06.922892+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:31:06.922892+0000","last_undegraded":"2024-02-16T10:31:06.922892+0000","last_fullsized":"2024-02-16T10:31:06.922892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925916+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:31:06.925916+0000","last_peered":"2024-02-16T10:31:06.925916+0000","last_clean":"2024-02-16T10:31:06.925916+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:31:06.925916+0000","last_undegraded":"2024-02-16T10:31:06.925916+0000","last_fullsized":"2024-02-16T10:31:06.925916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197265+0000","last_change":"2024-02-16T10:30:28.088710+0000","last_active":"2024-02-16T10:31:11.197265+0000","last_peered":"2024-02-16T10:31:11.197265+0000","last_clean":"2024-02-16T10:31:11.197265+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:31:11.197265+0000","last_undegraded":"2024-02-16T10:31:11.197265+0000","last_fullsized":"2024-02-16T10:31:11.197265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922587+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:31:06.922587+0000","last_peered":"2024-02-16T10:31:06.922587+0000","last_clean":"2024-02-16T10:31:06.922587+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:31:06.922587+0000","last_undegraded":"2024-02-16T10:31:06.922587+0000","last_fullsized":"2024-02-16T10:31:06.922587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498941+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:31:54.498941+0000","last_peered":"2024-02-16T10:31:54.498941+0000","last_clean":"2024-02-16T10:31:54.498941+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:31:54.498941+0000","last_undegraded":"2024-02-16T10:31:54.498941+0000","last_fullsized":"2024-02-16T10:31:54.498941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930315+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:31:06.930315+0000","last_peered":"2024-02-16T10:31:06.930315+0000","last_clean":"2024-02-16T10:31:06.930315+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:31:06.930315+0000","last_undegraded":"2024-02-16T10:31:06.930315+0000","last_fullsized":"2024-02-16T10:31:06.930315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:36:57.326356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996262+0000","last_change":"2024-02-16T10:30:28.082754+0000","last_active":"2024-02-16T10:31:11.996262+0000","last_peered":"2024-02-16T10:31:11.996262+0000","last_clean":"2024-02-16T10:31:11.996262+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:31:11.996262+0000","last_undegraded":"2024-02-16T10:31:11.996262+0000","last_fullsized":"2024-02-16T10:31:11.996262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:05:11.823357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913459+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:31:06.913459+0000","last_peered":"2024-02-16T10:31:06.913459+0000","last_clean":"2024-02-16T10:31:06.913459+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:31:06.913459+0000","last_undegraded":"2024-02-16T10:31:06.913459+0000","last_fullsized":"2024-02-16T10:31:06.913459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:00:10.245816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003021+0000","last_change":"2024-02-16T10:30:28.069630+0000","last_active":"2024-02-16T10:32:01.003021+0000","last_peered":"2024-02-16T10:32:01.003021+0000","last_clean":"2024-02-16T10:32:01.003021+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:01.003021+0000","last_undegraded":"2024-02-16T10:32:01.003021+0000","last_fullsized":"2024-02-16T10:32:01.003021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:21:11.835947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924942+0000","last_change":"2024-02-16T10:30:26.099907+0000","last_active":"2024-02-16T10:31:06.924942+0000","last_peered":"2024-02-16T10:31:06.924942+0000","last_clean":"2024-02-16T10:31:06.924942+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:31:06.924942+0000","last_undegraded":"2024-02-16T10:31:06.924942+0000","last_fullsized":"2024-02-16T10:31:06.924942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.687640+0000","last_change":"2024-02-16T10:30:28.065907+0000","last_active":"2024-02-16T10:31:12.687640+0000","last_peered":"2024-02-16T10:31:12.687640+0000","last_clean":"2024-02-16T10:31:12.687640+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:31:12.687640+0000","last_undegraded":"2024-02-16T10:31:12.687640+0000","last_fullsized":"2024-02-16T10:31:12.687640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922132+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:31:06.922132+0000","last_peered":"2024-02-16T10:31:06.922132+0000","last_clean":"2024-02-16T10:31:06.922132+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:31:06.922132+0000","last_undegraded":"2024-02-16T10:31:06.922132+0000","last_fullsized":"2024-02-16T10:31:06.922132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927080+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:31:06.927080+0000","last_peered":"2024-02-16T10:31:06.927080+0000","last_clean":"2024-02-16T10:31:06.927080+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:31:06.927080+0000","last_undegraded":"2024-02-16T10:31:06.927080+0000","last_fullsized":"2024-02-16T10:31:06.927080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:15.461099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919178+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:31:06.919178+0000","last_peered":"2024-02-16T10:31:06.919178+0000","last_clean":"2024-02-16T10:31:06.919178+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:31:06.919178+0000","last_undegraded":"2024-02-16T10:31:06.919178+0000","last_fullsized":"2024-02-16T10:31:06.919178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686094+0000","last_change":"2024-02-16T10:30:28.065620+0000","last_active":"2024-02-16T10:31:12.686094+0000","last_peered":"2024-02-16T10:31:12.686094+0000","last_clean":"2024-02-16T10:31:12.686094+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:31:12.686094+0000","last_undegraded":"2024-02-16T10:31:12.686094+0000","last_fullsized":"2024-02-16T10:31:12.686094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925237+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:31:06.925237+0000","last_peered":"2024-02-16T10:31:06.925237+0000","last_clean":"2024-02-16T10:31:06.925237+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:31:06.925237+0000","last_undegraded":"2024-02-16T10:31:06.925237+0000","last_fullsized":"2024-02-16T10:31:06.925237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:28:35.916782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197558+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:31:11.197558+0000","last_peered":"2024-02-16T10:31:11.197558+0000","last_clean":"2024-02-16T10:31:11.197558+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:31:11.197558+0000","last_undegraded":"2024-02-16T10:31:11.197558+0000","last_fullsized":"2024-02-16T10:31:11.197558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930984+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:31:06.930984+0000","last_peered":"2024-02-16T10:31:06.930984+0000","last_clean":"2024-02-16T10:31:06.930984+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:31:06.930984+0000","last_undegraded":"2024-02-16T10:31:06.930984+0000","last_fullsized":"2024-02-16T10:31:06.930984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:45.770711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003087+0000","last_change":"2024-02-16T10:30:28.087215+0000","last_active":"2024-02-16T10:32:01.003087+0000","last_peered":"2024-02-16T10:32:01.003087+0000","last_clean":"2024-02-16T10:32:01.003087+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:01.003087+0000","last_undegraded":"2024-02-16T10:32:01.003087+0000","last_fullsized":"2024-02-16T10:32:01.003087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:06.402688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923234+0000","last_change":"2024-02-16T10:30:26.083864+0000","last_active":"2024-02-16T10:31:06.923234+0000","last_peered":"2024-02-16T10:31:06.923234+0000","last_clean":"2024-02-16T10:31:06.923234+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:31:06.923234+0000","last_undegraded":"2024-02-16T10:31:06.923234+0000","last_fullsized":"2024-02-16T10:31:06.923234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917305+0000","last_change":"2024-02-16T10:30:28.072935+0000","last_active":"2024-02-16T10:31:06.917305+0000","last_peered":"2024-02-16T10:31:06.917305+0000","last_clean":"2024-02-16T10:31:06.917305+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:31:06.917305+0000","last_undegraded":"2024-02-16T10:31:06.917305+0000","last_fullsized":"2024-02-16T10:31:06.917305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934783+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:31:06.934783+0000","last_peered":"2024-02-16T10:31:06.934783+0000","last_clean":"2024-02-16T10:31:06.934783+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:31:06.934783+0000","last_undegraded":"2024-02-16T10:31:06.934783+0000","last_fullsized":"2024-02-16T10:31:06.934783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:02.701519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.982355+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:31:11.982355+0000","last_peered":"2024-02-16T10:31:11.982355+0000","last_clean":"2024-02-16T10:31:11.982355+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:31:11.982355+0000","last_undegraded":"2024-02-16T10:31:11.982355+0000","last_fullsized":"2024-02-16T10:31:11.982355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:33.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932493+0000","last_change":"2024-02-16T10:30:28.088605+0000","last_active":"2024-02-16T10:31:06.932493+0000","last_peered":"2024-02-16T10:31:06.932493+0000","last_clean":"2024-02-16T10:31:06.932493+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:31:06.932493+0000","last_undegraded":"2024-02-16T10:31:06.932493+0000","last_fullsized":"2024-02-16T10:31:06.932493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925231+0000","last_change":"2024-02-16T10:30:26.100409+0000","last_active":"2024-02-16T10:31:06.925231+0000","last_peered":"2024-02-16T10:31:06.925231+0000","last_clean":"2024-02-16T10:31:06.925231+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:31:06.925231+0000","last_undegraded":"2024-02-16T10:31:06.925231+0000","last_fullsized":"2024-02-16T10:31:06.925231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498959+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.498959+0000","last_peered":"2024-02-16T10:31:54.498959+0000","last_clean":"2024-02-16T10:31:54.498959+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.498959+0000","last_undegraded":"2024-02-16T10:31:54.498959+0000","last_fullsized":"2024-02-16T10:31:54.498959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:02.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705690,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69299999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":8.2560000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":24.481999999999999,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.503},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":18.614999999999998,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.72899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:09.602 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:09.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b3396d640 1 Processor -- start 2024-02-16T10:32:09.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b3396d640 1 -- start start 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b3396d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b2c12dd30 0x7f4b2c130120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b3396d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c071480 con 0x7f4b2c12af60 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b3396d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c09c000 con 0x7f4b2c12dd30 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b30f08640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b2c12dd30 0x7f4b2c130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b31709640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b2c12af60 0x7f4b2c12b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41082/0 (socket says 172.21.15.107:41082) 2024-02-16T10:32:09.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b31709640 1 -- 172.21.15.107:0/32522041 learned_addr learned my addr 172.21.15.107:0/32522041 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:09.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b30f08640 1 -- 172.21.15.107:0/32522041 >> v1:172.21.15.107:6789/0 conn(0x7f4b2c12af60 legacy=0x7f4b2c12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.751+0000 7f4b30f08640 1 -- 172.21.15.107:0/32522041 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c12ad40 con 0x7f4b2c12dd30 2024-02-16T10:32:09.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b30f08640 1 --2- 172.21.15.107:0/32522041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12dd30 0x7f4b2c130120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009740 tx=0x7f4b1c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424b9739583d2c13 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b23fff640 1 -- 172.21.15.107:0/32522041 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c0ab530 con 0x7f4b2c12dd30 2024-02-16T10:32:09.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b23fff640 1 -- 172.21.15.107:0/32522041 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0a7050 con 0x7f4b2c12dd30 2024-02-16T10:32:09.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b23fff640 1 -- 172.21.15.107:0/32522041 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c0ab7e0 con 0x7f4b2c12dd30 2024-02-16T10:32:09.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- 172.21.15.107:0/32522041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12dd30 msgr2=0x7f4b2c130120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 --2- 172.21.15.107:0/32522041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12dd30 0x7f4b2c130120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009740 tx=0x7f4b1c01c370 comp rx=0 tx=0).stop 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- 172.21.15.107:0/32522041 shutdown_connections 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 --2- 172.21.15.107:0/32522041 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12dd30 0x7f4b2c130120 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- 172.21.15.107:0/32522041 >> 172.21.15.107:0/32522041 conn(0x7f4b2c09a1c0 msgr2=0x7f4b2c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- 172.21.15.107:0/32522041 shutdown_connections 2024-02-16T10:32:09.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- 172.21.15.107:0/32522041 wait complete. 2024-02-16T10:32:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 Processor -- start 2024-02-16T10:32:09.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.755+0000 7f4b3396d640 1 -- start start 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b3396d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b3396d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1278e0 con 0x7f4b2c12af60 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b31709640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b31709640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50440/0 (socket says 172.21.15.107:50440) 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b31709640 1 -- 172.21.15.107:0/1529420384 learned_addr learned my addr 172.21.15.107:0/1529420384 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b31709640 1 -- 172.21.15.107:0/1529420384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009420 con 0x7f4b2c12af60 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b31709640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c480 tx=0x7f4b2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b28005c20 con 0x7f4b2c12af60 2024-02-16T10:32:09.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28005d80 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c130130 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b280071a0 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c1275a0 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c127d90 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4b28007300 con 0x7f4b2c12af60 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:09.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4b28047d10 con 0x7f4b2c12af60 2024-02-16T10:32:09.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b30f08640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:09.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.759+0000 7f4b30f08640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0ad000 tx=0x7f4b1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:09.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.763+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b2801b3b0 con 0x7f4b2c12af60 2024-02-16T10:32:09.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.919+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b2c06de60 con 0x7f4b10035a10 2024-02-16T10:32:09.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.963+0000 7f4b21ffb640 1 -- 172.21.15.107:0/1529420384 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673521 (secure 0 0 0) 0x7f4b2c06de60 con 0x7f4b10035a10 2024-02-16T10:32:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:09.980 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 msgr2=0x7f4b10037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0ad000 tx=0x7f4b1c008040 comp rx=0 tx=0).stop 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 msgr2=0x7f4b2c125880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c480 tx=0x7f4b2800c940 comp rx=0 tx=0).stop 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 shutdown_connections 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4b10035a10 0x7f4b10037ed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 --2- 172.21.15.107:0/1529420384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b2c12af60 0x7f4b2c125880 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:09.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 >> 172.21.15.107:0/1529420384 conn(0x7f4b2c09a1c0 msgr2=0x7f4b2c128ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 shutdown_connections 2024-02-16T10:32:09.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:09.971+0000 7f4b3396d640 1 -- 172.21.15.107:0/1529420384 wait complete. 2024-02-16T10:32:09.993 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-02-16T10:32:09.861915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3804,"num_read_kb":3447,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-825,"num_objects":-16,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":183,"num_read_kb":178,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006737"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916908+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:31:06.916908+0000","last_peered":"2024-02-16T10:31:06.916908+0000","last_clean":"2024-02-16T10:31:06.916908+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:31:06.916908+0000","last_undegraded":"2024-02-16T10:31:06.916908+0000","last_fullsized":"2024-02-16T10:31:06.916908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354394+0000","last_change":"2024-02-16T10:30:28.072642+0000","last_active":"2024-02-16T10:31:55.354394+0000","last_peered":"2024-02-16T10:31:55.354394+0000","last_clean":"2024-02-16T10:31:55.354394+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:31:55.354394+0000","last_undegraded":"2024-02-16T10:31:55.354394+0000","last_fullsized":"2024-02-16T10:31:55.354394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929412+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:31:06.929412+0000","last_peered":"2024-02-16T10:31:06.929412+0000","last_clean":"2024-02-16T10:31:06.929412+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:31:06.929412+0000","last_undegraded":"2024-02-16T10:31:06.929412+0000","last_fullsized":"2024-02-16T10:31:06.929412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918157+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918157+0000","last_peered":"2024-02-16T10:31:06.918157+0000","last_clean":"2024-02-16T10:31:06.918157+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918157+0000","last_undegraded":"2024-02-16T10:31:06.918157+0000","last_fullsized":"2024-02-16T10:31:06.918157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:41.510090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976695+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:31:11.976695+0000","last_peered":"2024-02-16T10:31:11.976695+0000","last_clean":"2024-02-16T10:31:11.976695+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:31:11.976695+0000","last_undegraded":"2024-02-16T10:31:11.976695+0000","last_fullsized":"2024-02-16T10:31:11.976695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:13.252426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920793+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920793+0000","last_peered":"2024-02-16T10:31:06.920793+0000","last_clean":"2024-02-16T10:31:06.920793+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920793+0000","last_undegraded":"2024-02-16T10:31:06.920793+0000","last_fullsized":"2024-02-16T10:31:06.920793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:41.339005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914702+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:31:06.914702+0000","last_peered":"2024-02-16T10:31:06.914702+0000","last_clean":"2024-02-16T10:31:06.914702+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:31:06.914702+0000","last_undegraded":"2024-02-16T10:31:06.914702+0000","last_fullsized":"2024-02-16T10:31:06.914702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920918+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.920918+0000","last_peered":"2024-02-16T10:31:06.920918+0000","last_clean":"2024-02-16T10:31:06.920918+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.920918+0000","last_undegraded":"2024-02-16T10:31:06.920918+0000","last_fullsized":"2024-02-16T10:31:06.920918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:09.881305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.503530+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.503530+0000","last_peered":"2024-02-16T10:31:54.503530+0000","last_clean":"2024-02-16T10:31:54.503530+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.503530+0000","last_undegraded":"2024-02-16T10:31:54.503530+0000","last_fullsized":"2024-02-16T10:31:54.503530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:17.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003130+0000","last_change":"2024-02-16T10:30:28.081973+0000","last_active":"2024-02-16T10:32:01.003130+0000","last_peered":"2024-02-16T10:32:01.003130+0000","last_clean":"2024-02-16T10:32:01.003130+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:01.003130+0000","last_undegraded":"2024-02-16T10:32:01.003130+0000","last_fullsized":"2024-02-16T10:32:01.003130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908534+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908534+0000","last_peered":"2024-02-16T10:31:06.908534+0000","last_clean":"2024-02-16T10:31:06.908534+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908534+0000","last_undegraded":"2024-02-16T10:31:06.908534+0000","last_fullsized":"2024-02-16T10:31:06.908534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925777+0000","last_change":"2024-02-16T10:30:28.083981+0000","last_active":"2024-02-16T10:31:06.925777+0000","last_peered":"2024-02-16T10:31:06.925777+0000","last_clean":"2024-02-16T10:31:06.925777+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:31:06.925777+0000","last_undegraded":"2024-02-16T10:31:06.925777+0000","last_fullsized":"2024-02-16T10:31:06.925777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:38.936680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916403+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.916403+0000","last_peered":"2024-02-16T10:31:06.916403+0000","last_clean":"2024-02-16T10:31:06.916403+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.916403+0000","last_undegraded":"2024-02-16T10:31:06.916403+0000","last_fullsized":"2024-02-16T10:31:06.916403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:03.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354647+0000","last_change":"2024-02-16T10:30:28.078739+0000","last_active":"2024-02-16T10:31:55.354647+0000","last_peered":"2024-02-16T10:31:55.354647+0000","last_clean":"2024-02-16T10:31:55.354647+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:31:55.354647+0000","last_undegraded":"2024-02-16T10:31:55.354647+0000","last_fullsized":"2024-02-16T10:31:55.354647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925042+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925042+0000","last_peered":"2024-02-16T10:31:06.925042+0000","last_clean":"2024-02-16T10:31:06.925042+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925042+0000","last_undegraded":"2024-02-16T10:31:06.925042+0000","last_fullsized":"2024-02-16T10:31:06.925042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686117+0000","last_change":"2024-02-16T10:30:28.063141+0000","last_active":"2024-02-16T10:31:12.686117+0000","last_peered":"2024-02-16T10:31:12.686117+0000","last_clean":"2024-02-16T10:31:12.686117+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:31:12.686117+0000","last_undegraded":"2024-02-16T10:31:12.686117+0000","last_fullsized":"2024-02-16T10:31:12.686117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915013+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:31:06.915013+0000","last_peered":"2024-02-16T10:31:06.915013+0000","last_clean":"2024-02-16T10:31:06.915013+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:31:06.915013+0000","last_undegraded":"2024-02-16T10:31:06.915013+0000","last_fullsized":"2024-02-16T10:31:06.915013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:03.383909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929156+0000","last_change":"2024-02-16T10:30:26.098135+0000","last_active":"2024-02-16T10:31:06.929156+0000","last_peered":"2024-02-16T10:31:06.929156+0000","last_clean":"2024-02-16T10:31:06.929156+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:31:06.929156+0000","last_undegraded":"2024-02-16T10:31:06.929156+0000","last_fullsized":"2024-02-16T10:31:06.929156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915167+0000","last_change":"2024-02-16T10:30:28.080080+0000","last_active":"2024-02-16T10:31:06.915167+0000","last_peered":"2024-02-16T10:31:06.915167+0000","last_clean":"2024-02-16T10:31:06.915167+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:31:06.915167+0000","last_undegraded":"2024-02-16T10:31:06.915167+0000","last_fullsized":"2024-02-16T10:31:06.915167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.994634+0000","last_change":"2024-02-16T10:30:26.086548+0000","last_active":"2024-02-16T10:32:00.994634+0000","last_peered":"2024-02-16T10:32:00.994634+0000","last_clean":"2024-02-16T10:32:00.994634+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:00.994634+0000","last_undegraded":"2024-02-16T10:32:00.994634+0000","last_fullsized":"2024-02-16T10:32:00.994634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366482+0000","last_change":"2024-02-16T10:30:28.082308+0000","last_active":"2024-02-16T10:31:55.366482+0000","last_peered":"2024-02-16T10:31:55.366482+0000","last_clean":"2024-02-16T10:31:55.366482+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:31:55.366482+0000","last_undegraded":"2024-02-16T10:31:55.366482+0000","last_fullsized":"2024-02-16T10:31:55.366482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926645+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:31:06.926645+0000","last_peered":"2024-02-16T10:31:06.926645+0000","last_clean":"2024-02-16T10:31:06.926645+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:31:06.926645+0000","last_undegraded":"2024-02-16T10:31:06.926645+0000","last_fullsized":"2024-02-16T10:31:06.926645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927940+0000","last_change":"2024-02-16T10:30:28.066522+0000","last_active":"2024-02-16T10:31:06.927940+0000","last_peered":"2024-02-16T10:31:06.927940+0000","last_clean":"2024-02-16T10:31:06.927940+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:31:06.927940+0000","last_undegraded":"2024-02-16T10:31:06.927940+0000","last_fullsized":"2024-02-16T10:31:06.927940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925646+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:31:06.925646+0000","last_peered":"2024-02-16T10:31:06.925646+0000","last_clean":"2024-02-16T10:31:06.925646+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:31:06.925646+0000","last_undegraded":"2024-02-16T10:31:06.925646+0000","last_fullsized":"2024-02-16T10:31:06.925646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.655926+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.655926+0000","last_peered":"2024-02-16T10:31:11.655926+0000","last_clean":"2024-02-16T10:31:11.655926+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.655926+0000","last_undegraded":"2024-02-16T10:31:11.655926+0000","last_fullsized":"2024-02-16T10:31:11.655926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927666+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:31:06.927666+0000","last_peered":"2024-02-16T10:31:06.927666+0000","last_clean":"2024-02-16T10:31:06.927666+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:31:06.927666+0000","last_undegraded":"2024-02-16T10:31:06.927666+0000","last_fullsized":"2024-02-16T10:31:06.927666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657215+0000","last_change":"2024-02-16T10:30:28.084327+0000","last_active":"2024-02-16T10:31:11.657215+0000","last_peered":"2024-02-16T10:31:11.657215+0000","last_clean":"2024-02-16T10:31:11.657215+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:31:11.657215+0000","last_undegraded":"2024-02-16T10:31:11.657215+0000","last_fullsized":"2024-02-16T10:31:11.657215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:06.450863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919484+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:31:06.919484+0000","last_peered":"2024-02-16T10:31:06.919484+0000","last_clean":"2024-02-16T10:31:06.919484+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:31:06.919484+0000","last_undegraded":"2024-02-16T10:31:06.919484+0000","last_fullsized":"2024-02-16T10:31:06.919484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:40:58.824376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.985103+0000","last_change":"2024-02-16T10:30:36.142641+0000","last_active":"2024-02-16T10:32:00.985103+0000","last_peered":"2024-02-16T10:32:00.985103+0000","last_clean":"2024-02-16T10:32:00.985103+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:00.985103+0000","last_undegraded":"2024-02-16T10:32:00.985103+0000","last_fullsized":"2024-02-16T10:32:00.985103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:21.049073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.684138+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:31:12.684138+0000","last_peered":"2024-02-16T10:31:12.684138+0000","last_clean":"2024-02-16T10:31:12.684138+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:31:12.684138+0000","last_undegraded":"2024-02-16T10:31:12.684138+0000","last_fullsized":"2024-02-16T10:31:12.684138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:54.640122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919653+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:31:06.919653+0000","last_peered":"2024-02-16T10:31:06.919653+0000","last_clean":"2024-02-16T10:31:06.919653+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:31:06.919653+0000","last_undegraded":"2024-02-16T10:31:06.919653+0000","last_fullsized":"2024-02-16T10:31:06.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.559382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.938309+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.938309+0000","last_peered":"2024-02-16T10:31:06.938309+0000","last_clean":"2024-02-16T10:31:06.938309+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.938309+0000","last_undegraded":"2024-02-16T10:31:06.938309+0000","last_fullsized":"2024-02-16T10:31:06.938309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:35.001597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.310393+0000","last_change":"2024-02-16T10:30:32.121571+0000","last_active":"2024-02-16T10:31:55.310393+0000","last_peered":"2024-02-16T10:31:55.310393+0000","last_clean":"2024-02-16T10:31:55.310393+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:31:55.310393+0000","last_undegraded":"2024-02-16T10:31:55.310393+0000","last_fullsized":"2024-02-16T10:31:55.310393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:46.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928644+0000","last_change":"2024-02-16T10:30:34.125614+0000","last_active":"2024-02-16T10:31:06.928644+0000","last_peered":"2024-02-16T10:31:06.928644+0000","last_clean":"2024-02-16T10:31:06.928644+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:31:06.928644+0000","last_undegraded":"2024-02-16T10:31:06.928644+0000","last_fullsized":"2024-02-16T10:31:06.928644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.441324+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:49.441324+0000","last_peered":"2024-02-16T10:31:49.441324+0000","last_clean":"2024-02-16T10:31:49.441324+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:49.441324+0000","last_undegraded":"2024-02-16T10:31:49.441324+0000","last_fullsized":"2024-02-16T10:31:49.441324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:28.899004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996497+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:11.996497+0000","last_peered":"2024-02-16T10:31:11.996497+0000","last_clean":"2024-02-16T10:31:11.996497+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:11.996497+0000","last_undegraded":"2024-02-16T10:31:11.996497+0000","last_fullsized":"2024-02-16T10:31:11.996497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:02.014700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907578+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:31:06.907578+0000","last_peered":"2024-02-16T10:31:06.907578+0000","last_clean":"2024-02-16T10:31:06.907578+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:31:06.907578+0000","last_undegraded":"2024-02-16T10:31:06.907578+0000","last_fullsized":"2024-02-16T10:31:06.907578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932531+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:06.932531+0000","last_peered":"2024-02-16T10:31:06.932531+0000","last_clean":"2024-02-16T10:31:06.932531+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:06.932531+0000","last_undegraded":"2024-02-16T10:31:06.932531+0000","last_fullsized":"2024-02-16T10:31:06.932531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:01.288368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927053+0000","last_change":"2024-02-16T10:30:32.097568+0000","last_active":"2024-02-16T10:31:06.927053+0000","last_peered":"2024-02-16T10:31:06.927053+0000","last_clean":"2024-02-16T10:31:06.927053+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:31:06.927053+0000","last_undegraded":"2024-02-16T10:31:06.927053+0000","last_fullsized":"2024-02-16T10:31:06.927053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:48.421929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926352+0000","last_change":"2024-02-16T10:30:34.132449+0000","last_active":"2024-02-16T10:31:06.926352+0000","last_peered":"2024-02-16T10:31:06.926352+0000","last_clean":"2024-02-16T10:31:06.926352+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:31:06.926352+0000","last_undegraded":"2024-02-16T10:31:06.926352+0000","last_fullsized":"2024-02-16T10:31:06.926352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924189+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924189+0000","last_peered":"2024-02-16T10:31:06.924189+0000","last_clean":"2024-02-16T10:31:06.924189+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924189+0000","last_undegraded":"2024-02-16T10:31:06.924189+0000","last_fullsized":"2024-02-16T10:31:06.924189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003292+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.003292+0000","last_peered":"2024-02-16T10:32:01.003292+0000","last_clean":"2024-02-16T10:32:01.003292+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.003292+0000","last_undegraded":"2024-02-16T10:32:01.003292+0000","last_fullsized":"2024-02-16T10:32:01.003292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:16.057698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915976+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:31:06.915976+0000","last_peered":"2024-02-16T10:31:06.915976+0000","last_clean":"2024-02-16T10:31:06.915976+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:31:06.915976+0000","last_undegraded":"2024-02-16T10:31:06.915976+0000","last_fullsized":"2024-02-16T10:31:06.915976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:43.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932467+0000","last_change":"2024-02-16T10:30:30.080558+0000","last_active":"2024-02-16T10:31:06.932467+0000","last_peered":"2024-02-16T10:31:06.932467+0000","last_clean":"2024-02-16T10:31:06.932467+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:31:06.932467+0000","last_undegraded":"2024-02-16T10:31:06.932467+0000","last_fullsized":"2024-02-16T10:31:06.932467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914049+0000","last_change":"2024-02-16T10:30:32.096519+0000","last_active":"2024-02-16T10:31:06.914049+0000","last_peered":"2024-02-16T10:31:06.914049+0000","last_clean":"2024-02-16T10:31:06.914049+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:31:06.914049+0000","last_undegraded":"2024-02-16T10:31:06.914049+0000","last_fullsized":"2024-02-16T10:31:06.914049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:11.152738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.255838+0000","last_change":"2024-02-16T10:30:34.141896+0000","last_active":"2024-02-16T10:32:01.255838+0000","last_peered":"2024-02-16T10:32:01.255838+0000","last_clean":"2024-02-16T10:32:01.255838+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:01.255838+0000","last_undegraded":"2024-02-16T10:32:01.255838+0000","last_fullsized":"2024-02-16T10:32:01.255838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911474+0000","last_change":"2024-02-16T10:30:36.135895+0000","last_active":"2024-02-16T10:31:06.911474+0000","last_peered":"2024-02-16T10:31:06.911474+0000","last_clean":"2024-02-16T10:31:06.911474+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:31:06.911474+0000","last_undegraded":"2024-02-16T10:31:06.911474+0000","last_fullsized":"2024-02-16T10:31:06.911474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:52.487219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003499+0000","last_change":"2024-02-16T10:30:28.088671+0000","last_active":"2024-02-16T10:32:01.003499+0000","last_peered":"2024-02-16T10:32:01.003499+0000","last_clean":"2024-02-16T10:32:01.003499+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:01.003499+0000","last_undegraded":"2024-02-16T10:32:01.003499+0000","last_fullsized":"2024-02-16T10:32:01.003499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915727+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:31:06.915727+0000","last_peered":"2024-02-16T10:31:06.915727+0000","last_clean":"2024-02-16T10:31:06.915727+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:31:06.915727+0000","last_undegraded":"2024-02-16T10:31:06.915727+0000","last_fullsized":"2024-02-16T10:31:06.915727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:23.730310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928540+0000","last_change":"2024-02-16T10:30:30.101708+0000","last_active":"2024-02-16T10:31:06.928540+0000","last_peered":"2024-02-16T10:31:06.928540+0000","last_clean":"2024-02-16T10:31:06.928540+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:31:06.928540+0000","last_undegraded":"2024-02-16T10:31:06.928540+0000","last_fullsized":"2024-02-16T10:31:06.928540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:12.591167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.302243+0000","last_change":"2024-02-16T10:30:32.098362+0000","last_active":"2024-02-16T10:31:55.302243+0000","last_peered":"2024-02-16T10:31:55.302243+0000","last_clean":"2024-02-16T10:31:55.302243+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:31:55.302243+0000","last_undegraded":"2024-02-16T10:31:55.302243+0000","last_fullsized":"2024-02-16T10:31:55.302243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:06.260410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.263475+0000","last_change":"2024-02-16T10:30:34.123300+0000","last_active":"2024-02-16T10:32:01.263475+0000","last_peered":"2024-02-16T10:32:01.263475+0000","last_clean":"2024-02-16T10:32:01.263475+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:01.263475+0000","last_undegraded":"2024-02-16T10:32:01.263475+0000","last_fullsized":"2024-02-16T10:32:01.263475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914537+0000","last_change":"2024-02-16T10:30:28.076250+0000","last_active":"2024-02-16T10:31:06.914537+0000","last_peered":"2024-02-16T10:31:06.914537+0000","last_clean":"2024-02-16T10:31:06.914537+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:31:06.914537+0000","last_undegraded":"2024-02-16T10:31:06.914537+0000","last_fullsized":"2024-02-16T10:31:06.914537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:55.536607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916055+0000","last_change":"2024-02-16T10:30:26.085100+0000","last_active":"2024-02-16T10:31:06.916055+0000","last_peered":"2024-02-16T10:31:06.916055+0000","last_clean":"2024-02-16T10:31:06.916055+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:31:06.916055+0000","last_undegraded":"2024-02-16T10:31:06.916055+0000","last_fullsized":"2024-02-16T10:31:06.916055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914345+0000","last_change":"2024-02-16T10:30:30.090540+0000","last_active":"2024-02-16T10:31:06.914345+0000","last_peered":"2024-02-16T10:31:06.914345+0000","last_clean":"2024-02-16T10:31:06.914345+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:31:06.914345+0000","last_undegraded":"2024-02-16T10:31:06.914345+0000","last_fullsized":"2024-02-16T10:31:06.914345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:57.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.316729+0000","last_change":"2024-02-16T10:30:32.090733+0000","last_active":"2024-02-16T10:31:55.316729+0000","last_peered":"2024-02-16T10:31:55.316729+0000","last_clean":"2024-02-16T10:31:55.316729+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:31:55.316729+0000","last_undegraded":"2024-02-16T10:31:55.316729+0000","last_fullsized":"2024-02-16T10:31:55.316729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:14.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927184+0000","last_change":"2024-02-16T10:30:34.130521+0000","last_active":"2024-02-16T10:31:06.927184+0000","last_peered":"2024-02-16T10:31:06.927184+0000","last_clean":"2024-02-16T10:31:06.927184+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:31:06.927184+0000","last_undegraded":"2024-02-16T10:31:06.927184+0000","last_fullsized":"2024-02-16T10:31:06.927184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:16.619978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.089594+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:31:55.089594+0000","last_peered":"2024-02-16T10:31:55.089594+0000","last_clean":"2024-02-16T10:31:55.089594+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:31:55.089594+0000","last_undegraded":"2024-02-16T10:31:55.089594+0000","last_fullsized":"2024-02-16T10:31:55.089594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:35.549647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.355411+0000","last_change":"2024-02-16T10:30:28.072768+0000","last_active":"2024-02-16T10:31:55.355411+0000","last_peered":"2024-02-16T10:31:55.355411+0000","last_clean":"2024-02-16T10:31:55.355411+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:31:55.355411+0000","last_undegraded":"2024-02-16T10:31:55.355411+0000","last_fullsized":"2024-02-16T10:31:55.355411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921914+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:31:06.921914+0000","last_peered":"2024-02-16T10:31:06.921914+0000","last_clean":"2024-02-16T10:31:06.921914+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:31:06.921914+0000","last_undegraded":"2024-02-16T10:31:06.921914+0000","last_fullsized":"2024-02-16T10:31:06.921914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925241+0000","last_change":"2024-02-16T10:30:30.092397+0000","last_active":"2024-02-16T10:31:06.925241+0000","last_peered":"2024-02-16T10:31:06.925241+0000","last_clean":"2024-02-16T10:31:06.925241+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:31:06.925241+0000","last_undegraded":"2024-02-16T10:31:06.925241+0000","last_fullsized":"2024-02-16T10:31:06.925241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:17:37.092874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.287165+0000","last_change":"2024-02-16T10:30:32.120960+0000","last_active":"2024-02-16T10:31:55.287165+0000","last_peered":"2024-02-16T10:31:55.287165+0000","last_clean":"2024-02-16T10:31:55.287165+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:31:55.287165+0000","last_undegraded":"2024-02-16T10:31:55.287165+0000","last_fullsized":"2024-02-16T10:31:55.287165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:15.954493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925210+0000","last_change":"2024-02-16T10:30:34.135930+0000","last_active":"2024-02-16T10:31:06.925210+0000","last_peered":"2024-02-16T10:31:06.925210+0000","last_clean":"2024-02-16T10:31:06.925210+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:31:06.925210+0000","last_undegraded":"2024-02-16T10:31:06.925210+0000","last_fullsized":"2024-02-16T10:31:06.925210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.305924+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:31:49.305924+0000","last_peered":"2024-02-16T10:31:49.305924+0000","last_clean":"2024-02-16T10:31:49.305924+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:31:49.305924+0000","last_undegraded":"2024-02-16T10:31:49.305924+0000","last_fullsized":"2024-02-16T10:31:49.305924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.201148+0000","last_change":"2024-02-16T10:30:28.064067+0000","last_active":"2024-02-16T10:31:11.201148+0000","last_peered":"2024-02-16T10:31:11.201148+0000","last_clean":"2024-02-16T10:31:11.201148+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:31:11.201148+0000","last_undegraded":"2024-02-16T10:31:11.201148+0000","last_fullsized":"2024-02-16T10:31:11.201148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:05.987067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927937+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:31:06.927937+0000","last_peered":"2024-02-16T10:31:06.927937+0000","last_clean":"2024-02-16T10:31:06.927937+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:31:06.927937+0000","last_undegraded":"2024-02-16T10:31:06.927937+0000","last_fullsized":"2024-02-16T10:31:06.927937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:20.023353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926646+0000","last_change":"2024-02-16T10:30:30.080329+0000","last_active":"2024-02-16T10:31:06.926646+0000","last_peered":"2024-02-16T10:31:06.926646+0000","last_clean":"2024-02-16T10:31:06.926646+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:31:06.926646+0000","last_undegraded":"2024-02-16T10:31:06.926646+0000","last_fullsized":"2024-02-16T10:31:06.926646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:30.180346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.319591+0000","last_change":"2024-02-16T10:30:32.116257+0000","last_active":"2024-02-16T10:31:55.319591+0000","last_peered":"2024-02-16T10:31:55.319591+0000","last_clean":"2024-02-16T10:31:55.319591+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:31:55.319591+0000","last_undegraded":"2024-02-16T10:31:55.319591+0000","last_fullsized":"2024-02-16T10:31:55.319591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:52.854962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.265989+0000","last_change":"2024-02-16T10:30:34.135819+0000","last_active":"2024-02-16T10:32:01.265989+0000","last_peered":"2024-02-16T10:32:01.265989+0000","last_clean":"2024-02-16T10:32:01.265989+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:01.265989+0000","last_undegraded":"2024-02-16T10:32:01.265989+0000","last_fullsized":"2024-02-16T10:32:01.265989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927141+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:31:06.927141+0000","last_peered":"2024-02-16T10:31:06.927141+0000","last_clean":"2024-02-16T10:31:06.927141+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:31:06.927141+0000","last_undegraded":"2024-02-16T10:31:06.927141+0000","last_fullsized":"2024-02-16T10:31:06.927141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:55.920641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657202+0000","last_change":"2024-02-16T10:30:28.068604+0000","last_active":"2024-02-16T10:31:11.657202+0000","last_peered":"2024-02-16T10:31:11.657202+0000","last_clean":"2024-02-16T10:31:11.657202+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:31:11.657202+0000","last_undegraded":"2024-02-16T10:31:11.657202+0000","last_fullsized":"2024-02-16T10:31:11.657202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924328+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:31:06.924328+0000","last_peered":"2024-02-16T10:31:06.924328+0000","last_clean":"2024-02-16T10:31:06.924328+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:31:06.924328+0000","last_undegraded":"2024-02-16T10:31:06.924328+0000","last_fullsized":"2024-02-16T10:31:06.924328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:56.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926096+0000","last_change":"2024-02-16T10:30:30.081734+0000","last_active":"2024-02-16T10:31:06.926096+0000","last_peered":"2024-02-16T10:31:06.926096+0000","last_clean":"2024-02-16T10:31:06.926096+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:31:06.926096+0000","last_undegraded":"2024-02-16T10:31:06.926096+0000","last_fullsized":"2024-02-16T10:31:06.926096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:06.703746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.937216+0000","last_change":"2024-02-16T10:30:32.122915+0000","last_active":"2024-02-16T10:32:00.937216+0000","last_peered":"2024-02-16T10:32:00.937216+0000","last_clean":"2024-02-16T10:32:00.937216+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:00.937216+0000","last_undegraded":"2024-02-16T10:32:00.937216+0000","last_fullsized":"2024-02-16T10:32:00.937216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:06.755062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924769+0000","last_change":"2024-02-16T10:30:34.118800+0000","last_active":"2024-02-16T10:31:06.924769+0000","last_peered":"2024-02-16T10:31:06.924769+0000","last_clean":"2024-02-16T10:31:06.924769+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:31:06.924769+0000","last_undegraded":"2024-02-16T10:31:06.924769+0000","last_fullsized":"2024-02-16T10:31:06.924769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929435+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:31:06.929435+0000","last_peered":"2024-02-16T10:31:06.929435+0000","last_clean":"2024-02-16T10:31:06.929435+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:31:06.929435+0000","last_undegraded":"2024-02-16T10:31:06.929435+0000","last_fullsized":"2024-02-16T10:31:06.929435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:56.882445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.683838+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:31:12.683838+0000","last_peered":"2024-02-16T10:31:12.683838+0000","last_clean":"2024-02-16T10:31:12.683838+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:31:12.683838+0000","last_undegraded":"2024-02-16T10:31:12.683838+0000","last_fullsized":"2024-02-16T10:31:12.683838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:52.232418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926917+0000","last_change":"2024-02-16T10:30:26.098753+0000","last_active":"2024-02-16T10:31:06.926917+0000","last_peered":"2024-02-16T10:31:06.926917+0000","last_clean":"2024-02-16T10:31:06.926917+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:31:06.926917+0000","last_undegraded":"2024-02-16T10:31:06.926917+0000","last_fullsized":"2024-02-16T10:31:06.926917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.061106+0000","last_change":"2024-02-16T10:30:30.080515+0000","last_active":"2024-02-16T10:32:02.061106+0000","last_peered":"2024-02-16T10:32:02.061106+0000","last_clean":"2024-02-16T10:32:02.061106+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:02.061106+0000","last_undegraded":"2024-02-16T10:32:02.061106+0000","last_fullsized":"2024-02-16T10:32:02.061106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:03.555320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.292402+0000","last_change":"2024-02-16T10:30:32.094520+0000","last_active":"2024-02-16T10:31:55.292402+0000","last_peered":"2024-02-16T10:31:55.292402+0000","last_clean":"2024-02-16T10:31:55.292402+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:31:55.292402+0000","last_undegraded":"2024-02-16T10:31:55.292402+0000","last_fullsized":"2024-02-16T10:31:55.292402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:31.069304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.933898+0000","last_change":"2024-02-16T10:30:34.141827+0000","last_active":"2024-02-16T10:31:06.933898+0000","last_peered":"2024-02-16T10:31:06.933898+0000","last_clean":"2024-02-16T10:31:06.933898+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:31:06.933898+0000","last_undegraded":"2024-02-16T10:31:06.933898+0000","last_fullsized":"2024-02-16T10:31:06.933898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:38.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911244+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:31:06.911244+0000","last_peered":"2024-02-16T10:31:06.911244+0000","last_clean":"2024-02-16T10:31:06.911244+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:31:06.911244+0000","last_undegraded":"2024-02-16T10:31:06.911244+0000","last_fullsized":"2024-02-16T10:31:06.911244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:00.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.202587+0000","last_change":"2024-02-16T10:30:28.086917+0000","last_active":"2024-02-16T10:31:11.202587+0000","last_peered":"2024-02-16T10:31:11.202587+0000","last_clean":"2024-02-16T10:31:11.202587+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:31:11.202587+0000","last_undegraded":"2024-02-16T10:31:11.202587+0000","last_fullsized":"2024-02-16T10:31:11.202587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:44.394736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921051+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:31:06.921051+0000","last_peered":"2024-02-16T10:31:06.921051+0000","last_clean":"2024-02-16T10:31:06.921051+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:31:06.921051+0000","last_undegraded":"2024-02-16T10:31:06.921051+0000","last_fullsized":"2024-02-16T10:31:06.921051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926662+0000","last_change":"2024-02-16T10:30:30.082304+0000","last_active":"2024-02-16T10:31:06.926662+0000","last_peered":"2024-02-16T10:31:06.926662+0000","last_clean":"2024-02-16T10:31:06.926662+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:31:06.926662+0000","last_undegraded":"2024-02-16T10:31:06.926662+0000","last_fullsized":"2024-02-16T10:31:06.926662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:59.066509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.335445+0000","last_change":"2024-02-16T10:30:32.091187+0000","last_active":"2024-02-16T10:31:55.335445+0000","last_peered":"2024-02-16T10:31:55.335445+0000","last_clean":"2024-02-16T10:31:55.335445+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:31:55.335445+0000","last_undegraded":"2024-02-16T10:31:55.335445+0000","last_fullsized":"2024-02-16T10:31:55.335445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:59.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.257093+0000","last_change":"2024-02-16T10:30:34.129069+0000","last_active":"2024-02-16T10:32:01.257093+0000","last_peered":"2024-02-16T10:32:01.257093+0000","last_clean":"2024-02-16T10:32:01.257093+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:01.257093+0000","last_undegraded":"2024-02-16T10:32:01.257093+0000","last_fullsized":"2024-02-16T10:32:01.257093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:33.083249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.374319+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:31:55.374319+0000","last_peered":"2024-02-16T10:31:55.374319+0000","last_clean":"2024-02-16T10:31:55.374319+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:31:55.374319+0000","last_undegraded":"2024-02-16T10:31:55.374319+0000","last_fullsized":"2024-02-16T10:31:55.374319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922972+0000","last_change":"2024-02-16T10:30:28.063099+0000","last_active":"2024-02-16T10:31:06.922972+0000","last_peered":"2024-02-16T10:31:06.922972+0000","last_clean":"2024-02-16T10:31:06.922972+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:31:06.922972+0000","last_undegraded":"2024-02-16T10:31:06.922972+0000","last_fullsized":"2024-02-16T10:31:06.922972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.987828+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:31:11.987828+0000","last_peered":"2024-02-16T10:31:11.987828+0000","last_clean":"2024-02-16T10:31:11.987828+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:31:11.987828+0000","last_undegraded":"2024-02-16T10:31:11.987828+0000","last_fullsized":"2024-02-16T10:31:11.987828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:21.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193502+0000","last_change":"2024-02-16T10:30:30.090962+0000","last_active":"2024-02-16T10:32:02.193502+0000","last_peered":"2024-02-16T10:32:02.193502+0000","last_clean":"2024-02-16T10:32:02.193502+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:02.193502+0000","last_undegraded":"2024-02-16T10:32:02.193502+0000","last_fullsized":"2024-02-16T10:32:02.193502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:08.415016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928037+0000","last_change":"2024-02-16T10:30:32.123949+0000","last_active":"2024-02-16T10:31:06.928037+0000","last_peered":"2024-02-16T10:31:06.928037+0000","last_clean":"2024-02-16T10:31:06.928037+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:31:06.928037+0000","last_undegraded":"2024-02-16T10:31:06.928037+0000","last_fullsized":"2024-02-16T10:31:06.928037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:03.303232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.259237+0000","last_change":"2024-02-16T10:30:34.117090+0000","last_active":"2024-02-16T10:32:01.259237+0000","last_peered":"2024-02-16T10:32:01.259237+0000","last_clean":"2024-02-16T10:32:01.259237+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:01.259237+0000","last_undegraded":"2024-02-16T10:32:01.259237+0000","last_fullsized":"2024-02-16T10:32:01.259237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908544+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:31:06.908544+0000","last_peered":"2024-02-16T10:31:06.908544+0000","last_clean":"2024-02-16T10:31:06.908544+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:31:06.908544+0000","last_undegraded":"2024-02-16T10:31:06.908544+0000","last_fullsized":"2024-02-16T10:31:06.908544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:36.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497874+0000","last_change":"2024-02-16T10:30:28.085134+0000","last_active":"2024-02-16T10:31:54.497874+0000","last_peered":"2024-02-16T10:31:54.497874+0000","last_clean":"2024-02-16T10:31:54.497874+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:31:54.497874+0000","last_undegraded":"2024-02-16T10:31:54.497874+0000","last_fullsized":"2024-02-16T10:31:54.497874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:01.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913722+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:31:06.913722+0000","last_peered":"2024-02-16T10:31:06.913722+0000","last_clean":"2024-02-16T10:31:06.913722+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:31:06.913722+0000","last_undegraded":"2024-02-16T10:31:06.913722+0000","last_fullsized":"2024-02-16T10:31:06.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:18.440901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929645+0000","last_change":"2024-02-16T10:30:30.102962+0000","last_active":"2024-02-16T10:31:06.929645+0000","last_peered":"2024-02-16T10:31:06.929645+0000","last_clean":"2024-02-16T10:31:06.929645+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:31:06.929645+0000","last_undegraded":"2024-02-16T10:31:06.929645+0000","last_fullsized":"2024-02-16T10:31:06.929645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:37:30.267642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.312265+0000","last_change":"2024-02-16T10:30:32.094067+0000","last_active":"2024-02-16T10:31:55.312265+0000","last_peered":"2024-02-16T10:31:55.312265+0000","last_clean":"2024-02-16T10:31:55.312265+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:31:55.312265+0000","last_undegraded":"2024-02-16T10:31:55.312265+0000","last_fullsized":"2024-02-16T10:31:55.312265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:49.917930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913640+0000","last_change":"2024-02-16T10:30:34.143148+0000","last_active":"2024-02-16T10:31:06.913640+0000","last_peered":"2024-02-16T10:31:06.913640+0000","last_clean":"2024-02-16T10:31:06.913640+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:31:06.913640+0000","last_undegraded":"2024-02-16T10:31:06.913640+0000","last_fullsized":"2024-02-16T10:31:06.913640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:03.500298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919017+0000","last_change":"2024-02-16T10:30:36.124467+0000","last_active":"2024-02-16T10:31:06.919017+0000","last_peered":"2024-02-16T10:31:06.919017+0000","last_clean":"2024-02-16T10:31:06.919017+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:31:06.919017+0000","last_undegraded":"2024-02-16T10:31:06.919017+0000","last_fullsized":"2024-02-16T10:31:06.919017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:10.069376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.009909+0000","last_change":"2024-02-16T10:30:28.084181+0000","last_active":"2024-02-16T10:31:12.009909+0000","last_peered":"2024-02-16T10:31:12.009909+0000","last_clean":"2024-02-16T10:31:12.009909+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:31:12.009909+0000","last_undegraded":"2024-02-16T10:31:12.009909+0000","last_fullsized":"2024-02-16T10:31:12.009909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:30.459984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911425+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:31:06.911425+0000","last_peered":"2024-02-16T10:31:06.911425+0000","last_clean":"2024-02-16T10:31:06.911425+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:31:06.911425+0000","last_undegraded":"2024-02-16T10:31:06.911425+0000","last_fullsized":"2024-02-16T10:31:06.911425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920241+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:31:06.920241+0000","last_peered":"2024-02-16T10:31:06.920241+0000","last_clean":"2024-02-16T10:31:06.920241+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:31:06.920241+0000","last_undegraded":"2024-02-16T10:31:06.920241+0000","last_fullsized":"2024-02-16T10:31:06.920241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919063+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:31:06.919063+0000","last_peered":"2024-02-16T10:31:06.919063+0000","last_clean":"2024-02-16T10:31:06.919063+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:31:06.919063+0000","last_undegraded":"2024-02-16T10:31:06.919063+0000","last_fullsized":"2024-02-16T10:31:06.919063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.376276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929597+0000","last_change":"2024-02-16T10:30:30.091282+0000","last_active":"2024-02-16T10:31:06.929597+0000","last_peered":"2024-02-16T10:31:06.929597+0000","last_clean":"2024-02-16T10:31:06.929597+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:31:06.929597+0000","last_undegraded":"2024-02-16T10:31:06.929597+0000","last_fullsized":"2024-02-16T10:31:06.929597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:45.940628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.963490+0000","last_change":"2024-02-16T10:30:32.125750+0000","last_active":"2024-02-16T10:32:00.963490+0000","last_peered":"2024-02-16T10:32:00.963490+0000","last_clean":"2024-02-16T10:32:00.963490+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:00.963490+0000","last_undegraded":"2024-02-16T10:32:00.963490+0000","last_fullsized":"2024-02-16T10:32:00.963490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:57:39.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":72,"num_read_kb":76,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927452+0000","last_change":"2024-02-16T10:30:34.135655+0000","last_active":"2024-02-16T10:31:06.927452+0000","last_peered":"2024-02-16T10:31:06.927452+0000","last_clean":"2024-02-16T10:31:06.927452+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:31:06.927452+0000","last_undegraded":"2024-02-16T10:31:06.927452+0000","last_fullsized":"2024-02-16T10:31:06.927452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:22.389333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.026066+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:01.026066+0000","last_peered":"2024-02-16T10:32:01.026066+0000","last_clean":"2024-02-16T10:32:01.026066+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:01.026066+0000","last_undegraded":"2024-02-16T10:32:01.026066+0000","last_fullsized":"2024-02-16T10:32:01.026066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:51.053720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.685163+0000","last_change":"2024-02-16T10:30:28.069523+0000","last_active":"2024-02-16T10:31:12.685163+0000","last_peered":"2024-02-16T10:31:12.685163+0000","last_clean":"2024-02-16T10:31:12.685163+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:31:12.685163+0000","last_undegraded":"2024-02-16T10:31:12.685163+0000","last_fullsized":"2024-02-16T10:31:12.685163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:45.890737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912556+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:31:06.912556+0000","last_peered":"2024-02-16T10:31:06.912556+0000","last_clean":"2024-02-16T10:31:06.912556+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:31:06.912556+0000","last_undegraded":"2024-02-16T10:31:06.912556+0000","last_fullsized":"2024-02-16T10:31:06.912556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.966566+0000","last_change":"2024-02-16T10:30:26.098916+0000","last_active":"2024-02-16T10:31:11.966566+0000","last_peered":"2024-02-16T10:31:11.966566+0000","last_clean":"2024-02-16T10:31:11.966566+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:31:11.966566+0000","last_undegraded":"2024-02-16T10:31:11.966566+0000","last_fullsized":"2024-02-16T10:31:11.966566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934263+0000","last_change":"2024-02-16T10:30:30.102474+0000","last_active":"2024-02-16T10:31:06.934263+0000","last_peered":"2024-02-16T10:31:06.934263+0000","last_clean":"2024-02-16T10:31:06.934263+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:31:06.934263+0000","last_undegraded":"2024-02-16T10:31:06.934263+0000","last_fullsized":"2024-02-16T10:31:06.934263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:06.503438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.250178+0000","last_change":"2024-02-16T10:30:32.096480+0000","last_active":"2024-02-16T10:32:01.250178+0000","last_peered":"2024-02-16T10:32:01.250178+0000","last_clean":"2024-02-16T10:32:01.250178+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:01.250178+0000","last_undegraded":"2024-02-16T10:32:01.250178+0000","last_fullsized":"2024-02-16T10:32:01.250178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:13.908498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923579+0000","last_change":"2024-02-16T10:30:34.141970+0000","last_active":"2024-02-16T10:31:06.923579+0000","last_peered":"2024-02-16T10:31:06.923579+0000","last_clean":"2024-02-16T10:31:06.923579+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:31:06.923579+0000","last_undegraded":"2024-02-16T10:31:06.923579+0000","last_fullsized":"2024-02-16T10:31:06.923579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:53.614440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.457111+0000","last_change":"2024-02-16T10:30:36.139509+0000","last_active":"2024-02-16T10:31:49.457111+0000","last_peered":"2024-02-16T10:31:49.457111+0000","last_clean":"2024-02-16T10:31:49.457111+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:31:49.457111+0000","last_undegraded":"2024-02-16T10:31:49.457111+0000","last_fullsized":"2024-02-16T10:31:49.457111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:50.619455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003297+0000","last_change":"2024-02-16T10:30:28.079105+0000","last_active":"2024-02-16T10:32:01.003297+0000","last_peered":"2024-02-16T10:32:01.003297+0000","last_clean":"2024-02-16T10:32:01.003297+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:01.003297+0000","last_undegraded":"2024-02-16T10:32:01.003297+0000","last_fullsized":"2024-02-16T10:32:01.003297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908820+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:31:06.908820+0000","last_peered":"2024-02-16T10:31:06.908820+0000","last_clean":"2024-02-16T10:31:06.908820+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:31:06.908820+0000","last_undegraded":"2024-02-16T10:31:06.908820+0000","last_fullsized":"2024-02-16T10:31:06.908820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924324+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:31:06.924324+0000","last_peered":"2024-02-16T10:31:06.924324+0000","last_clean":"2024-02-16T10:31:06.924324+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:31:06.924324+0000","last_undegraded":"2024-02-16T10:31:06.924324+0000","last_fullsized":"2024-02-16T10:31:06.924324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915764+0000","last_change":"2024-02-16T10:30:30.078068+0000","last_active":"2024-02-16T10:31:06.915764+0000","last_peered":"2024-02-16T10:31:06.915764+0000","last_clean":"2024-02-16T10:31:06.915764+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:31:06.915764+0000","last_undegraded":"2024-02-16T10:31:06.915764+0000","last_fullsized":"2024-02-16T10:31:06.915764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:40.026302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.261541+0000","last_change":"2024-02-16T10:30:32.091702+0000","last_active":"2024-02-16T10:32:00.261541+0000","last_peered":"2024-02-16T10:32:00.261541+0000","last_clean":"2024-02-16T10:32:00.261541+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:00.261541+0000","last_undegraded":"2024-02-16T10:32:00.261541+0000","last_fullsized":"2024-02-16T10:32:00.261541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:33.175979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927804+0000","last_change":"2024-02-16T10:30:34.138200+0000","last_active":"2024-02-16T10:31:06.927804+0000","last_peered":"2024-02-16T10:31:06.927804+0000","last_clean":"2024-02-16T10:31:06.927804+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:31:06.927804+0000","last_undegraded":"2024-02-16T10:31:06.927804+0000","last_fullsized":"2024-02-16T10:31:06.927804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:20.815431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917885+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:31:06.917885+0000","last_peered":"2024-02-16T10:31:06.917885+0000","last_clean":"2024-02-16T10:31:06.917885+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:31:06.917885+0000","last_undegraded":"2024-02-16T10:31:06.917885+0000","last_fullsized":"2024-02-16T10:31:06.917885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:08.274614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.205515+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:31:11.205515+0000","last_peered":"2024-02-16T10:31:11.205515+0000","last_clean":"2024-02-16T10:31:11.205515+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:31:11.205515+0000","last_undegraded":"2024-02-16T10:31:11.205515+0000","last_fullsized":"2024-02-16T10:31:11.205515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915962+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:31:06.915962+0000","last_peered":"2024-02-16T10:31:06.915962+0000","last_clean":"2024-02-16T10:31:06.915962+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:31:06.915962+0000","last_undegraded":"2024-02-16T10:31:06.915962+0000","last_fullsized":"2024-02-16T10:31:06.915962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912749+0000","last_change":"2024-02-16T10:30:26.084253+0000","last_active":"2024-02-16T10:31:06.912749+0000","last_peered":"2024-02-16T10:31:06.912749+0000","last_clean":"2024-02-16T10:31:06.912749+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:31:06.912749+0000","last_undegraded":"2024-02-16T10:31:06.912749+0000","last_fullsized":"2024-02-16T10:31:06.912749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927392+0000","last_change":"2024-02-16T10:30:30.080063+0000","last_active":"2024-02-16T10:31:06.927392+0000","last_peered":"2024-02-16T10:31:06.927392+0000","last_clean":"2024-02-16T10:31:06.927392+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:31:06.927392+0000","last_undegraded":"2024-02-16T10:31:06.927392+0000","last_fullsized":"2024-02-16T10:31:06.927392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:12.944183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928152+0000","last_change":"2024-02-16T10:30:32.125409+0000","last_active":"2024-02-16T10:31:06.928152+0000","last_peered":"2024-02-16T10:31:06.928152+0000","last_clean":"2024-02-16T10:31:06.928152+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:31:06.928152+0000","last_undegraded":"2024-02-16T10:31:06.928152+0000","last_fullsized":"2024-02-16T10:31:06.928152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:35:51.048004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934645+0000","last_change":"2024-02-16T10:30:34.141949+0000","last_active":"2024-02-16T10:31:06.934645+0000","last_peered":"2024-02-16T10:31:06.934645+0000","last_clean":"2024-02-16T10:31:06.934645+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:31:06.934645+0000","last_undegraded":"2024-02-16T10:31:06.934645+0000","last_fullsized":"2024-02-16T10:31:06.934645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:14:10.316154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.339887+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:31:55.339887+0000","last_peered":"2024-02-16T10:31:55.339887+0000","last_clean":"2024-02-16T10:31:55.339887+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:31:55.339887+0000","last_undegraded":"2024-02-16T10:31:55.339887+0000","last_fullsized":"2024-02-16T10:31:55.339887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:25.468581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354549+0000","last_change":"2024-02-16T10:30:28.065872+0000","last_active":"2024-02-16T10:31:55.354549+0000","last_peered":"2024-02-16T10:31:55.354549+0000","last_clean":"2024-02-16T10:31:55.354549+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:31:55.354549+0000","last_undegraded":"2024-02-16T10:31:55.354549+0000","last_fullsized":"2024-02-16T10:31:55.354549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914991+0000","last_change":"2024-02-16T10:30:26.087305+0000","last_active":"2024-02-16T10:31:06.914991+0000","last_peered":"2024-02-16T10:31:06.914991+0000","last_clean":"2024-02-16T10:31:06.914991+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:31:06.914991+0000","last_undegraded":"2024-02-16T10:31:06.914991+0000","last_fullsized":"2024-02-16T10:31:06.914991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927469+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:31:06.927469+0000","last_peered":"2024-02-16T10:31:06.927469+0000","last_clean":"2024-02-16T10:31:06.927469+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:31:06.927469+0000","last_undegraded":"2024-02-16T10:31:06.927469+0000","last_fullsized":"2024-02-16T10:31:06.927469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926744+0000","last_change":"2024-02-16T10:30:30.079568+0000","last_active":"2024-02-16T10:31:06.926744+0000","last_peered":"2024-02-16T10:31:06.926744+0000","last_clean":"2024-02-16T10:31:06.926744+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:31:06.926744+0000","last_undegraded":"2024-02-16T10:31:06.926744+0000","last_fullsized":"2024-02-16T10:31:06.926744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:12.104297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.981370+0000","last_change":"2024-02-16T10:30:32.088251+0000","last_active":"2024-02-16T10:32:00.981370+0000","last_peered":"2024-02-16T10:32:00.981370+0000","last_clean":"2024-02-16T10:32:00.981370+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:00.981370+0000","last_undegraded":"2024-02-16T10:32:00.981370+0000","last_fullsized":"2024-02-16T10:32:00.981370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:58.667315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906656+0000","last_change":"2024-02-16T10:30:34.119623+0000","last_active":"2024-02-16T10:31:06.906656+0000","last_peered":"2024-02-16T10:31:06.906656+0000","last_clean":"2024-02-16T10:31:06.906656+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:31:06.906656+0000","last_undegraded":"2024-02-16T10:31:06.906656+0000","last_fullsized":"2024-02-16T10:31:06.906656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:22.098837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.337862+0000","last_change":"2024-02-16T10:30:36.121926+0000","last_active":"2024-02-16T10:31:55.337862+0000","last_peered":"2024-02-16T10:31:55.337862+0000","last_clean":"2024-02-16T10:31:55.337862+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:31:55.337862+0000","last_undegraded":"2024-02-16T10:31:55.337862+0000","last_fullsized":"2024-02-16T10:31:55.337862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:27:43.916489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919422+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:31:06.919422+0000","last_peered":"2024-02-16T10:31:06.919422+0000","last_clean":"2024-02-16T10:31:06.919422+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:31:06.919422+0000","last_undegraded":"2024-02-16T10:31:06.919422+0000","last_fullsized":"2024-02-16T10:31:06.919422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:27:43.149715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929126+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:31:06.929126+0000","last_peered":"2024-02-16T10:31:06.929126+0000","last_clean":"2024-02-16T10:31:06.929126+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:31:06.929126+0000","last_undegraded":"2024-02-16T10:31:06.929126+0000","last_fullsized":"2024-02-16T10:31:06.929126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926258+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:31:06.926258+0000","last_peered":"2024-02-16T10:31:06.926258+0000","last_clean":"2024-02-16T10:31:06.926258+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:31:06.926258+0000","last_undegraded":"2024-02-16T10:31:06.926258+0000","last_fullsized":"2024-02-16T10:31:06.926258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915178+0000","last_change":"2024-02-16T10:30:30.100081+0000","last_active":"2024-02-16T10:31:06.915178+0000","last_peered":"2024-02-16T10:31:06.915178+0000","last_clean":"2024-02-16T10:31:06.915178+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:31:06.915178+0000","last_undegraded":"2024-02-16T10:31:06.915178+0000","last_fullsized":"2024-02-16T10:31:06.915178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:04.710974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911662+0000","last_change":"2024-02-16T10:30:32.101750+0000","last_active":"2024-02-16T10:31:06.911662+0000","last_peered":"2024-02-16T10:31:06.911662+0000","last_clean":"2024-02-16T10:31:06.911662+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:31:06.911662+0000","last_undegraded":"2024-02-16T10:31:06.911662+0000","last_fullsized":"2024-02-16T10:31:06.911662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:20.084891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.253565+0000","last_change":"2024-02-16T10:30:34.111985+0000","last_active":"2024-02-16T10:32:01.253565+0000","last_peered":"2024-02-16T10:32:01.253565+0000","last_clean":"2024-02-16T10:32:01.253565+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:01.253565+0000","last_undegraded":"2024-02-16T10:32:01.253565+0000","last_fullsized":"2024-02-16T10:32:01.253565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932415+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:31:06.932415+0000","last_peered":"2024-02-16T10:31:06.932415+0000","last_clean":"2024-02-16T10:31:06.932415+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:31:06.932415+0000","last_undegraded":"2024-02-16T10:31:06.932415+0000","last_fullsized":"2024-02-16T10:31:06.932415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:46.560489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922019+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:06.922019+0000","last_peered":"2024-02-16T10:31:06.922019+0000","last_clean":"2024-02-16T10:31:06.922019+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:06.922019+0000","last_undegraded":"2024-02-16T10:31:06.922019+0000","last_fullsized":"2024-02-16T10:31:06.922019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:17.413905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936126+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:31:06.936126+0000","last_peered":"2024-02-16T10:31:06.936126+0000","last_clean":"2024-02-16T10:31:06.936126+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:31:06.936126+0000","last_undegraded":"2024-02-16T10:31:06.936126+0000","last_fullsized":"2024-02-16T10:31:06.936126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:27.417317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928021+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:31:06.928021+0000","last_peered":"2024-02-16T10:31:06.928021+0000","last_clean":"2024-02-16T10:31:06.928021+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:31:06.928021+0000","last_undegraded":"2024-02-16T10:31:06.928021+0000","last_fullsized":"2024-02-16T10:31:06.928021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915715+0000","last_change":"2024-02-16T10:30:30.097705+0000","last_active":"2024-02-16T10:31:06.915715+0000","last_peered":"2024-02-16T10:31:06.915715+0000","last_clean":"2024-02-16T10:31:06.915715+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:31:06.915715+0000","last_undegraded":"2024-02-16T10:31:06.915715+0000","last_fullsized":"2024-02-16T10:31:06.915715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:01.461744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920148+0000","last_change":"2024-02-16T10:30:32.121333+0000","last_active":"2024-02-16T10:31:06.920148+0000","last_peered":"2024-02-16T10:31:06.920148+0000","last_clean":"2024-02-16T10:31:06.920148+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:31:06.920148+0000","last_undegraded":"2024-02-16T10:31:06.920148+0000","last_fullsized":"2024-02-16T10:31:06.920148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:10.723393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.261495+0000","last_change":"2024-02-16T10:30:34.123666+0000","last_active":"2024-02-16T10:32:01.261495+0000","last_peered":"2024-02-16T10:32:01.261495+0000","last_clean":"2024-02-16T10:32:01.261495+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:01.261495+0000","last_undegraded":"2024-02-16T10:32:01.261495+0000","last_fullsized":"2024-02-16T10:32:01.261495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:37.246851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924998+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:31:06.924998+0000","last_peered":"2024-02-16T10:31:06.924998+0000","last_clean":"2024-02-16T10:31:06.924998+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:31:06.924998+0000","last_undegraded":"2024-02-16T10:31:06.924998+0000","last_fullsized":"2024-02-16T10:31:06.924998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907950+0000","last_change":"2024-02-16T10:30:28.059745+0000","last_active":"2024-02-16T10:31:06.907950+0000","last_peered":"2024-02-16T10:31:06.907950+0000","last_clean":"2024-02-16T10:31:06.907950+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:31:06.907950+0000","last_undegraded":"2024-02-16T10:31:06.907950+0000","last_fullsized":"2024-02-16T10:31:06.907950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:20.455470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926582+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:31:06.926582+0000","last_peered":"2024-02-16T10:31:06.926582+0000","last_clean":"2024-02-16T10:31:06.926582+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:31:06.926582+0000","last_undegraded":"2024-02-16T10:31:06.926582+0000","last_fullsized":"2024-02-16T10:31:06.926582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934928+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:31:06.934928+0000","last_peered":"2024-02-16T10:31:06.934928+0000","last_clean":"2024-02-16T10:31:06.934928+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:31:06.934928+0000","last_undegraded":"2024-02-16T10:31:06.934928+0000","last_fullsized":"2024-02-16T10:31:06.934928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912208+0000","last_change":"2024-02-16T10:30:30.090784+0000","last_active":"2024-02-16T10:31:06.912208+0000","last_peered":"2024-02-16T10:31:06.912208+0000","last_clean":"2024-02-16T10:31:06.912208+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:31:06.912208+0000","last_undegraded":"2024-02-16T10:31:06.912208+0000","last_fullsized":"2024-02-16T10:31:06.912208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:16.786621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.945908+0000","last_change":"2024-02-16T10:30:32.086049+0000","last_active":"2024-02-16T10:32:00.945908+0000","last_peered":"2024-02-16T10:32:00.945908+0000","last_clean":"2024-02-16T10:32:00.945908+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:00.945908+0000","last_undegraded":"2024-02-16T10:32:00.945908+0000","last_fullsized":"2024-02-16T10:32:00.945908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:07.411102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924423+0000","last_change":"2024-02-16T10:30:34.118806+0000","last_active":"2024-02-16T10:31:06.924423+0000","last_peered":"2024-02-16T10:31:06.924423+0000","last_clean":"2024-02-16T10:31:06.924423+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:31:06.924423+0000","last_undegraded":"2024-02-16T10:31:06.924423+0000","last_fullsized":"2024-02-16T10:31:06.924423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917565+0000","last_change":"2024-02-16T10:30:36.134096+0000","last_active":"2024-02-16T10:31:06.917565+0000","last_peered":"2024-02-16T10:31:06.917565+0000","last_clean":"2024-02-16T10:31:06.917565+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:31:06.917565+0000","last_undegraded":"2024-02-16T10:31:06.917565+0000","last_fullsized":"2024-02-16T10:31:06.917565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:20.709724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915771+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:31:06.915771+0000","last_peered":"2024-02-16T10:31:06.915771+0000","last_clean":"2024-02-16T10:31:06.915771+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:31:06.915771+0000","last_undegraded":"2024-02-16T10:31:06.915771+0000","last_fullsized":"2024-02-16T10:31:06.915771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:31.149744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003456+0000","last_change":"2024-02-16T10:30:28.065560+0000","last_active":"2024-02-16T10:32:01.003456+0000","last_peered":"2024-02-16T10:32:01.003456+0000","last_clean":"2024-02-16T10:32:01.003456+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:01.003456+0000","last_undegraded":"2024-02-16T10:32:01.003456+0000","last_fullsized":"2024-02-16T10:32:01.003456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924689+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:31:06.924689+0000","last_peered":"2024-02-16T10:31:06.924689+0000","last_clean":"2024-02-16T10:31:06.924689+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:31:06.924689+0000","last_undegraded":"2024-02-16T10:31:06.924689+0000","last_fullsized":"2024-02-16T10:31:06.924689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:04.250123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912078+0000","last_change":"2024-02-16T10:30:30.099282+0000","last_active":"2024-02-16T10:31:06.912078+0000","last_peered":"2024-02-16T10:31:06.912078+0000","last_clean":"2024-02-16T10:31:06.912078+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:31:06.912078+0000","last_undegraded":"2024-02-16T10:31:06.912078+0000","last_fullsized":"2024-02-16T10:31:06.912078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:05.396237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.318143+0000","last_change":"2024-02-16T10:30:32.117290+0000","last_active":"2024-02-16T10:31:55.318143+0000","last_peered":"2024-02-16T10:31:55.318143+0000","last_clean":"2024-02-16T10:31:55.318143+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:31:55.318143+0000","last_undegraded":"2024-02-16T10:31:55.318143+0000","last_fullsized":"2024-02-16T10:31:55.318143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:10.257963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914793+0000","last_change":"2024-02-16T10:30:34.138222+0000","last_active":"2024-02-16T10:31:06.914793+0000","last_peered":"2024-02-16T10:31:06.914793+0000","last_clean":"2024-02-16T10:31:06.914793+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:31:06.914793+0000","last_undegraded":"2024-02-16T10:31:06.914793+0000","last_fullsized":"2024-02-16T10:31:06.914793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927061+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:31:06.927061+0000","last_peered":"2024-02-16T10:31:06.927061+0000","last_clean":"2024-02-16T10:31:06.927061+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:31:06.927061+0000","last_undegraded":"2024-02-16T10:31:06.927061+0000","last_fullsized":"2024-02-16T10:31:06.927061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:29.115943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686067+0000","last_change":"2024-02-16T10:30:28.065164+0000","last_active":"2024-02-16T10:31:12.686067+0000","last_peered":"2024-02-16T10:31:12.686067+0000","last_clean":"2024-02-16T10:31:12.686067+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:31:12.686067+0000","last_undegraded":"2024-02-16T10:31:12.686067+0000","last_fullsized":"2024-02-16T10:31:12.686067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915272+0000","last_change":"2024-02-16T10:30:26.089582+0000","last_active":"2024-02-16T10:31:06.915272+0000","last_peered":"2024-02-16T10:31:06.915272+0000","last_clean":"2024-02-16T10:31:06.915272+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:31:06.915272+0000","last_undegraded":"2024-02-16T10:31:06.915272+0000","last_fullsized":"2024-02-16T10:31:06.915272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918652+0000","last_change":"2024-02-16T10:30:30.101510+0000","last_active":"2024-02-16T10:31:06.918652+0000","last_peered":"2024-02-16T10:31:06.918652+0000","last_clean":"2024-02-16T10:31:06.918652+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:31:06.918652+0000","last_undegraded":"2024-02-16T10:31:06.918652+0000","last_fullsized":"2024-02-16T10:31:06.918652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:18.360523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:47.841019+0000","last_change":"2024-02-16T10:30:32.096419+0000","last_active":"2024-02-16T10:31:47.841019+0000","last_peered":"2024-02-16T10:31:47.841019+0000","last_clean":"2024-02-16T10:31:47.841019+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:31:47.841019+0000","last_undegraded":"2024-02-16T10:31:47.841019+0000","last_fullsized":"2024-02-16T10:31:47.841019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:42.963873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908228+0000","last_change":"2024-02-16T10:30:34.143222+0000","last_active":"2024-02-16T10:31:06.908228+0000","last_peered":"2024-02-16T10:31:06.908228+0000","last_clean":"2024-02-16T10:31:06.908228+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:31:06.908228+0000","last_undegraded":"2024-02-16T10:31:06.908228+0000","last_fullsized":"2024-02-16T10:31:06.908228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:15.922444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926743+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926743+0000","last_peered":"2024-02-16T10:31:06.926743+0000","last_clean":"2024-02-16T10:31:06.926743+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926743+0000","last_undegraded":"2024-02-16T10:31:06.926743+0000","last_fullsized":"2024-02-16T10:31:06.926743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:59.110103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.998018+0000","last_change":"2024-02-16T10:30:28.063758+0000","last_active":"2024-02-16T10:31:11.998018+0000","last_peered":"2024-02-16T10:31:11.998018+0000","last_clean":"2024-02-16T10:31:11.998018+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:31:11.998018+0000","last_undegraded":"2024-02-16T10:31:11.998018+0000","last_fullsized":"2024-02-16T10:31:11.998018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922326+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:31:06.922326+0000","last_peered":"2024-02-16T10:31:06.922326+0000","last_clean":"2024-02-16T10:31:06.922326+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:31:06.922326+0000","last_undegraded":"2024-02-16T10:31:06.922326+0000","last_fullsized":"2024-02-16T10:31:06.922326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908145+0000","last_change":"2024-02-16T10:30:30.080008+0000","last_active":"2024-02-16T10:31:06.908145+0000","last_peered":"2024-02-16T10:31:06.908145+0000","last_clean":"2024-02-16T10:31:06.908145+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:31:06.908145+0000","last_undegraded":"2024-02-16T10:31:06.908145+0000","last_fullsized":"2024-02-16T10:31:06.908145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:54.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.738535+0000","last_change":"2024-02-16T10:30:32.092783+0000","last_active":"2024-02-16T10:32:00.738535+0000","last_peered":"2024-02-16T10:32:00.738535+0000","last_clean":"2024-02-16T10:32:00.738535+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:00.738535+0000","last_undegraded":"2024-02-16T10:32:00.738535+0000","last_fullsized":"2024-02-16T10:32:00.738535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:45.366198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911478+0000","last_change":"2024-02-16T10:30:34.111884+0000","last_active":"2024-02-16T10:31:06.911478+0000","last_peered":"2024-02-16T10:31:06.911478+0000","last_clean":"2024-02-16T10:31:06.911478+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:31:06.911478+0000","last_undegraded":"2024-02-16T10:31:06.911478+0000","last_fullsized":"2024-02-16T10:31:06.911478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922646+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922646+0000","last_peered":"2024-02-16T10:31:06.922646+0000","last_clean":"2024-02-16T10:31:06.922646+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922646+0000","last_undegraded":"2024-02-16T10:31:06.922646+0000","last_fullsized":"2024-02-16T10:31:06.922646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:05.173479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003196+0000","last_change":"2024-02-16T10:30:28.083725+0000","last_active":"2024-02-16T10:32:01.003196+0000","last_peered":"2024-02-16T10:32:01.003196+0000","last_clean":"2024-02-16T10:32:01.003196+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:01.003196+0000","last_undegraded":"2024-02-16T10:32:01.003196+0000","last_fullsized":"2024-02-16T10:32:01.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:08:02.265809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928210+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:31:06.928210+0000","last_peered":"2024-02-16T10:31:06.928210+0000","last_clean":"2024-02-16T10:31:06.928210+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:31:06.928210+0000","last_undegraded":"2024-02-16T10:31:06.928210+0000","last_fullsized":"2024-02-16T10:31:06.928210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915480+0000","last_change":"2024-02-16T10:30:30.096518+0000","last_active":"2024-02-16T10:31:06.915480+0000","last_peered":"2024-02-16T10:31:06.915480+0000","last_clean":"2024-02-16T10:31:06.915480+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:31:06.915480+0000","last_undegraded":"2024-02-16T10:31:06.915480+0000","last_fullsized":"2024-02-16T10:31:06.915480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:33.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.296534+0000","last_change":"2024-02-16T10:30:32.090307+0000","last_active":"2024-02-16T10:31:55.296534+0000","last_peered":"2024-02-16T10:31:55.296534+0000","last_clean":"2024-02-16T10:31:55.296534+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:31:55.296534+0000","last_undegraded":"2024-02-16T10:31:55.296534+0000","last_fullsized":"2024-02-16T10:31:55.296534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:14.119162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911888+0000","last_change":"2024-02-16T10:30:34.119744+0000","last_active":"2024-02-16T10:31:06.911888+0000","last_peered":"2024-02-16T10:31:06.911888+0000","last_clean":"2024-02-16T10:31:06.911888+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:31:06.911888+0000","last_undegraded":"2024-02-16T10:31:06.911888+0000","last_fullsized":"2024-02-16T10:31:06.911888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:56.895959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498313+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:31:54.498313+0000","last_peered":"2024-02-16T10:31:54.498313+0000","last_clean":"2024-02-16T10:31:54.498313+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:31:54.498313+0000","last_undegraded":"2024-02-16T10:31:54.498313+0000","last_fullsized":"2024-02-16T10:31:54.498313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:27.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912785+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:31:06.912785+0000","last_peered":"2024-02-16T10:31:06.912785+0000","last_clean":"2024-02-16T10:31:06.912785+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:31:06.912785+0000","last_undegraded":"2024-02-16T10:31:06.912785+0000","last_fullsized":"2024-02-16T10:31:06.912785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:54.625844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936294+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:06.936294+0000","last_peered":"2024-02-16T10:31:06.936294+0000","last_clean":"2024-02-16T10:31:06.936294+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:06.936294+0000","last_undegraded":"2024-02-16T10:31:06.936294+0000","last_fullsized":"2024-02-16T10:31:06.936294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:44.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.941425+0000","last_change":"2024-02-16T10:30:32.092432+0000","last_active":"2024-02-16T10:32:00.941425+0000","last_peered":"2024-02-16T10:32:00.941425+0000","last_clean":"2024-02-16T10:32:00.941425+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:00.941425+0000","last_undegraded":"2024-02-16T10:32:00.941425+0000","last_fullsized":"2024-02-16T10:32:00.941425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:34.487177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913394+0000","last_change":"2024-02-16T10:30:34.119818+0000","last_active":"2024-02-16T10:31:06.913394+0000","last_peered":"2024-02-16T10:31:06.913394+0000","last_clean":"2024-02-16T10:31:06.913394+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:31:06.913394+0000","last_undegraded":"2024-02-16T10:31:06.913394+0000","last_fullsized":"2024-02-16T10:31:06.913394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:36.501122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.987273+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:00.987273+0000","last_peered":"2024-02-16T10:32:00.987273+0000","last_clean":"2024-02-16T10:32:00.987273+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:00.987273+0000","last_undegraded":"2024-02-16T10:32:00.987273+0000","last_fullsized":"2024-02-16T10:32:00.987273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930607+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:31:06.930607+0000","last_peered":"2024-02-16T10:31:06.930607+0000","last_clean":"2024-02-16T10:31:06.930607+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:31:06.930607+0000","last_undegraded":"2024-02-16T10:31:06.930607+0000","last_fullsized":"2024-02-16T10:31:06.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911567+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:31:06.911567+0000","last_peered":"2024-02-16T10:31:06.911567+0000","last_clean":"2024-02-16T10:31:06.911567+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:31:06.911567+0000","last_undegraded":"2024-02-16T10:31:06.911567+0000","last_fullsized":"2024-02-16T10:31:06.911567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:36.991486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917057+0000","last_change":"2024-02-16T10:30:30.075709+0000","last_active":"2024-02-16T10:31:06.917057+0000","last_peered":"2024-02-16T10:31:06.917057+0000","last_clean":"2024-02-16T10:31:06.917057+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:31:06.917057+0000","last_undegraded":"2024-02-16T10:31:06.917057+0000","last_fullsized":"2024-02-16T10:31:06.917057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:26.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.297577+0000","last_change":"2024-02-16T10:30:32.122498+0000","last_active":"2024-02-16T10:31:55.297577+0000","last_peered":"2024-02-16T10:31:55.297577+0000","last_clean":"2024-02-16T10:31:55.297577+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:31:55.297577+0000","last_undegraded":"2024-02-16T10:31:55.297577+0000","last_fullsized":"2024-02-16T10:31:55.297577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:17.677726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925017+0000","last_change":"2024-02-16T10:30:34.125516+0000","last_active":"2024-02-16T10:31:06.925017+0000","last_peered":"2024-02-16T10:31:06.925017+0000","last_clean":"2024-02-16T10:31:06.925017+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:31:06.925017+0000","last_undegraded":"2024-02-16T10:31:06.925017+0000","last_fullsized":"2024-02-16T10:31:06.925017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914711+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914711+0000","last_peered":"2024-02-16T10:31:06.914711+0000","last_clean":"2024-02-16T10:31:06.914711+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914711+0000","last_undegraded":"2024-02-16T10:31:06.914711+0000","last_fullsized":"2024-02-16T10:31:06.914711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:24.665857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354694+0000","last_change":"2024-02-16T10:30:28.087170+0000","last_active":"2024-02-16T10:31:55.354694+0000","last_peered":"2024-02-16T10:31:55.354694+0000","last_clean":"2024-02-16T10:31:55.354694+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:31:55.354694+0000","last_undegraded":"2024-02-16T10:31:55.354694+0000","last_fullsized":"2024-02-16T10:31:55.354694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:43.039912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912283+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912283+0000","last_peered":"2024-02-16T10:31:06.912283+0000","last_clean":"2024-02-16T10:31:06.912283+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912283+0000","last_undegraded":"2024-02-16T10:31:06.912283+0000","last_fullsized":"2024-02-16T10:31:06.912283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915313+0000","last_change":"2024-02-16T10:30:30.076018+0000","last_active":"2024-02-16T10:31:06.915313+0000","last_peered":"2024-02-16T10:31:06.915313+0000","last_clean":"2024-02-16T10:31:06.915313+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:31:06.915313+0000","last_undegraded":"2024-02-16T10:31:06.915313+0000","last_fullsized":"2024-02-16T10:31:06.915313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:08.463191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.324566+0000","last_change":"2024-02-16T10:30:32.119391+0000","last_active":"2024-02-16T10:31:55.324566+0000","last_peered":"2024-02-16T10:31:55.324566+0000","last_clean":"2024-02-16T10:31:55.324566+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:31:55.324566+0000","last_undegraded":"2024-02-16T10:31:55.324566+0000","last_fullsized":"2024-02-16T10:31:55.324566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:54.882014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927434+0000","last_change":"2024-02-16T10:30:34.124775+0000","last_active":"2024-02-16T10:31:06.927434+0000","last_peered":"2024-02-16T10:31:06.927434+0000","last_clean":"2024-02-16T10:31:06.927434+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:31:06.927434+0000","last_undegraded":"2024-02-16T10:31:06.927434+0000","last_fullsized":"2024-02-16T10:31:06.927434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:35.295960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917230+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917230+0000","last_peered":"2024-02-16T10:31:06.917230+0000","last_clean":"2024-02-16T10:31:06.917230+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917230+0000","last_undegraded":"2024-02-16T10:31:06.917230+0000","last_fullsized":"2024-02-16T10:31:06.917230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.882409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930153+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930153+0000","last_peered":"2024-02-16T10:31:06.930153+0000","last_clean":"2024-02-16T10:31:06.930153+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930153+0000","last_undegraded":"2024-02-16T10:31:06.930153+0000","last_fullsized":"2024-02-16T10:31:06.930153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.163010+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.163010+0000","last_peered":"2024-02-16T10:31:11.163010+0000","last_clean":"2024-02-16T10:31:11.163010+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.163010+0000","last_undegraded":"2024-02-16T10:31:11.163010+0000","last_fullsized":"2024-02-16T10:31:11.163010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:31.255409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925657+0000","last_change":"2024-02-16T10:30:30.091253+0000","last_active":"2024-02-16T10:31:06.925657+0000","last_peered":"2024-02-16T10:31:06.925657+0000","last_clean":"2024-02-16T10:31:06.925657+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:31:06.925657+0000","last_undegraded":"2024-02-16T10:31:06.925657+0000","last_fullsized":"2024-02-16T10:31:06.925657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:43.522418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930647+0000","last_change":"2024-02-16T10:30:32.123357+0000","last_active":"2024-02-16T10:31:06.930647+0000","last_peered":"2024-02-16T10:31:06.930647+0000","last_clean":"2024-02-16T10:31:06.930647+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:31:06.930647+0000","last_undegraded":"2024-02-16T10:31:06.930647+0000","last_fullsized":"2024-02-16T10:31:06.930647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:56:50.568670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.251519+0000","last_change":"2024-02-16T10:30:34.143270+0000","last_active":"2024-02-16T10:32:01.251519+0000","last_peered":"2024-02-16T10:32:01.251519+0000","last_clean":"2024-02-16T10:32:01.251519+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:01.251519+0000","last_undegraded":"2024-02-16T10:32:01.251519+0000","last_fullsized":"2024-02-16T10:32:01.251519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:51.931876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913269+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913269+0000","last_peered":"2024-02-16T10:31:06.913269+0000","last_clean":"2024-02-16T10:31:06.913269+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913269+0000","last_undegraded":"2024-02-16T10:31:06.913269+0000","last_fullsized":"2024-02-16T10:31:06.913269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:47:45.661564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913938+0000","last_change":"2024-02-16T10:30:28.068653+0000","last_active":"2024-02-16T10:31:06.913938+0000","last_peered":"2024-02-16T10:31:06.913938+0000","last_clean":"2024-02-16T10:31:06.913938+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:31:06.913938+0000","last_undegraded":"2024-02-16T10:31:06.913938+0000","last_fullsized":"2024-02-16T10:31:06.913938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:19.170808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.971149+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.971149+0000","last_peered":"2024-02-16T10:31:11.971149+0000","last_clean":"2024-02-16T10:31:11.971149+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.971149+0000","last_undegraded":"2024-02-16T10:31:11.971149+0000","last_fullsized":"2024-02-16T10:31:11.971149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912004+0000","last_change":"2024-02-16T10:30:30.097916+0000","last_active":"2024-02-16T10:31:06.912004+0000","last_peered":"2024-02-16T10:31:06.912004+0000","last_clean":"2024-02-16T10:31:06.912004+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:31:06.912004+0000","last_undegraded":"2024-02-16T10:31:06.912004+0000","last_fullsized":"2024-02-16T10:31:06.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:31.161114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.284137+0000","last_change":"2024-02-16T10:30:32.097289+0000","last_active":"2024-02-16T10:31:55.284137+0000","last_peered":"2024-02-16T10:31:55.284137+0000","last_clean":"2024-02-16T10:31:55.284137+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:31:55.284137+0000","last_undegraded":"2024-02-16T10:31:55.284137+0000","last_fullsized":"2024-02-16T10:31:55.284137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:01.486352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923897+0000","last_change":"2024-02-16T10:30:34.135806+0000","last_active":"2024-02-16T10:31:06.923897+0000","last_peered":"2024-02-16T10:31:06.923897+0000","last_clean":"2024-02-16T10:31:06.923897+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:31:06.923897+0000","last_undegraded":"2024-02-16T10:31:06.923897+0000","last_fullsized":"2024-02-16T10:31:06.923897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.688719+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.688719+0000","last_peered":"2024-02-16T10:31:12.688719+0000","last_clean":"2024-02-16T10:31:12.688719+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.688719+0000","last_undegraded":"2024-02-16T10:31:12.688719+0000","last_fullsized":"2024-02-16T10:31:12.688719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'13","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003577+0000","last_change":"2024-02-16T10:30:28.068349+0000","last_active":"2024-02-16T10:32:01.003577+0000","last_peered":"2024-02-16T10:32:01.003577+0000","last_clean":"2024-02-16T10:32:01.003577+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:01.003577+0000","last_undegraded":"2024-02-16T10:32:01.003577+0000","last_fullsized":"2024-02-16T10:32:01.003577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926497+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926497+0000","last_peered":"2024-02-16T10:31:06.926497+0000","last_clean":"2024-02-16T10:31:06.926497+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926497+0000","last_undegraded":"2024-02-16T10:31:06.926497+0000","last_fullsized":"2024-02-16T10:31:06.926497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:35.881032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914335+0000","last_change":"2024-02-16T10:30:30.074767+0000","last_active":"2024-02-16T10:31:06.914335+0000","last_peered":"2024-02-16T10:31:06.914335+0000","last_clean":"2024-02-16T10:31:06.914335+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:31:06.914335+0000","last_undegraded":"2024-02-16T10:31:06.914335+0000","last_fullsized":"2024-02-16T10:31:06.914335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:17.473427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.286151+0000","last_change":"2024-02-16T10:30:32.089195+0000","last_active":"2024-02-16T10:31:55.286151+0000","last_peered":"2024-02-16T10:31:55.286151+0000","last_clean":"2024-02-16T10:31:55.286151+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:31:55.286151+0000","last_undegraded":"2024-02-16T10:31:55.286151+0000","last_fullsized":"2024-02-16T10:31:55.286151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:43.979549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914695+0000","last_change":"2024-02-16T10:30:34.138612+0000","last_active":"2024-02-16T10:31:06.914695+0000","last_peered":"2024-02-16T10:31:06.914695+0000","last_clean":"2024-02-16T10:31:06.914695+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:31:06.914695+0000","last_undegraded":"2024-02-16T10:31:06.914695+0000","last_fullsized":"2024-02-16T10:31:06.914695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:16.947910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931060+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931060+0000","last_peered":"2024-02-16T10:31:06.931060+0000","last_clean":"2024-02-16T10:31:06.931060+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931060+0000","last_undegraded":"2024-02-16T10:31:06.931060+0000","last_fullsized":"2024-02-16T10:31:06.931060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:04.374041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498061+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.498061+0000","last_peered":"2024-02-16T10:31:54.498061+0000","last_clean":"2024-02-16T10:31:54.498061+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.498061+0000","last_undegraded":"2024-02-16T10:31:54.498061+0000","last_fullsized":"2024-02-16T10:31:54.498061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.347024+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:31:55.347024+0000","last_peered":"2024-02-16T10:31:55.347024+0000","last_clean":"2024-02-16T10:31:55.347024+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:31:55.347024+0000","last_undegraded":"2024-02-16T10:31:55.347024+0000","last_fullsized":"2024-02-16T10:31:55.347024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:13.928686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.910958+0000","last_change":"2024-02-16T10:30:30.098954+0000","last_active":"2024-02-16T10:31:06.910958+0000","last_peered":"2024-02-16T10:31:06.910958+0000","last_clean":"2024-02-16T10:31:06.910958+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:31:06.910958+0000","last_undegraded":"2024-02-16T10:31:06.910958+0000","last_fullsized":"2024-02-16T10:31:06.910958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.320914+0000","last_change":"2024-02-16T10:30:32.120059+0000","last_active":"2024-02-16T10:31:55.320914+0000","last_peered":"2024-02-16T10:31:55.320914+0000","last_clean":"2024-02-16T10:31:55.320914+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:31:55.320914+0000","last_undegraded":"2024-02-16T10:31:55.320914+0000","last_fullsized":"2024-02-16T10:31:55.320914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:54.720052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915718+0000","last_change":"2024-02-16T10:30:34.139182+0000","last_active":"2024-02-16T10:31:06.915718+0000","last_peered":"2024-02-16T10:31:06.915718+0000","last_clean":"2024-02-16T10:31:06.915718+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:31:06.915718+0000","last_undegraded":"2024-02-16T10:31:06.915718+0000","last_fullsized":"2024-02-16T10:31:06.915718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:33.233363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.660952+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.660952+0000","last_peered":"2024-02-16T10:31:11.660952+0000","last_clean":"2024-02-16T10:31:11.660952+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.660952+0000","last_undegraded":"2024-02-16T10:31:11.660952+0000","last_fullsized":"2024-02-16T10:31:11.660952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:08.234713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.002993+0000","last_change":"2024-02-16T10:30:28.068221+0000","last_active":"2024-02-16T10:32:01.002993+0000","last_peered":"2024-02-16T10:32:01.002993+0000","last_clean":"2024-02-16T10:32:01.002993+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:01.002993+0000","last_undegraded":"2024-02-16T10:32:01.002993+0000","last_fullsized":"2024-02-16T10:32:01.002993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:33.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928894+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:31:06.928894+0000","last_peered":"2024-02-16T10:31:06.928894+0000","last_clean":"2024-02-16T10:31:06.928894+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:31:06.928894+0000","last_undegraded":"2024-02-16T10:31:06.928894+0000","last_fullsized":"2024-02-16T10:31:06.928894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'7","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193889+0000","last_change":"2024-02-16T10:30:30.090010+0000","last_active":"2024-02-16T10:32:02.193889+0000","last_peered":"2024-02-16T10:32:02.193889+0000","last_clean":"2024-02-16T10:32:02.193889+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:02.193889+0000","last_undegraded":"2024-02-16T10:32:02.193889+0000","last_fullsized":"2024-02-16T10:32:02.193889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:04.245545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.974431+0000","last_change":"2024-02-16T10:30:32.120625+0000","last_active":"2024-02-16T10:32:00.974431+0000","last_peered":"2024-02-16T10:32:00.974431+0000","last_clean":"2024-02-16T10:32:00.974431+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:00.974431+0000","last_undegraded":"2024-02-16T10:32:00.974431+0000","last_fullsized":"2024-02-16T10:32:00.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:00:10.689555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926215+0000","last_change":"2024-02-16T10:30:34.104811+0000","last_active":"2024-02-16T10:31:06.926215+0000","last_peered":"2024-02-16T10:31:06.926215+0000","last_clean":"2024-02-16T10:31:06.926215+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:31:06.926215+0000","last_undegraded":"2024-02-16T10:31:06.926215+0000","last_fullsized":"2024-02-16T10:31:06.926215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:05.490555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923461+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923461+0000","last_peered":"2024-02-16T10:31:06.923461+0000","last_clean":"2024-02-16T10:31:06.923461+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923461+0000","last_undegraded":"2024-02-16T10:31:06.923461+0000","last_fullsized":"2024-02-16T10:31:06.923461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:05.711450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930585+0000","last_change":"2024-02-16T10:30:28.085439+0000","last_active":"2024-02-16T10:31:06.930585+0000","last_peered":"2024-02-16T10:31:06.930585+0000","last_clean":"2024-02-16T10:31:06.930585+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:31:06.930585+0000","last_undegraded":"2024-02-16T10:31:06.930585+0000","last_fullsized":"2024-02-16T10:31:06.930585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:24.178735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906798+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:31:06.906798+0000","last_peered":"2024-02-16T10:31:06.906798+0000","last_clean":"2024-02-16T10:31:06.906798+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:31:06.906798+0000","last_undegraded":"2024-02-16T10:31:06.906798+0000","last_fullsized":"2024-02-16T10:31:06.906798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354785+0000","last_change":"2024-02-16T10:30:28.066897+0000","last_active":"2024-02-16T10:31:55.354785+0000","last_peered":"2024-02-16T10:31:55.354785+0000","last_clean":"2024-02-16T10:31:55.354785+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:31:55.354785+0000","last_undegraded":"2024-02-16T10:31:55.354785+0000","last_fullsized":"2024-02-16T10:31:55.354785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924256+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:31:06.924256+0000","last_peered":"2024-02-16T10:31:06.924256+0000","last_clean":"2024-02-16T10:31:06.924256+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:31:06.924256+0000","last_undegraded":"2024-02-16T10:31:06.924256+0000","last_fullsized":"2024-02-16T10:31:06.924256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497934+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:31:54.497934+0000","last_peered":"2024-02-16T10:31:54.497934+0000","last_clean":"2024-02-16T10:31:54.497934+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:31:54.497934+0000","last_undegraded":"2024-02-16T10:31:54.497934+0000","last_fullsized":"2024-02-16T10:31:54.497934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:39.952356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918764+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:31:06.918764+0000","last_peered":"2024-02-16T10:31:06.918764+0000","last_clean":"2024-02-16T10:31:06.918764+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:31:06.918764+0000","last_undegraded":"2024-02-16T10:31:06.918764+0000","last_fullsized":"2024-02-16T10:31:06.918764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:44:00.902889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.367527+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:31:55.367527+0000","last_peered":"2024-02-16T10:31:55.367527+0000","last_clean":"2024-02-16T10:31:55.367527+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:31:55.367527+0000","last_undegraded":"2024-02-16T10:31:55.367527+0000","last_fullsized":"2024-02-16T10:31:55.367527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927369+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:31:06.927369+0000","last_peered":"2024-02-16T10:31:06.927369+0000","last_clean":"2024-02-16T10:31:06.927369+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:31:06.927369+0000","last_undegraded":"2024-02-16T10:31:06.927369+0000","last_fullsized":"2024-02-16T10:31:06.927369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003265+0000","last_change":"2024-02-16T10:30:28.070344+0000","last_active":"2024-02-16T10:32:01.003265+0000","last_peered":"2024-02-16T10:32:01.003265+0000","last_clean":"2024-02-16T10:32:01.003265+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:01.003265+0000","last_undegraded":"2024-02-16T10:32:01.003265+0000","last_fullsized":"2024-02-16T10:32:01.003265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929450+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:31:06.929450+0000","last_peered":"2024-02-16T10:31:06.929450+0000","last_clean":"2024-02-16T10:31:06.929450+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:31:06.929450+0000","last_undegraded":"2024-02-16T10:31:06.929450+0000","last_fullsized":"2024-02-16T10:31:06.929450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922892+0000","last_change":"2024-02-16T10:30:28.084698+0000","last_active":"2024-02-16T10:31:06.922892+0000","last_peered":"2024-02-16T10:31:06.922892+0000","last_clean":"2024-02-16T10:31:06.922892+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:31:06.922892+0000","last_undegraded":"2024-02-16T10:31:06.922892+0000","last_fullsized":"2024-02-16T10:31:06.922892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925916+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:31:06.925916+0000","last_peered":"2024-02-16T10:31:06.925916+0000","last_clean":"2024-02-16T10:31:06.925916+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:31:06.925916+0000","last_undegraded":"2024-02-16T10:31:06.925916+0000","last_fullsized":"2024-02-16T10:31:06.925916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197265+0000","last_change":"2024-02-16T10:30:28.088710+0000","last_active":"2024-02-16T10:31:11.197265+0000","last_peered":"2024-02-16T10:31:11.197265+0000","last_clean":"2024-02-16T10:31:11.197265+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:31:11.197265+0000","last_undegraded":"2024-02-16T10:31:11.197265+0000","last_fullsized":"2024-02-16T10:31:11.197265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922587+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:31:06.922587+0000","last_peered":"2024-02-16T10:31:06.922587+0000","last_clean":"2024-02-16T10:31:06.922587+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:31:06.922587+0000","last_undegraded":"2024-02-16T10:31:06.922587+0000","last_fullsized":"2024-02-16T10:31:06.922587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498941+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:31:54.498941+0000","last_peered":"2024-02-16T10:31:54.498941+0000","last_clean":"2024-02-16T10:31:54.498941+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:31:54.498941+0000","last_undegraded":"2024-02-16T10:31:54.498941+0000","last_fullsized":"2024-02-16T10:31:54.498941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930315+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:31:06.930315+0000","last_peered":"2024-02-16T10:31:06.930315+0000","last_clean":"2024-02-16T10:31:06.930315+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:31:06.930315+0000","last_undegraded":"2024-02-16T10:31:06.930315+0000","last_fullsized":"2024-02-16T10:31:06.930315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:36:57.326356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996262+0000","last_change":"2024-02-16T10:30:28.082754+0000","last_active":"2024-02-16T10:31:11.996262+0000","last_peered":"2024-02-16T10:31:11.996262+0000","last_clean":"2024-02-16T10:31:11.996262+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:31:11.996262+0000","last_undegraded":"2024-02-16T10:31:11.996262+0000","last_fullsized":"2024-02-16T10:31:11.996262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:05:11.823357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913459+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:31:06.913459+0000","last_peered":"2024-02-16T10:31:06.913459+0000","last_clean":"2024-02-16T10:31:06.913459+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:31:06.913459+0000","last_undegraded":"2024-02-16T10:31:06.913459+0000","last_fullsized":"2024-02-16T10:31:06.913459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:00:10.245816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003021+0000","last_change":"2024-02-16T10:30:28.069630+0000","last_active":"2024-02-16T10:32:01.003021+0000","last_peered":"2024-02-16T10:32:01.003021+0000","last_clean":"2024-02-16T10:32:01.003021+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:01.003021+0000","last_undegraded":"2024-02-16T10:32:01.003021+0000","last_fullsized":"2024-02-16T10:32:01.003021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:21:11.835947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924942+0000","last_change":"2024-02-16T10:30:26.099907+0000","last_active":"2024-02-16T10:31:06.924942+0000","last_peered":"2024-02-16T10:31:06.924942+0000","last_clean":"2024-02-16T10:31:06.924942+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:31:06.924942+0000","last_undegraded":"2024-02-16T10:31:06.924942+0000","last_fullsized":"2024-02-16T10:31:06.924942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.687640+0000","last_change":"2024-02-16T10:30:28.065907+0000","last_active":"2024-02-16T10:31:12.687640+0000","last_peered":"2024-02-16T10:31:12.687640+0000","last_clean":"2024-02-16T10:31:12.687640+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:31:12.687640+0000","last_undegraded":"2024-02-16T10:31:12.687640+0000","last_fullsized":"2024-02-16T10:31:12.687640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922132+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:31:06.922132+0000","last_peered":"2024-02-16T10:31:06.922132+0000","last_clean":"2024-02-16T10:31:06.922132+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:31:06.922132+0000","last_undegraded":"2024-02-16T10:31:06.922132+0000","last_fullsized":"2024-02-16T10:31:06.922132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927080+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:31:06.927080+0000","last_peered":"2024-02-16T10:31:06.927080+0000","last_clean":"2024-02-16T10:31:06.927080+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:31:06.927080+0000","last_undegraded":"2024-02-16T10:31:06.927080+0000","last_fullsized":"2024-02-16T10:31:06.927080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:15.461099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919178+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:31:06.919178+0000","last_peered":"2024-02-16T10:31:06.919178+0000","last_clean":"2024-02-16T10:31:06.919178+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:31:06.919178+0000","last_undegraded":"2024-02-16T10:31:06.919178+0000","last_fullsized":"2024-02-16T10:31:06.919178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686094+0000","last_change":"2024-02-16T10:30:28.065620+0000","last_active":"2024-02-16T10:31:12.686094+0000","last_peered":"2024-02-16T10:31:12.686094+0000","last_clean":"2024-02-16T10:31:12.686094+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:31:12.686094+0000","last_undegraded":"2024-02-16T10:31:12.686094+0000","last_fullsized":"2024-02-16T10:31:12.686094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925237+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:31:06.925237+0000","last_peered":"2024-02-16T10:31:06.925237+0000","last_clean":"2024-02-16T10:31:06.925237+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:31:06.925237+0000","last_undegraded":"2024-02-16T10:31:06.925237+0000","last_fullsized":"2024-02-16T10:31:06.925237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:28:35.916782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197558+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:31:11.197558+0000","last_peered":"2024-02-16T10:31:11.197558+0000","last_clean":"2024-02-16T10:31:11.197558+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:31:11.197558+0000","last_undegraded":"2024-02-16T10:31:11.197558+0000","last_fullsized":"2024-02-16T10:31:11.197558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930984+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:31:06.930984+0000","last_peered":"2024-02-16T10:31:06.930984+0000","last_clean":"2024-02-16T10:31:06.930984+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:31:06.930984+0000","last_undegraded":"2024-02-16T10:31:06.930984+0000","last_fullsized":"2024-02-16T10:31:06.930984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:45.770711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003087+0000","last_change":"2024-02-16T10:30:28.087215+0000","last_active":"2024-02-16T10:32:01.003087+0000","last_peered":"2024-02-16T10:32:01.003087+0000","last_clean":"2024-02-16T10:32:01.003087+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:01.003087+0000","last_undegraded":"2024-02-16T10:32:01.003087+0000","last_fullsized":"2024-02-16T10:32:01.003087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:06.402688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923234+0000","last_change":"2024-02-16T10:30:26.083864+0000","last_active":"2024-02-16T10:31:06.923234+0000","last_peered":"2024-02-16T10:31:06.923234+0000","last_clean":"2024-02-16T10:31:06.923234+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:31:06.923234+0000","last_undegraded":"2024-02-16T10:31:06.923234+0000","last_fullsized":"2024-02-16T10:31:06.923234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917305+0000","last_change":"2024-02-16T10:30:28.072935+0000","last_active":"2024-02-16T10:31:06.917305+0000","last_peered":"2024-02-16T10:31:06.917305+0000","last_clean":"2024-02-16T10:31:06.917305+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:31:06.917305+0000","last_undegraded":"2024-02-16T10:31:06.917305+0000","last_fullsized":"2024-02-16T10:31:06.917305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934783+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:31:06.934783+0000","last_peered":"2024-02-16T10:31:06.934783+0000","last_clean":"2024-02-16T10:31:06.934783+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:31:06.934783+0000","last_undegraded":"2024-02-16T10:31:06.934783+0000","last_fullsized":"2024-02-16T10:31:06.934783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:02.701519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.982355+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:31:11.982355+0000","last_peered":"2024-02-16T10:31:11.982355+0000","last_clean":"2024-02-16T10:31:11.982355+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:31:11.982355+0000","last_undegraded":"2024-02-16T10:31:11.982355+0000","last_fullsized":"2024-02-16T10:31:11.982355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:33.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932493+0000","last_change":"2024-02-16T10:30:28.088605+0000","last_active":"2024-02-16T10:31:06.932493+0000","last_peered":"2024-02-16T10:31:06.932493+0000","last_clean":"2024-02-16T10:31:06.932493+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:31:06.932493+0000","last_undegraded":"2024-02-16T10:31:06.932493+0000","last_fullsized":"2024-02-16T10:31:06.932493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925231+0000","last_change":"2024-02-16T10:30:26.100409+0000","last_active":"2024-02-16T10:31:06.925231+0000","last_peered":"2024-02-16T10:31:06.925231+0000","last_clean":"2024-02-16T10:31:06.925231+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:31:06.925231+0000","last_undegraded":"2024-02-16T10:31:06.925231+0000","last_fullsized":"2024-02-16T10:31:06.925231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498959+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.498959+0000","last_peered":"2024-02-16T10:31:54.498959+0000","last_clean":"2024-02-16T10:31:54.498959+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.498959+0000","last_undegraded":"2024-02-16T10:31:54.498959+0000","last_fullsized":"2024-02-16T10:31:54.498959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:02.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705690,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69299999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":8.2560000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":24.481999999999999,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.503},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":18.614999999999998,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.72899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:10.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-16T10:32:10.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:10.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94d0145640 1 Processor -- start 2024-02-16T10:32:10.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94d0145640 1 -- start start 2024-02-16T10:32:10.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94d0145640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94c806f8b0 0x7f94c812c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94d0145640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c8072450 con 0x7f94c812c750 2024-02-16T10:32:10.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94d0145640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c812cb60 con 0x7f94c806f8b0 2024-02-16T10:32:10.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94cdee1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94c806f8b0 0x7f94c812c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94cdee1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94c806f8b0 0x7f94c812c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50446/0 (socket says 172.21.15.107:50446) 2024-02-16T10:32:10.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.155+0000 7f94cdee1640 1 -- 172.21.15.107:0/747493627 learned_addr learned my addr 172.21.15.107:0/747493627 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:10.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94cdee1640 1 -- 172.21.15.107:0/747493627 >> v1:172.21.15.107:6789/0 conn(0x7f94c812c750 legacy=0x7f94c8128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94cdee1640 1 -- 172.21.15.107:0/747493627 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c812bed0 con 0x7f94c806f8b0 2024-02-16T10:32:10.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94cdee1640 1 --2- 172.21.15.107:0/747493627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c812c210 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097f0 tx=0x7f94bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eb587acc509bec server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94ccedf640 1 -- 172.21.15.107:0/747493627 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94bc0ab530 con 0x7f94c806f8b0 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94ccedf640 1 -- 172.21.15.107:0/747493627 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc0a7050 con 0x7f94c806f8b0 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94ccedf640 1 -- 172.21.15.107:0/747493627 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94bc0ab7e0 con 0x7f94c806f8b0 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 -- 172.21.15.107:0/747493627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 msgr2=0x7f94c812c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 --2- 172.21.15.107:0/747493627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c812c210 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0097f0 tx=0x7f94bc01c430 comp rx=0 tx=0).stop 2024-02-16T10:32:10.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 -- 172.21.15.107:0/747493627 shutdown_connections 2024-02-16T10:32:10.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 --2- 172.21.15.107:0/747493627 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c812c210 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 -- 172.21.15.107:0/747493627 >> 172.21.15.107:0/747493627 conn(0x7f94c809a1c0 msgr2=0x7f94c809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:10.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 -- 172.21.15.107:0/747493627 shutdown_connections 2024-02-16T10:32:10.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.159+0000 7f94d0145640 1 -- 172.21.15.107:0/747493627 wait complete. 2024-02-16T10:32:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 Processor -- start 2024-02-16T10:32:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 -- start start 2024-02-16T10:32:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8114cd0 con 0x7f94c806f8b0 2024-02-16T10:32:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cdee1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cdee1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50454/0 (socket says 172.21.15.107:50454) 2024-02-16T10:32:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cdee1640 1 -- 172.21.15.107:0/1194882341 learned_addr learned my addr 172.21.15.107:0/1194882341 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cdee1640 1 -- 172.21.15.107:0/1194882341 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0094d0 con 0x7f94c806f8b0 2024-02-16T10:32:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cdee1640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f94bc019040 tx=0x7f94bc0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94bc0b4440 con 0x7f94c806f8b0 2024-02-16T10:32:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c81134c0 con 0x7f94c806f8b0 2024-02-16T10:32:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c8122c10 con 0x7f94c806f8b0 2024-02-16T10:32:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94bc0b4710 con 0x7f94c806f8b0 2024-02-16T10:32:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8115f20 con 0x7f94c806f8b0 2024-02-16T10:32:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f94bc0b2070 con 0x7f94c806f8b0 2024-02-16T10:32:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c8062980 con 0x7f94c806f8b0 2024-02-16T10:32:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 0x7f94b4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f94bc0e2710 con 0x7f94c806f8b0 2024-02-16T10:32:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.163+0000 7f94cd6e0640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 0x7f94b4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.167+0000 7f94cd6e0640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 0x7f94b4037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94b8007fd0 tx=0x7f94b8007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.167+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94bc0c4300 con 0x7f94c806f8b0 2024-02-16T10:32:10.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.327+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94c8073f80 con 0x7f94b4035a10 2024-02-16T10:32:10.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.371+0000 7f94c67fc640 1 -- 172.21.15.107:0/1194882341 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673521 (secure 0 0 0) 0x7f94c8073f80 con 0x7f94b4035a10 2024-02-16T10:32:10.383 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 msgr2=0x7f94b4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 0x7f94b4037ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f94b8007fd0 tx=0x7f94b8007dc0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 msgr2=0x7f94c8113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f94bc019040 tx=0x7f94bc0191d0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 shutdown_connections 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f94b4035a10 0x7f94b4037ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 --2- 172.21.15.107:0/1194882341 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94c806f8b0 0x7f94c8113bd0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 >> 172.21.15.107:0/1194882341 conn(0x7f94c809a1c0 msgr2=0x7f94c812a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:10.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 shutdown_connections 2024-02-16T10:32:10.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.379+0000 7f94d0145640 1 -- 172.21.15.107:0/1194882341 wait complete. 2024-02-16T10:32:10.406 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-02-16T10:32:09.861915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3804,"num_read_kb":3447,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-825,"num_objects":-16,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":183,"num_read_kb":178,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006737"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916908+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:31:06.916908+0000","last_peered":"2024-02-16T10:31:06.916908+0000","last_clean":"2024-02-16T10:31:06.916908+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:31:06.916908+0000","last_undegraded":"2024-02-16T10:31:06.916908+0000","last_fullsized":"2024-02-16T10:31:06.916908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354394+0000","last_change":"2024-02-16T10:30:28.072642+0000","last_active":"2024-02-16T10:31:55.354394+0000","last_peered":"2024-02-16T10:31:55.354394+0000","last_clean":"2024-02-16T10:31:55.354394+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:31:55.354394+0000","last_undegraded":"2024-02-16T10:31:55.354394+0000","last_fullsized":"2024-02-16T10:31:55.354394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929412+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:31:06.929412+0000","last_peered":"2024-02-16T10:31:06.929412+0000","last_clean":"2024-02-16T10:31:06.929412+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:31:06.929412+0000","last_undegraded":"2024-02-16T10:31:06.929412+0000","last_fullsized":"2024-02-16T10:31:06.929412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918157+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918157+0000","last_peered":"2024-02-16T10:31:06.918157+0000","last_clean":"2024-02-16T10:31:06.918157+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918157+0000","last_undegraded":"2024-02-16T10:31:06.918157+0000","last_fullsized":"2024-02-16T10:31:06.918157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:41.510090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976695+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:31:11.976695+0000","last_peered":"2024-02-16T10:31:11.976695+0000","last_clean":"2024-02-16T10:31:11.976695+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:31:11.976695+0000","last_undegraded":"2024-02-16T10:31:11.976695+0000","last_fullsized":"2024-02-16T10:31:11.976695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:13.252426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920793+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920793+0000","last_peered":"2024-02-16T10:31:06.920793+0000","last_clean":"2024-02-16T10:31:06.920793+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920793+0000","last_undegraded":"2024-02-16T10:31:06.920793+0000","last_fullsized":"2024-02-16T10:31:06.920793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:41.339005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914702+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:31:06.914702+0000","last_peered":"2024-02-16T10:31:06.914702+0000","last_clean":"2024-02-16T10:31:06.914702+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:31:06.914702+0000","last_undegraded":"2024-02-16T10:31:06.914702+0000","last_fullsized":"2024-02-16T10:31:06.914702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920918+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.920918+0000","last_peered":"2024-02-16T10:31:06.920918+0000","last_clean":"2024-02-16T10:31:06.920918+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.920918+0000","last_undegraded":"2024-02-16T10:31:06.920918+0000","last_fullsized":"2024-02-16T10:31:06.920918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:09.881305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.503530+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.503530+0000","last_peered":"2024-02-16T10:31:54.503530+0000","last_clean":"2024-02-16T10:31:54.503530+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.503530+0000","last_undegraded":"2024-02-16T10:31:54.503530+0000","last_fullsized":"2024-02-16T10:31:54.503530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:17.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003130+0000","last_change":"2024-02-16T10:30:28.081973+0000","last_active":"2024-02-16T10:32:01.003130+0000","last_peered":"2024-02-16T10:32:01.003130+0000","last_clean":"2024-02-16T10:32:01.003130+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:01.003130+0000","last_undegraded":"2024-02-16T10:32:01.003130+0000","last_fullsized":"2024-02-16T10:32:01.003130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908534+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908534+0000","last_peered":"2024-02-16T10:31:06.908534+0000","last_clean":"2024-02-16T10:31:06.908534+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908534+0000","last_undegraded":"2024-02-16T10:31:06.908534+0000","last_fullsized":"2024-02-16T10:31:06.908534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925777+0000","last_change":"2024-02-16T10:30:28.083981+0000","last_active":"2024-02-16T10:31:06.925777+0000","last_peered":"2024-02-16T10:31:06.925777+0000","last_clean":"2024-02-16T10:31:06.925777+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:31:06.925777+0000","last_undegraded":"2024-02-16T10:31:06.925777+0000","last_fullsized":"2024-02-16T10:31:06.925777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:38.936680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916403+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.916403+0000","last_peered":"2024-02-16T10:31:06.916403+0000","last_clean":"2024-02-16T10:31:06.916403+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.916403+0000","last_undegraded":"2024-02-16T10:31:06.916403+0000","last_fullsized":"2024-02-16T10:31:06.916403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:03.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354647+0000","last_change":"2024-02-16T10:30:28.078739+0000","last_active":"2024-02-16T10:31:55.354647+0000","last_peered":"2024-02-16T10:31:55.354647+0000","last_clean":"2024-02-16T10:31:55.354647+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:31:55.354647+0000","last_undegraded":"2024-02-16T10:31:55.354647+0000","last_fullsized":"2024-02-16T10:31:55.354647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925042+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925042+0000","last_peered":"2024-02-16T10:31:06.925042+0000","last_clean":"2024-02-16T10:31:06.925042+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925042+0000","last_undegraded":"2024-02-16T10:31:06.925042+0000","last_fullsized":"2024-02-16T10:31:06.925042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686117+0000","last_change":"2024-02-16T10:30:28.063141+0000","last_active":"2024-02-16T10:31:12.686117+0000","last_peered":"2024-02-16T10:31:12.686117+0000","last_clean":"2024-02-16T10:31:12.686117+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:31:12.686117+0000","last_undegraded":"2024-02-16T10:31:12.686117+0000","last_fullsized":"2024-02-16T10:31:12.686117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915013+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:31:06.915013+0000","last_peered":"2024-02-16T10:31:06.915013+0000","last_clean":"2024-02-16T10:31:06.915013+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:31:06.915013+0000","last_undegraded":"2024-02-16T10:31:06.915013+0000","last_fullsized":"2024-02-16T10:31:06.915013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:03.383909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929156+0000","last_change":"2024-02-16T10:30:26.098135+0000","last_active":"2024-02-16T10:31:06.929156+0000","last_peered":"2024-02-16T10:31:06.929156+0000","last_clean":"2024-02-16T10:31:06.929156+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:31:06.929156+0000","last_undegraded":"2024-02-16T10:31:06.929156+0000","last_fullsized":"2024-02-16T10:31:06.929156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915167+0000","last_change":"2024-02-16T10:30:28.080080+0000","last_active":"2024-02-16T10:31:06.915167+0000","last_peered":"2024-02-16T10:31:06.915167+0000","last_clean":"2024-02-16T10:31:06.915167+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:31:06.915167+0000","last_undegraded":"2024-02-16T10:31:06.915167+0000","last_fullsized":"2024-02-16T10:31:06.915167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.994634+0000","last_change":"2024-02-16T10:30:26.086548+0000","last_active":"2024-02-16T10:32:00.994634+0000","last_peered":"2024-02-16T10:32:00.994634+0000","last_clean":"2024-02-16T10:32:00.994634+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:00.994634+0000","last_undegraded":"2024-02-16T10:32:00.994634+0000","last_fullsized":"2024-02-16T10:32:00.994634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366482+0000","last_change":"2024-02-16T10:30:28.082308+0000","last_active":"2024-02-16T10:31:55.366482+0000","last_peered":"2024-02-16T10:31:55.366482+0000","last_clean":"2024-02-16T10:31:55.366482+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:31:55.366482+0000","last_undegraded":"2024-02-16T10:31:55.366482+0000","last_fullsized":"2024-02-16T10:31:55.366482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926645+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:31:06.926645+0000","last_peered":"2024-02-16T10:31:06.926645+0000","last_clean":"2024-02-16T10:31:06.926645+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:31:06.926645+0000","last_undegraded":"2024-02-16T10:31:06.926645+0000","last_fullsized":"2024-02-16T10:31:06.926645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927940+0000","last_change":"2024-02-16T10:30:28.066522+0000","last_active":"2024-02-16T10:31:06.927940+0000","last_peered":"2024-02-16T10:31:06.927940+0000","last_clean":"2024-02-16T10:31:06.927940+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:31:06.927940+0000","last_undegraded":"2024-02-16T10:31:06.927940+0000","last_fullsized":"2024-02-16T10:31:06.927940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925646+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:31:06.925646+0000","last_peered":"2024-02-16T10:31:06.925646+0000","last_clean":"2024-02-16T10:31:06.925646+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:31:06.925646+0000","last_undegraded":"2024-02-16T10:31:06.925646+0000","last_fullsized":"2024-02-16T10:31:06.925646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.655926+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.655926+0000","last_peered":"2024-02-16T10:31:11.655926+0000","last_clean":"2024-02-16T10:31:11.655926+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.655926+0000","last_undegraded":"2024-02-16T10:31:11.655926+0000","last_fullsized":"2024-02-16T10:31:11.655926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927666+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:31:06.927666+0000","last_peered":"2024-02-16T10:31:06.927666+0000","last_clean":"2024-02-16T10:31:06.927666+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:31:06.927666+0000","last_undegraded":"2024-02-16T10:31:06.927666+0000","last_fullsized":"2024-02-16T10:31:06.927666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657215+0000","last_change":"2024-02-16T10:30:28.084327+0000","last_active":"2024-02-16T10:31:11.657215+0000","last_peered":"2024-02-16T10:31:11.657215+0000","last_clean":"2024-02-16T10:31:11.657215+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:31:11.657215+0000","last_undegraded":"2024-02-16T10:31:11.657215+0000","last_fullsized":"2024-02-16T10:31:11.657215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:06.450863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919484+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:31:06.919484+0000","last_peered":"2024-02-16T10:31:06.919484+0000","last_clean":"2024-02-16T10:31:06.919484+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:31:06.919484+0000","last_undegraded":"2024-02-16T10:31:06.919484+0000","last_fullsized":"2024-02-16T10:31:06.919484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:40:58.824376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.985103+0000","last_change":"2024-02-16T10:30:36.142641+0000","last_active":"2024-02-16T10:32:00.985103+0000","last_peered":"2024-02-16T10:32:00.985103+0000","last_clean":"2024-02-16T10:32:00.985103+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:00.985103+0000","last_undegraded":"2024-02-16T10:32:00.985103+0000","last_fullsized":"2024-02-16T10:32:00.985103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:21.049073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.684138+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:31:12.684138+0000","last_peered":"2024-02-16T10:31:12.684138+0000","last_clean":"2024-02-16T10:31:12.684138+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:31:12.684138+0000","last_undegraded":"2024-02-16T10:31:12.684138+0000","last_fullsized":"2024-02-16T10:31:12.684138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:54.640122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919653+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:31:06.919653+0000","last_peered":"2024-02-16T10:31:06.919653+0000","last_clean":"2024-02-16T10:31:06.919653+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:31:06.919653+0000","last_undegraded":"2024-02-16T10:31:06.919653+0000","last_fullsized":"2024-02-16T10:31:06.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.559382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.938309+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.938309+0000","last_peered":"2024-02-16T10:31:06.938309+0000","last_clean":"2024-02-16T10:31:06.938309+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.938309+0000","last_undegraded":"2024-02-16T10:31:06.938309+0000","last_fullsized":"2024-02-16T10:31:06.938309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:35.001597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.310393+0000","last_change":"2024-02-16T10:30:32.121571+0000","last_active":"2024-02-16T10:31:55.310393+0000","last_peered":"2024-02-16T10:31:55.310393+0000","last_clean":"2024-02-16T10:31:55.310393+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:31:55.310393+0000","last_undegraded":"2024-02-16T10:31:55.310393+0000","last_fullsized":"2024-02-16T10:31:55.310393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:46.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928644+0000","last_change":"2024-02-16T10:30:34.125614+0000","last_active":"2024-02-16T10:31:06.928644+0000","last_peered":"2024-02-16T10:31:06.928644+0000","last_clean":"2024-02-16T10:31:06.928644+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:31:06.928644+0000","last_undegraded":"2024-02-16T10:31:06.928644+0000","last_fullsized":"2024-02-16T10:31:06.928644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.441324+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:49.441324+0000","last_peered":"2024-02-16T10:31:49.441324+0000","last_clean":"2024-02-16T10:31:49.441324+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:49.441324+0000","last_undegraded":"2024-02-16T10:31:49.441324+0000","last_fullsized":"2024-02-16T10:31:49.441324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:28.899004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996497+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:11.996497+0000","last_peered":"2024-02-16T10:31:11.996497+0000","last_clean":"2024-02-16T10:31:11.996497+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:11.996497+0000","last_undegraded":"2024-02-16T10:31:11.996497+0000","last_fullsized":"2024-02-16T10:31:11.996497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:02.014700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907578+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:31:06.907578+0000","last_peered":"2024-02-16T10:31:06.907578+0000","last_clean":"2024-02-16T10:31:06.907578+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:31:06.907578+0000","last_undegraded":"2024-02-16T10:31:06.907578+0000","last_fullsized":"2024-02-16T10:31:06.907578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932531+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:06.932531+0000","last_peered":"2024-02-16T10:31:06.932531+0000","last_clean":"2024-02-16T10:31:06.932531+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:06.932531+0000","last_undegraded":"2024-02-16T10:31:06.932531+0000","last_fullsized":"2024-02-16T10:31:06.932531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:01.288368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927053+0000","last_change":"2024-02-16T10:30:32.097568+0000","last_active":"2024-02-16T10:31:06.927053+0000","last_peered":"2024-02-16T10:31:06.927053+0000","last_clean":"2024-02-16T10:31:06.927053+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:31:06.927053+0000","last_undegraded":"2024-02-16T10:31:06.927053+0000","last_fullsized":"2024-02-16T10:31:06.927053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:48.421929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926352+0000","last_change":"2024-02-16T10:30:34.132449+0000","last_active":"2024-02-16T10:31:06.926352+0000","last_peered":"2024-02-16T10:31:06.926352+0000","last_clean":"2024-02-16T10:31:06.926352+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:31:06.926352+0000","last_undegraded":"2024-02-16T10:31:06.926352+0000","last_fullsized":"2024-02-16T10:31:06.926352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924189+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924189+0000","last_peered":"2024-02-16T10:31:06.924189+0000","last_clean":"2024-02-16T10:31:06.924189+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924189+0000","last_undegraded":"2024-02-16T10:31:06.924189+0000","last_fullsized":"2024-02-16T10:31:06.924189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003292+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.003292+0000","last_peered":"2024-02-16T10:32:01.003292+0000","last_clean":"2024-02-16T10:32:01.003292+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.003292+0000","last_undegraded":"2024-02-16T10:32:01.003292+0000","last_fullsized":"2024-02-16T10:32:01.003292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:16.057698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915976+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:31:06.915976+0000","last_peered":"2024-02-16T10:31:06.915976+0000","last_clean":"2024-02-16T10:31:06.915976+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:31:06.915976+0000","last_undegraded":"2024-02-16T10:31:06.915976+0000","last_fullsized":"2024-02-16T10:31:06.915976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:43.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932467+0000","last_change":"2024-02-16T10:30:30.080558+0000","last_active":"2024-02-16T10:31:06.932467+0000","last_peered":"2024-02-16T10:31:06.932467+0000","last_clean":"2024-02-16T10:31:06.932467+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:31:06.932467+0000","last_undegraded":"2024-02-16T10:31:06.932467+0000","last_fullsized":"2024-02-16T10:31:06.932467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914049+0000","last_change":"2024-02-16T10:30:32.096519+0000","last_active":"2024-02-16T10:31:06.914049+0000","last_peered":"2024-02-16T10:31:06.914049+0000","last_clean":"2024-02-16T10:31:06.914049+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:31:06.914049+0000","last_undegraded":"2024-02-16T10:31:06.914049+0000","last_fullsized":"2024-02-16T10:31:06.914049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:11.152738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'240","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.255838+0000","last_change":"2024-02-16T10:30:34.141896+0000","last_active":"2024-02-16T10:32:01.255838+0000","last_peered":"2024-02-16T10:32:01.255838+0000","last_clean":"2024-02-16T10:32:01.255838+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:01.255838+0000","last_undegraded":"2024-02-16T10:32:01.255838+0000","last_fullsized":"2024-02-16T10:32:01.255838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911474+0000","last_change":"2024-02-16T10:30:36.135895+0000","last_active":"2024-02-16T10:31:06.911474+0000","last_peered":"2024-02-16T10:31:06.911474+0000","last_clean":"2024-02-16T10:31:06.911474+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:31:06.911474+0000","last_undegraded":"2024-02-16T10:31:06.911474+0000","last_fullsized":"2024-02-16T10:31:06.911474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:52.487219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003499+0000","last_change":"2024-02-16T10:30:28.088671+0000","last_active":"2024-02-16T10:32:01.003499+0000","last_peered":"2024-02-16T10:32:01.003499+0000","last_clean":"2024-02-16T10:32:01.003499+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:01.003499+0000","last_undegraded":"2024-02-16T10:32:01.003499+0000","last_fullsized":"2024-02-16T10:32:01.003499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915727+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:31:06.915727+0000","last_peered":"2024-02-16T10:31:06.915727+0000","last_clean":"2024-02-16T10:31:06.915727+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:31:06.915727+0000","last_undegraded":"2024-02-16T10:31:06.915727+0000","last_fullsized":"2024-02-16T10:31:06.915727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:23.730310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928540+0000","last_change":"2024-02-16T10:30:30.101708+0000","last_active":"2024-02-16T10:31:06.928540+0000","last_peered":"2024-02-16T10:31:06.928540+0000","last_clean":"2024-02-16T10:31:06.928540+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:31:06.928540+0000","last_undegraded":"2024-02-16T10:31:06.928540+0000","last_fullsized":"2024-02-16T10:31:06.928540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:12.591167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.302243+0000","last_change":"2024-02-16T10:30:32.098362+0000","last_active":"2024-02-16T10:31:55.302243+0000","last_peered":"2024-02-16T10:31:55.302243+0000","last_clean":"2024-02-16T10:31:55.302243+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:31:55.302243+0000","last_undegraded":"2024-02-16T10:31:55.302243+0000","last_fullsized":"2024-02-16T10:31:55.302243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:06.260410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'240","reported_seq":330,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.263475+0000","last_change":"2024-02-16T10:30:34.123300+0000","last_active":"2024-02-16T10:32:01.263475+0000","last_peered":"2024-02-16T10:32:01.263475+0000","last_clean":"2024-02-16T10:32:01.263475+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:01.263475+0000","last_undegraded":"2024-02-16T10:32:01.263475+0000","last_fullsized":"2024-02-16T10:32:01.263475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914537+0000","last_change":"2024-02-16T10:30:28.076250+0000","last_active":"2024-02-16T10:31:06.914537+0000","last_peered":"2024-02-16T10:31:06.914537+0000","last_clean":"2024-02-16T10:31:06.914537+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:31:06.914537+0000","last_undegraded":"2024-02-16T10:31:06.914537+0000","last_fullsized":"2024-02-16T10:31:06.914537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:55.536607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916055+0000","last_change":"2024-02-16T10:30:26.085100+0000","last_active":"2024-02-16T10:31:06.916055+0000","last_peered":"2024-02-16T10:31:06.916055+0000","last_clean":"2024-02-16T10:31:06.916055+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:31:06.916055+0000","last_undegraded":"2024-02-16T10:31:06.916055+0000","last_fullsized":"2024-02-16T10:31:06.916055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914345+0000","last_change":"2024-02-16T10:30:30.090540+0000","last_active":"2024-02-16T10:31:06.914345+0000","last_peered":"2024-02-16T10:31:06.914345+0000","last_clean":"2024-02-16T10:31:06.914345+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:31:06.914345+0000","last_undegraded":"2024-02-16T10:31:06.914345+0000","last_fullsized":"2024-02-16T10:31:06.914345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:57.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'38","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.316729+0000","last_change":"2024-02-16T10:30:32.090733+0000","last_active":"2024-02-16T10:31:55.316729+0000","last_peered":"2024-02-16T10:31:55.316729+0000","last_clean":"2024-02-16T10:31:55.316729+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:31:55.316729+0000","last_undegraded":"2024-02-16T10:31:55.316729+0000","last_fullsized":"2024-02-16T10:31:55.316729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:14.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927184+0000","last_change":"2024-02-16T10:30:34.130521+0000","last_active":"2024-02-16T10:31:06.927184+0000","last_peered":"2024-02-16T10:31:06.927184+0000","last_clean":"2024-02-16T10:31:06.927184+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:31:06.927184+0000","last_undegraded":"2024-02-16T10:31:06.927184+0000","last_fullsized":"2024-02-16T10:31:06.927184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:16.619978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.089594+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:31:55.089594+0000","last_peered":"2024-02-16T10:31:55.089594+0000","last_clean":"2024-02-16T10:31:55.089594+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:31:55.089594+0000","last_undegraded":"2024-02-16T10:31:55.089594+0000","last_fullsized":"2024-02-16T10:31:55.089594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:35.549647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.355411+0000","last_change":"2024-02-16T10:30:28.072768+0000","last_active":"2024-02-16T10:31:55.355411+0000","last_peered":"2024-02-16T10:31:55.355411+0000","last_clean":"2024-02-16T10:31:55.355411+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:31:55.355411+0000","last_undegraded":"2024-02-16T10:31:55.355411+0000","last_fullsized":"2024-02-16T10:31:55.355411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921914+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:31:06.921914+0000","last_peered":"2024-02-16T10:31:06.921914+0000","last_clean":"2024-02-16T10:31:06.921914+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:31:06.921914+0000","last_undegraded":"2024-02-16T10:31:06.921914+0000","last_fullsized":"2024-02-16T10:31:06.921914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925241+0000","last_change":"2024-02-16T10:30:30.092397+0000","last_active":"2024-02-16T10:31:06.925241+0000","last_peered":"2024-02-16T10:31:06.925241+0000","last_clean":"2024-02-16T10:31:06.925241+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:31:06.925241+0000","last_undegraded":"2024-02-16T10:31:06.925241+0000","last_fullsized":"2024-02-16T10:31:06.925241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:17:37.092874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.287165+0000","last_change":"2024-02-16T10:30:32.120960+0000","last_active":"2024-02-16T10:31:55.287165+0000","last_peered":"2024-02-16T10:31:55.287165+0000","last_clean":"2024-02-16T10:31:55.287165+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:31:55.287165+0000","last_undegraded":"2024-02-16T10:31:55.287165+0000","last_fullsized":"2024-02-16T10:31:55.287165+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:15.954493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925210+0000","last_change":"2024-02-16T10:30:34.135930+0000","last_active":"2024-02-16T10:31:06.925210+0000","last_peered":"2024-02-16T10:31:06.925210+0000","last_clean":"2024-02-16T10:31:06.925210+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:31:06.925210+0000","last_undegraded":"2024-02-16T10:31:06.925210+0000","last_fullsized":"2024-02-16T10:31:06.925210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.305924+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:31:49.305924+0000","last_peered":"2024-02-16T10:31:49.305924+0000","last_clean":"2024-02-16T10:31:49.305924+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:31:49.305924+0000","last_undegraded":"2024-02-16T10:31:49.305924+0000","last_fullsized":"2024-02-16T10:31:49.305924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.201148+0000","last_change":"2024-02-16T10:30:28.064067+0000","last_active":"2024-02-16T10:31:11.201148+0000","last_peered":"2024-02-16T10:31:11.201148+0000","last_clean":"2024-02-16T10:31:11.201148+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:31:11.201148+0000","last_undegraded":"2024-02-16T10:31:11.201148+0000","last_fullsized":"2024-02-16T10:31:11.201148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:05.987067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927937+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:31:06.927937+0000","last_peered":"2024-02-16T10:31:06.927937+0000","last_clean":"2024-02-16T10:31:06.927937+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:31:06.927937+0000","last_undegraded":"2024-02-16T10:31:06.927937+0000","last_fullsized":"2024-02-16T10:31:06.927937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:20.023353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926646+0000","last_change":"2024-02-16T10:30:30.080329+0000","last_active":"2024-02-16T10:31:06.926646+0000","last_peered":"2024-02-16T10:31:06.926646+0000","last_clean":"2024-02-16T10:31:06.926646+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:31:06.926646+0000","last_undegraded":"2024-02-16T10:31:06.926646+0000","last_fullsized":"2024-02-16T10:31:06.926646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:30.180346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.319591+0000","last_change":"2024-02-16T10:30:32.116257+0000","last_active":"2024-02-16T10:31:55.319591+0000","last_peered":"2024-02-16T10:31:55.319591+0000","last_clean":"2024-02-16T10:31:55.319591+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:31:55.319591+0000","last_undegraded":"2024-02-16T10:31:55.319591+0000","last_fullsized":"2024-02-16T10:31:55.319591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:52.854962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'240","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.265989+0000","last_change":"2024-02-16T10:30:34.135819+0000","last_active":"2024-02-16T10:32:01.265989+0000","last_peered":"2024-02-16T10:32:01.265989+0000","last_clean":"2024-02-16T10:32:01.265989+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:01.265989+0000","last_undegraded":"2024-02-16T10:32:01.265989+0000","last_fullsized":"2024-02-16T10:32:01.265989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927141+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:31:06.927141+0000","last_peered":"2024-02-16T10:31:06.927141+0000","last_clean":"2024-02-16T10:31:06.927141+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:31:06.927141+0000","last_undegraded":"2024-02-16T10:31:06.927141+0000","last_fullsized":"2024-02-16T10:31:06.927141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:55.920641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657202+0000","last_change":"2024-02-16T10:30:28.068604+0000","last_active":"2024-02-16T10:31:11.657202+0000","last_peered":"2024-02-16T10:31:11.657202+0000","last_clean":"2024-02-16T10:31:11.657202+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:31:11.657202+0000","last_undegraded":"2024-02-16T10:31:11.657202+0000","last_fullsized":"2024-02-16T10:31:11.657202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924328+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:31:06.924328+0000","last_peered":"2024-02-16T10:31:06.924328+0000","last_clean":"2024-02-16T10:31:06.924328+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:31:06.924328+0000","last_undegraded":"2024-02-16T10:31:06.924328+0000","last_fullsized":"2024-02-16T10:31:06.924328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:56.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926096+0000","last_change":"2024-02-16T10:30:30.081734+0000","last_active":"2024-02-16T10:31:06.926096+0000","last_peered":"2024-02-16T10:31:06.926096+0000","last_clean":"2024-02-16T10:31:06.926096+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:31:06.926096+0000","last_undegraded":"2024-02-16T10:31:06.926096+0000","last_fullsized":"2024-02-16T10:31:06.926096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:06.703746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.937216+0000","last_change":"2024-02-16T10:30:32.122915+0000","last_active":"2024-02-16T10:32:00.937216+0000","last_peered":"2024-02-16T10:32:00.937216+0000","last_clean":"2024-02-16T10:32:00.937216+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:00.937216+0000","last_undegraded":"2024-02-16T10:32:00.937216+0000","last_fullsized":"2024-02-16T10:32:00.937216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:06.755062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924769+0000","last_change":"2024-02-16T10:30:34.118800+0000","last_active":"2024-02-16T10:31:06.924769+0000","last_peered":"2024-02-16T10:31:06.924769+0000","last_clean":"2024-02-16T10:31:06.924769+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:31:06.924769+0000","last_undegraded":"2024-02-16T10:31:06.924769+0000","last_fullsized":"2024-02-16T10:31:06.924769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929435+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:31:06.929435+0000","last_peered":"2024-02-16T10:31:06.929435+0000","last_clean":"2024-02-16T10:31:06.929435+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:31:06.929435+0000","last_undegraded":"2024-02-16T10:31:06.929435+0000","last_fullsized":"2024-02-16T10:31:06.929435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:56.882445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.683838+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:31:12.683838+0000","last_peered":"2024-02-16T10:31:12.683838+0000","last_clean":"2024-02-16T10:31:12.683838+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:31:12.683838+0000","last_undegraded":"2024-02-16T10:31:12.683838+0000","last_fullsized":"2024-02-16T10:31:12.683838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:52.232418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926917+0000","last_change":"2024-02-16T10:30:26.098753+0000","last_active":"2024-02-16T10:31:06.926917+0000","last_peered":"2024-02-16T10:31:06.926917+0000","last_clean":"2024-02-16T10:31:06.926917+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:31:06.926917+0000","last_undegraded":"2024-02-16T10:31:06.926917+0000","last_fullsized":"2024-02-16T10:31:06.926917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.061106+0000","last_change":"2024-02-16T10:30:30.080515+0000","last_active":"2024-02-16T10:32:02.061106+0000","last_peered":"2024-02-16T10:32:02.061106+0000","last_clean":"2024-02-16T10:32:02.061106+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:02.061106+0000","last_undegraded":"2024-02-16T10:32:02.061106+0000","last_fullsized":"2024-02-16T10:32:02.061106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:03.555320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.292402+0000","last_change":"2024-02-16T10:30:32.094520+0000","last_active":"2024-02-16T10:31:55.292402+0000","last_peered":"2024-02-16T10:31:55.292402+0000","last_clean":"2024-02-16T10:31:55.292402+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:31:55.292402+0000","last_undegraded":"2024-02-16T10:31:55.292402+0000","last_fullsized":"2024-02-16T10:31:55.292402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:31.069304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.933898+0000","last_change":"2024-02-16T10:30:34.141827+0000","last_active":"2024-02-16T10:31:06.933898+0000","last_peered":"2024-02-16T10:31:06.933898+0000","last_clean":"2024-02-16T10:31:06.933898+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:31:06.933898+0000","last_undegraded":"2024-02-16T10:31:06.933898+0000","last_fullsized":"2024-02-16T10:31:06.933898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:38.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911244+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:31:06.911244+0000","last_peered":"2024-02-16T10:31:06.911244+0000","last_clean":"2024-02-16T10:31:06.911244+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:31:06.911244+0000","last_undegraded":"2024-02-16T10:31:06.911244+0000","last_fullsized":"2024-02-16T10:31:06.911244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:00.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.202587+0000","last_change":"2024-02-16T10:30:28.086917+0000","last_active":"2024-02-16T10:31:11.202587+0000","last_peered":"2024-02-16T10:31:11.202587+0000","last_clean":"2024-02-16T10:31:11.202587+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:31:11.202587+0000","last_undegraded":"2024-02-16T10:31:11.202587+0000","last_fullsized":"2024-02-16T10:31:11.202587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:44.394736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921051+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:31:06.921051+0000","last_peered":"2024-02-16T10:31:06.921051+0000","last_clean":"2024-02-16T10:31:06.921051+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:31:06.921051+0000","last_undegraded":"2024-02-16T10:31:06.921051+0000","last_fullsized":"2024-02-16T10:31:06.921051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926662+0000","last_change":"2024-02-16T10:30:30.082304+0000","last_active":"2024-02-16T10:31:06.926662+0000","last_peered":"2024-02-16T10:31:06.926662+0000","last_clean":"2024-02-16T10:31:06.926662+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:31:06.926662+0000","last_undegraded":"2024-02-16T10:31:06.926662+0000","last_fullsized":"2024-02-16T10:31:06.926662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:59.066509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.335445+0000","last_change":"2024-02-16T10:30:32.091187+0000","last_active":"2024-02-16T10:31:55.335445+0000","last_peered":"2024-02-16T10:31:55.335445+0000","last_clean":"2024-02-16T10:31:55.335445+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:31:55.335445+0000","last_undegraded":"2024-02-16T10:31:55.335445+0000","last_fullsized":"2024-02-16T10:31:55.335445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:59.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'240","reported_seq":332,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.257093+0000","last_change":"2024-02-16T10:30:34.129069+0000","last_active":"2024-02-16T10:32:01.257093+0000","last_peered":"2024-02-16T10:32:01.257093+0000","last_clean":"2024-02-16T10:32:01.257093+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:01.257093+0000","last_undegraded":"2024-02-16T10:32:01.257093+0000","last_fullsized":"2024-02-16T10:32:01.257093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:33.083249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.374319+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:31:55.374319+0000","last_peered":"2024-02-16T10:31:55.374319+0000","last_clean":"2024-02-16T10:31:55.374319+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:31:55.374319+0000","last_undegraded":"2024-02-16T10:31:55.374319+0000","last_fullsized":"2024-02-16T10:31:55.374319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922972+0000","last_change":"2024-02-16T10:30:28.063099+0000","last_active":"2024-02-16T10:31:06.922972+0000","last_peered":"2024-02-16T10:31:06.922972+0000","last_clean":"2024-02-16T10:31:06.922972+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:31:06.922972+0000","last_undegraded":"2024-02-16T10:31:06.922972+0000","last_fullsized":"2024-02-16T10:31:06.922972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.987828+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:31:11.987828+0000","last_peered":"2024-02-16T10:31:11.987828+0000","last_clean":"2024-02-16T10:31:11.987828+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:31:11.987828+0000","last_undegraded":"2024-02-16T10:31:11.987828+0000","last_fullsized":"2024-02-16T10:31:11.987828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:21.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193502+0000","last_change":"2024-02-16T10:30:30.090962+0000","last_active":"2024-02-16T10:32:02.193502+0000","last_peered":"2024-02-16T10:32:02.193502+0000","last_clean":"2024-02-16T10:32:02.193502+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:02.193502+0000","last_undegraded":"2024-02-16T10:32:02.193502+0000","last_fullsized":"2024-02-16T10:32:02.193502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:08.415016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928037+0000","last_change":"2024-02-16T10:30:32.123949+0000","last_active":"2024-02-16T10:31:06.928037+0000","last_peered":"2024-02-16T10:31:06.928037+0000","last_clean":"2024-02-16T10:31:06.928037+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:31:06.928037+0000","last_undegraded":"2024-02-16T10:31:06.928037+0000","last_fullsized":"2024-02-16T10:31:06.928037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:03.303232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'240","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.259237+0000","last_change":"2024-02-16T10:30:34.117090+0000","last_active":"2024-02-16T10:32:01.259237+0000","last_peered":"2024-02-16T10:32:01.259237+0000","last_clean":"2024-02-16T10:32:01.259237+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:01.259237+0000","last_undegraded":"2024-02-16T10:32:01.259237+0000","last_fullsized":"2024-02-16T10:32:01.259237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908544+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:31:06.908544+0000","last_peered":"2024-02-16T10:31:06.908544+0000","last_clean":"2024-02-16T10:31:06.908544+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:31:06.908544+0000","last_undegraded":"2024-02-16T10:31:06.908544+0000","last_fullsized":"2024-02-16T10:31:06.908544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:36.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497874+0000","last_change":"2024-02-16T10:30:28.085134+0000","last_active":"2024-02-16T10:31:54.497874+0000","last_peered":"2024-02-16T10:31:54.497874+0000","last_clean":"2024-02-16T10:31:54.497874+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:31:54.497874+0000","last_undegraded":"2024-02-16T10:31:54.497874+0000","last_fullsized":"2024-02-16T10:31:54.497874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:01.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913722+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:31:06.913722+0000","last_peered":"2024-02-16T10:31:06.913722+0000","last_clean":"2024-02-16T10:31:06.913722+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:31:06.913722+0000","last_undegraded":"2024-02-16T10:31:06.913722+0000","last_fullsized":"2024-02-16T10:31:06.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:18.440901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929645+0000","last_change":"2024-02-16T10:30:30.102962+0000","last_active":"2024-02-16T10:31:06.929645+0000","last_peered":"2024-02-16T10:31:06.929645+0000","last_clean":"2024-02-16T10:31:06.929645+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:31:06.929645+0000","last_undegraded":"2024-02-16T10:31:06.929645+0000","last_fullsized":"2024-02-16T10:31:06.929645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:37:30.267642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.312265+0000","last_change":"2024-02-16T10:30:32.094067+0000","last_active":"2024-02-16T10:31:55.312265+0000","last_peered":"2024-02-16T10:31:55.312265+0000","last_clean":"2024-02-16T10:31:55.312265+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:31:55.312265+0000","last_undegraded":"2024-02-16T10:31:55.312265+0000","last_fullsized":"2024-02-16T10:31:55.312265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:49.917930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913640+0000","last_change":"2024-02-16T10:30:34.143148+0000","last_active":"2024-02-16T10:31:06.913640+0000","last_peered":"2024-02-16T10:31:06.913640+0000","last_clean":"2024-02-16T10:31:06.913640+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:31:06.913640+0000","last_undegraded":"2024-02-16T10:31:06.913640+0000","last_fullsized":"2024-02-16T10:31:06.913640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:03.500298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919017+0000","last_change":"2024-02-16T10:30:36.124467+0000","last_active":"2024-02-16T10:31:06.919017+0000","last_peered":"2024-02-16T10:31:06.919017+0000","last_clean":"2024-02-16T10:31:06.919017+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:31:06.919017+0000","last_undegraded":"2024-02-16T10:31:06.919017+0000","last_fullsized":"2024-02-16T10:31:06.919017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:10.069376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.009909+0000","last_change":"2024-02-16T10:30:28.084181+0000","last_active":"2024-02-16T10:31:12.009909+0000","last_peered":"2024-02-16T10:31:12.009909+0000","last_clean":"2024-02-16T10:31:12.009909+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:31:12.009909+0000","last_undegraded":"2024-02-16T10:31:12.009909+0000","last_fullsized":"2024-02-16T10:31:12.009909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:30.459984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911425+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:31:06.911425+0000","last_peered":"2024-02-16T10:31:06.911425+0000","last_clean":"2024-02-16T10:31:06.911425+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:31:06.911425+0000","last_undegraded":"2024-02-16T10:31:06.911425+0000","last_fullsized":"2024-02-16T10:31:06.911425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920241+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:31:06.920241+0000","last_peered":"2024-02-16T10:31:06.920241+0000","last_clean":"2024-02-16T10:31:06.920241+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:31:06.920241+0000","last_undegraded":"2024-02-16T10:31:06.920241+0000","last_fullsized":"2024-02-16T10:31:06.920241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919063+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:31:06.919063+0000","last_peered":"2024-02-16T10:31:06.919063+0000","last_clean":"2024-02-16T10:31:06.919063+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:31:06.919063+0000","last_undegraded":"2024-02-16T10:31:06.919063+0000","last_fullsized":"2024-02-16T10:31:06.919063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.376276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929597+0000","last_change":"2024-02-16T10:30:30.091282+0000","last_active":"2024-02-16T10:31:06.929597+0000","last_peered":"2024-02-16T10:31:06.929597+0000","last_clean":"2024-02-16T10:31:06.929597+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:31:06.929597+0000","last_undegraded":"2024-02-16T10:31:06.929597+0000","last_fullsized":"2024-02-16T10:31:06.929597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:45.940628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'72","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.963490+0000","last_change":"2024-02-16T10:30:32.125750+0000","last_active":"2024-02-16T10:32:00.963490+0000","last_peered":"2024-02-16T10:32:00.963490+0000","last_clean":"2024-02-16T10:32:00.963490+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:00.963490+0000","last_undegraded":"2024-02-16T10:32:00.963490+0000","last_fullsized":"2024-02-16T10:32:00.963490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:57:39.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":72,"num_read_kb":76,"num_write":26,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927452+0000","last_change":"2024-02-16T10:30:34.135655+0000","last_active":"2024-02-16T10:31:06.927452+0000","last_peered":"2024-02-16T10:31:06.927452+0000","last_clean":"2024-02-16T10:31:06.927452+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:31:06.927452+0000","last_undegraded":"2024-02-16T10:31:06.927452+0000","last_fullsized":"2024-02-16T10:31:06.927452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:22.389333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.026066+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:01.026066+0000","last_peered":"2024-02-16T10:32:01.026066+0000","last_clean":"2024-02-16T10:32:01.026066+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:01.026066+0000","last_undegraded":"2024-02-16T10:32:01.026066+0000","last_fullsized":"2024-02-16T10:32:01.026066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:51.053720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.685163+0000","last_change":"2024-02-16T10:30:28.069523+0000","last_active":"2024-02-16T10:31:12.685163+0000","last_peered":"2024-02-16T10:31:12.685163+0000","last_clean":"2024-02-16T10:31:12.685163+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:31:12.685163+0000","last_undegraded":"2024-02-16T10:31:12.685163+0000","last_fullsized":"2024-02-16T10:31:12.685163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:45.890737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912556+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:31:06.912556+0000","last_peered":"2024-02-16T10:31:06.912556+0000","last_clean":"2024-02-16T10:31:06.912556+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:31:06.912556+0000","last_undegraded":"2024-02-16T10:31:06.912556+0000","last_fullsized":"2024-02-16T10:31:06.912556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.966566+0000","last_change":"2024-02-16T10:30:26.098916+0000","last_active":"2024-02-16T10:31:11.966566+0000","last_peered":"2024-02-16T10:31:11.966566+0000","last_clean":"2024-02-16T10:31:11.966566+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:31:11.966566+0000","last_undegraded":"2024-02-16T10:31:11.966566+0000","last_fullsized":"2024-02-16T10:31:11.966566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934263+0000","last_change":"2024-02-16T10:30:30.102474+0000","last_active":"2024-02-16T10:31:06.934263+0000","last_peered":"2024-02-16T10:31:06.934263+0000","last_clean":"2024-02-16T10:31:06.934263+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:31:06.934263+0000","last_undegraded":"2024-02-16T10:31:06.934263+0000","last_fullsized":"2024-02-16T10:31:06.934263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:06.503438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'239","reported_seq":408,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.250178+0000","last_change":"2024-02-16T10:30:32.096480+0000","last_active":"2024-02-16T10:32:01.250178+0000","last_peered":"2024-02-16T10:32:01.250178+0000","last_clean":"2024-02-16T10:32:01.250178+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:01.250178+0000","last_undegraded":"2024-02-16T10:32:01.250178+0000","last_fullsized":"2024-02-16T10:32:01.250178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:13.908498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923579+0000","last_change":"2024-02-16T10:30:34.141970+0000","last_active":"2024-02-16T10:31:06.923579+0000","last_peered":"2024-02-16T10:31:06.923579+0000","last_clean":"2024-02-16T10:31:06.923579+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:31:06.923579+0000","last_undegraded":"2024-02-16T10:31:06.923579+0000","last_fullsized":"2024-02-16T10:31:06.923579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:53.614440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.457111+0000","last_change":"2024-02-16T10:30:36.139509+0000","last_active":"2024-02-16T10:31:49.457111+0000","last_peered":"2024-02-16T10:31:49.457111+0000","last_clean":"2024-02-16T10:31:49.457111+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:31:49.457111+0000","last_undegraded":"2024-02-16T10:31:49.457111+0000","last_fullsized":"2024-02-16T10:31:49.457111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:50.619455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003297+0000","last_change":"2024-02-16T10:30:28.079105+0000","last_active":"2024-02-16T10:32:01.003297+0000","last_peered":"2024-02-16T10:32:01.003297+0000","last_clean":"2024-02-16T10:32:01.003297+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:01.003297+0000","last_undegraded":"2024-02-16T10:32:01.003297+0000","last_fullsized":"2024-02-16T10:32:01.003297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908820+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:31:06.908820+0000","last_peered":"2024-02-16T10:31:06.908820+0000","last_clean":"2024-02-16T10:31:06.908820+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:31:06.908820+0000","last_undegraded":"2024-02-16T10:31:06.908820+0000","last_fullsized":"2024-02-16T10:31:06.908820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924324+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:31:06.924324+0000","last_peered":"2024-02-16T10:31:06.924324+0000","last_clean":"2024-02-16T10:31:06.924324+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:31:06.924324+0000","last_undegraded":"2024-02-16T10:31:06.924324+0000","last_fullsized":"2024-02-16T10:31:06.924324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915764+0000","last_change":"2024-02-16T10:30:30.078068+0000","last_active":"2024-02-16T10:31:06.915764+0000","last_peered":"2024-02-16T10:31:06.915764+0000","last_clean":"2024-02-16T10:31:06.915764+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:31:06.915764+0000","last_undegraded":"2024-02-16T10:31:06.915764+0000","last_fullsized":"2024-02-16T10:31:06.915764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:40.026302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.261541+0000","last_change":"2024-02-16T10:30:32.091702+0000","last_active":"2024-02-16T10:32:00.261541+0000","last_peered":"2024-02-16T10:32:00.261541+0000","last_clean":"2024-02-16T10:32:00.261541+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:00.261541+0000","last_undegraded":"2024-02-16T10:32:00.261541+0000","last_fullsized":"2024-02-16T10:32:00.261541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:33.175979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927804+0000","last_change":"2024-02-16T10:30:34.138200+0000","last_active":"2024-02-16T10:31:06.927804+0000","last_peered":"2024-02-16T10:31:06.927804+0000","last_clean":"2024-02-16T10:31:06.927804+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:31:06.927804+0000","last_undegraded":"2024-02-16T10:31:06.927804+0000","last_fullsized":"2024-02-16T10:31:06.927804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:20.815431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917885+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:31:06.917885+0000","last_peered":"2024-02-16T10:31:06.917885+0000","last_clean":"2024-02-16T10:31:06.917885+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:31:06.917885+0000","last_undegraded":"2024-02-16T10:31:06.917885+0000","last_fullsized":"2024-02-16T10:31:06.917885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:08.274614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.205515+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:31:11.205515+0000","last_peered":"2024-02-16T10:31:11.205515+0000","last_clean":"2024-02-16T10:31:11.205515+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:31:11.205515+0000","last_undegraded":"2024-02-16T10:31:11.205515+0000","last_fullsized":"2024-02-16T10:31:11.205515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915962+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:31:06.915962+0000","last_peered":"2024-02-16T10:31:06.915962+0000","last_clean":"2024-02-16T10:31:06.915962+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:31:06.915962+0000","last_undegraded":"2024-02-16T10:31:06.915962+0000","last_fullsized":"2024-02-16T10:31:06.915962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912749+0000","last_change":"2024-02-16T10:30:26.084253+0000","last_active":"2024-02-16T10:31:06.912749+0000","last_peered":"2024-02-16T10:31:06.912749+0000","last_clean":"2024-02-16T10:31:06.912749+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:31:06.912749+0000","last_undegraded":"2024-02-16T10:31:06.912749+0000","last_fullsized":"2024-02-16T10:31:06.912749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927392+0000","last_change":"2024-02-16T10:30:30.080063+0000","last_active":"2024-02-16T10:31:06.927392+0000","last_peered":"2024-02-16T10:31:06.927392+0000","last_clean":"2024-02-16T10:31:06.927392+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:31:06.927392+0000","last_undegraded":"2024-02-16T10:31:06.927392+0000","last_fullsized":"2024-02-16T10:31:06.927392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:12.944183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928152+0000","last_change":"2024-02-16T10:30:32.125409+0000","last_active":"2024-02-16T10:31:06.928152+0000","last_peered":"2024-02-16T10:31:06.928152+0000","last_clean":"2024-02-16T10:31:06.928152+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:31:06.928152+0000","last_undegraded":"2024-02-16T10:31:06.928152+0000","last_fullsized":"2024-02-16T10:31:06.928152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:35:51.048004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934645+0000","last_change":"2024-02-16T10:30:34.141949+0000","last_active":"2024-02-16T10:31:06.934645+0000","last_peered":"2024-02-16T10:31:06.934645+0000","last_clean":"2024-02-16T10:31:06.934645+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:31:06.934645+0000","last_undegraded":"2024-02-16T10:31:06.934645+0000","last_fullsized":"2024-02-16T10:31:06.934645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:14:10.316154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.339887+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:31:55.339887+0000","last_peered":"2024-02-16T10:31:55.339887+0000","last_clean":"2024-02-16T10:31:55.339887+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:31:55.339887+0000","last_undegraded":"2024-02-16T10:31:55.339887+0000","last_fullsized":"2024-02-16T10:31:55.339887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:25.468581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354549+0000","last_change":"2024-02-16T10:30:28.065872+0000","last_active":"2024-02-16T10:31:55.354549+0000","last_peered":"2024-02-16T10:31:55.354549+0000","last_clean":"2024-02-16T10:31:55.354549+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:31:55.354549+0000","last_undegraded":"2024-02-16T10:31:55.354549+0000","last_fullsized":"2024-02-16T10:31:55.354549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914991+0000","last_change":"2024-02-16T10:30:26.087305+0000","last_active":"2024-02-16T10:31:06.914991+0000","last_peered":"2024-02-16T10:31:06.914991+0000","last_clean":"2024-02-16T10:31:06.914991+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:31:06.914991+0000","last_undegraded":"2024-02-16T10:31:06.914991+0000","last_fullsized":"2024-02-16T10:31:06.914991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927469+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:31:06.927469+0000","last_peered":"2024-02-16T10:31:06.927469+0000","last_clean":"2024-02-16T10:31:06.927469+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:31:06.927469+0000","last_undegraded":"2024-02-16T10:31:06.927469+0000","last_fullsized":"2024-02-16T10:31:06.927469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926744+0000","last_change":"2024-02-16T10:30:30.079568+0000","last_active":"2024-02-16T10:31:06.926744+0000","last_peered":"2024-02-16T10:31:06.926744+0000","last_clean":"2024-02-16T10:31:06.926744+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:31:06.926744+0000","last_undegraded":"2024-02-16T10:31:06.926744+0000","last_fullsized":"2024-02-16T10:31:06.926744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:12.104297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.981370+0000","last_change":"2024-02-16T10:30:32.088251+0000","last_active":"2024-02-16T10:32:00.981370+0000","last_peered":"2024-02-16T10:32:00.981370+0000","last_clean":"2024-02-16T10:32:00.981370+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:00.981370+0000","last_undegraded":"2024-02-16T10:32:00.981370+0000","last_fullsized":"2024-02-16T10:32:00.981370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:58.667315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906656+0000","last_change":"2024-02-16T10:30:34.119623+0000","last_active":"2024-02-16T10:31:06.906656+0000","last_peered":"2024-02-16T10:31:06.906656+0000","last_clean":"2024-02-16T10:31:06.906656+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:31:06.906656+0000","last_undegraded":"2024-02-16T10:31:06.906656+0000","last_fullsized":"2024-02-16T10:31:06.906656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:22.098837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.337862+0000","last_change":"2024-02-16T10:30:36.121926+0000","last_active":"2024-02-16T10:31:55.337862+0000","last_peered":"2024-02-16T10:31:55.337862+0000","last_clean":"2024-02-16T10:31:55.337862+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:31:55.337862+0000","last_undegraded":"2024-02-16T10:31:55.337862+0000","last_fullsized":"2024-02-16T10:31:55.337862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:27:43.916489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919422+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:31:06.919422+0000","last_peered":"2024-02-16T10:31:06.919422+0000","last_clean":"2024-02-16T10:31:06.919422+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:31:06.919422+0000","last_undegraded":"2024-02-16T10:31:06.919422+0000","last_fullsized":"2024-02-16T10:31:06.919422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:27:43.149715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929126+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:31:06.929126+0000","last_peered":"2024-02-16T10:31:06.929126+0000","last_clean":"2024-02-16T10:31:06.929126+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:31:06.929126+0000","last_undegraded":"2024-02-16T10:31:06.929126+0000","last_fullsized":"2024-02-16T10:31:06.929126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926258+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:31:06.926258+0000","last_peered":"2024-02-16T10:31:06.926258+0000","last_clean":"2024-02-16T10:31:06.926258+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:31:06.926258+0000","last_undegraded":"2024-02-16T10:31:06.926258+0000","last_fullsized":"2024-02-16T10:31:06.926258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915178+0000","last_change":"2024-02-16T10:30:30.100081+0000","last_active":"2024-02-16T10:31:06.915178+0000","last_peered":"2024-02-16T10:31:06.915178+0000","last_clean":"2024-02-16T10:31:06.915178+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:31:06.915178+0000","last_undegraded":"2024-02-16T10:31:06.915178+0000","last_fullsized":"2024-02-16T10:31:06.915178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:04.710974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911662+0000","last_change":"2024-02-16T10:30:32.101750+0000","last_active":"2024-02-16T10:31:06.911662+0000","last_peered":"2024-02-16T10:31:06.911662+0000","last_clean":"2024-02-16T10:31:06.911662+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:31:06.911662+0000","last_undegraded":"2024-02-16T10:31:06.911662+0000","last_fullsized":"2024-02-16T10:31:06.911662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:20.084891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'240","reported_seq":278,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.253565+0000","last_change":"2024-02-16T10:30:34.111985+0000","last_active":"2024-02-16T10:32:01.253565+0000","last_peered":"2024-02-16T10:32:01.253565+0000","last_clean":"2024-02-16T10:32:01.253565+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:01.253565+0000","last_undegraded":"2024-02-16T10:32:01.253565+0000","last_fullsized":"2024-02-16T10:32:01.253565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932415+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:31:06.932415+0000","last_peered":"2024-02-16T10:31:06.932415+0000","last_clean":"2024-02-16T10:31:06.932415+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:31:06.932415+0000","last_undegraded":"2024-02-16T10:31:06.932415+0000","last_fullsized":"2024-02-16T10:31:06.932415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:46.560489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922019+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:06.922019+0000","last_peered":"2024-02-16T10:31:06.922019+0000","last_clean":"2024-02-16T10:31:06.922019+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:06.922019+0000","last_undegraded":"2024-02-16T10:31:06.922019+0000","last_fullsized":"2024-02-16T10:31:06.922019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:17.413905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936126+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:31:06.936126+0000","last_peered":"2024-02-16T10:31:06.936126+0000","last_clean":"2024-02-16T10:31:06.936126+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:31:06.936126+0000","last_undegraded":"2024-02-16T10:31:06.936126+0000","last_fullsized":"2024-02-16T10:31:06.936126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:27.417317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928021+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:31:06.928021+0000","last_peered":"2024-02-16T10:31:06.928021+0000","last_clean":"2024-02-16T10:31:06.928021+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:31:06.928021+0000","last_undegraded":"2024-02-16T10:31:06.928021+0000","last_fullsized":"2024-02-16T10:31:06.928021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915715+0000","last_change":"2024-02-16T10:30:30.097705+0000","last_active":"2024-02-16T10:31:06.915715+0000","last_peered":"2024-02-16T10:31:06.915715+0000","last_clean":"2024-02-16T10:31:06.915715+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:31:06.915715+0000","last_undegraded":"2024-02-16T10:31:06.915715+0000","last_fullsized":"2024-02-16T10:31:06.915715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:01.461744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920148+0000","last_change":"2024-02-16T10:30:32.121333+0000","last_active":"2024-02-16T10:31:06.920148+0000","last_peered":"2024-02-16T10:31:06.920148+0000","last_clean":"2024-02-16T10:31:06.920148+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:31:06.920148+0000","last_undegraded":"2024-02-16T10:31:06.920148+0000","last_fullsized":"2024-02-16T10:31:06.920148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:10.723393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'240","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.261495+0000","last_change":"2024-02-16T10:30:34.123666+0000","last_active":"2024-02-16T10:32:01.261495+0000","last_peered":"2024-02-16T10:32:01.261495+0000","last_clean":"2024-02-16T10:32:01.261495+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:01.261495+0000","last_undegraded":"2024-02-16T10:32:01.261495+0000","last_fullsized":"2024-02-16T10:32:01.261495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:37.246851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924998+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:31:06.924998+0000","last_peered":"2024-02-16T10:31:06.924998+0000","last_clean":"2024-02-16T10:31:06.924998+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:31:06.924998+0000","last_undegraded":"2024-02-16T10:31:06.924998+0000","last_fullsized":"2024-02-16T10:31:06.924998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907950+0000","last_change":"2024-02-16T10:30:28.059745+0000","last_active":"2024-02-16T10:31:06.907950+0000","last_peered":"2024-02-16T10:31:06.907950+0000","last_clean":"2024-02-16T10:31:06.907950+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:31:06.907950+0000","last_undegraded":"2024-02-16T10:31:06.907950+0000","last_fullsized":"2024-02-16T10:31:06.907950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:20.455470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926582+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:31:06.926582+0000","last_peered":"2024-02-16T10:31:06.926582+0000","last_clean":"2024-02-16T10:31:06.926582+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:31:06.926582+0000","last_undegraded":"2024-02-16T10:31:06.926582+0000","last_fullsized":"2024-02-16T10:31:06.926582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934928+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:31:06.934928+0000","last_peered":"2024-02-16T10:31:06.934928+0000","last_clean":"2024-02-16T10:31:06.934928+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:31:06.934928+0000","last_undegraded":"2024-02-16T10:31:06.934928+0000","last_fullsized":"2024-02-16T10:31:06.934928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912208+0000","last_change":"2024-02-16T10:30:30.090784+0000","last_active":"2024-02-16T10:31:06.912208+0000","last_peered":"2024-02-16T10:31:06.912208+0000","last_clean":"2024-02-16T10:31:06.912208+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:31:06.912208+0000","last_undegraded":"2024-02-16T10:31:06.912208+0000","last_fullsized":"2024-02-16T10:31:06.912208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:16.786621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'76","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.945908+0000","last_change":"2024-02-16T10:30:32.086049+0000","last_active":"2024-02-16T10:32:00.945908+0000","last_peered":"2024-02-16T10:32:00.945908+0000","last_clean":"2024-02-16T10:32:00.945908+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:00.945908+0000","last_undegraded":"2024-02-16T10:32:00.945908+0000","last_fullsized":"2024-02-16T10:32:00.945908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:07.411102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924423+0000","last_change":"2024-02-16T10:30:34.118806+0000","last_active":"2024-02-16T10:31:06.924423+0000","last_peered":"2024-02-16T10:31:06.924423+0000","last_clean":"2024-02-16T10:31:06.924423+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:31:06.924423+0000","last_undegraded":"2024-02-16T10:31:06.924423+0000","last_fullsized":"2024-02-16T10:31:06.924423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917565+0000","last_change":"2024-02-16T10:30:36.134096+0000","last_active":"2024-02-16T10:31:06.917565+0000","last_peered":"2024-02-16T10:31:06.917565+0000","last_clean":"2024-02-16T10:31:06.917565+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:31:06.917565+0000","last_undegraded":"2024-02-16T10:31:06.917565+0000","last_fullsized":"2024-02-16T10:31:06.917565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:20.709724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915771+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:31:06.915771+0000","last_peered":"2024-02-16T10:31:06.915771+0000","last_clean":"2024-02-16T10:31:06.915771+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:31:06.915771+0000","last_undegraded":"2024-02-16T10:31:06.915771+0000","last_fullsized":"2024-02-16T10:31:06.915771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:31.149744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003456+0000","last_change":"2024-02-16T10:30:28.065560+0000","last_active":"2024-02-16T10:32:01.003456+0000","last_peered":"2024-02-16T10:32:01.003456+0000","last_clean":"2024-02-16T10:32:01.003456+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:01.003456+0000","last_undegraded":"2024-02-16T10:32:01.003456+0000","last_fullsized":"2024-02-16T10:32:01.003456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924689+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:31:06.924689+0000","last_peered":"2024-02-16T10:31:06.924689+0000","last_clean":"2024-02-16T10:31:06.924689+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:31:06.924689+0000","last_undegraded":"2024-02-16T10:31:06.924689+0000","last_fullsized":"2024-02-16T10:31:06.924689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:04.250123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912078+0000","last_change":"2024-02-16T10:30:30.099282+0000","last_active":"2024-02-16T10:31:06.912078+0000","last_peered":"2024-02-16T10:31:06.912078+0000","last_clean":"2024-02-16T10:31:06.912078+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:31:06.912078+0000","last_undegraded":"2024-02-16T10:31:06.912078+0000","last_fullsized":"2024-02-16T10:31:06.912078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:05.396237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.318143+0000","last_change":"2024-02-16T10:30:32.117290+0000","last_active":"2024-02-16T10:31:55.318143+0000","last_peered":"2024-02-16T10:31:55.318143+0000","last_clean":"2024-02-16T10:31:55.318143+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:31:55.318143+0000","last_undegraded":"2024-02-16T10:31:55.318143+0000","last_fullsized":"2024-02-16T10:31:55.318143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:10.257963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914793+0000","last_change":"2024-02-16T10:30:34.138222+0000","last_active":"2024-02-16T10:31:06.914793+0000","last_peered":"2024-02-16T10:31:06.914793+0000","last_clean":"2024-02-16T10:31:06.914793+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:31:06.914793+0000","last_undegraded":"2024-02-16T10:31:06.914793+0000","last_fullsized":"2024-02-16T10:31:06.914793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927061+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:31:06.927061+0000","last_peered":"2024-02-16T10:31:06.927061+0000","last_clean":"2024-02-16T10:31:06.927061+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:31:06.927061+0000","last_undegraded":"2024-02-16T10:31:06.927061+0000","last_fullsized":"2024-02-16T10:31:06.927061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:29.115943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686067+0000","last_change":"2024-02-16T10:30:28.065164+0000","last_active":"2024-02-16T10:31:12.686067+0000","last_peered":"2024-02-16T10:31:12.686067+0000","last_clean":"2024-02-16T10:31:12.686067+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:31:12.686067+0000","last_undegraded":"2024-02-16T10:31:12.686067+0000","last_fullsized":"2024-02-16T10:31:12.686067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915272+0000","last_change":"2024-02-16T10:30:26.089582+0000","last_active":"2024-02-16T10:31:06.915272+0000","last_peered":"2024-02-16T10:31:06.915272+0000","last_clean":"2024-02-16T10:31:06.915272+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:31:06.915272+0000","last_undegraded":"2024-02-16T10:31:06.915272+0000","last_fullsized":"2024-02-16T10:31:06.915272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918652+0000","last_change":"2024-02-16T10:30:30.101510+0000","last_active":"2024-02-16T10:31:06.918652+0000","last_peered":"2024-02-16T10:31:06.918652+0000","last_clean":"2024-02-16T10:31:06.918652+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:31:06.918652+0000","last_undegraded":"2024-02-16T10:31:06.918652+0000","last_fullsized":"2024-02-16T10:31:06.918652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:18.360523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:47.841019+0000","last_change":"2024-02-16T10:30:32.096419+0000","last_active":"2024-02-16T10:31:47.841019+0000","last_peered":"2024-02-16T10:31:47.841019+0000","last_clean":"2024-02-16T10:31:47.841019+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:31:47.841019+0000","last_undegraded":"2024-02-16T10:31:47.841019+0000","last_fullsized":"2024-02-16T10:31:47.841019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:42.963873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908228+0000","last_change":"2024-02-16T10:30:34.143222+0000","last_active":"2024-02-16T10:31:06.908228+0000","last_peered":"2024-02-16T10:31:06.908228+0000","last_clean":"2024-02-16T10:31:06.908228+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:31:06.908228+0000","last_undegraded":"2024-02-16T10:31:06.908228+0000","last_fullsized":"2024-02-16T10:31:06.908228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:15.922444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926743+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926743+0000","last_peered":"2024-02-16T10:31:06.926743+0000","last_clean":"2024-02-16T10:31:06.926743+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926743+0000","last_undegraded":"2024-02-16T10:31:06.926743+0000","last_fullsized":"2024-02-16T10:31:06.926743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:59.110103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.998018+0000","last_change":"2024-02-16T10:30:28.063758+0000","last_active":"2024-02-16T10:31:11.998018+0000","last_peered":"2024-02-16T10:31:11.998018+0000","last_clean":"2024-02-16T10:31:11.998018+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:31:11.998018+0000","last_undegraded":"2024-02-16T10:31:11.998018+0000","last_fullsized":"2024-02-16T10:31:11.998018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922326+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:31:06.922326+0000","last_peered":"2024-02-16T10:31:06.922326+0000","last_clean":"2024-02-16T10:31:06.922326+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:31:06.922326+0000","last_undegraded":"2024-02-16T10:31:06.922326+0000","last_fullsized":"2024-02-16T10:31:06.922326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908145+0000","last_change":"2024-02-16T10:30:30.080008+0000","last_active":"2024-02-16T10:31:06.908145+0000","last_peered":"2024-02-16T10:31:06.908145+0000","last_clean":"2024-02-16T10:31:06.908145+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:31:06.908145+0000","last_undegraded":"2024-02-16T10:31:06.908145+0000","last_fullsized":"2024-02-16T10:31:06.908145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:54.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.738535+0000","last_change":"2024-02-16T10:30:32.092783+0000","last_active":"2024-02-16T10:32:00.738535+0000","last_peered":"2024-02-16T10:32:00.738535+0000","last_clean":"2024-02-16T10:32:00.738535+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:00.738535+0000","last_undegraded":"2024-02-16T10:32:00.738535+0000","last_fullsized":"2024-02-16T10:32:00.738535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:45.366198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911478+0000","last_change":"2024-02-16T10:30:34.111884+0000","last_active":"2024-02-16T10:31:06.911478+0000","last_peered":"2024-02-16T10:31:06.911478+0000","last_clean":"2024-02-16T10:31:06.911478+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:31:06.911478+0000","last_undegraded":"2024-02-16T10:31:06.911478+0000","last_fullsized":"2024-02-16T10:31:06.911478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922646+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922646+0000","last_peered":"2024-02-16T10:31:06.922646+0000","last_clean":"2024-02-16T10:31:06.922646+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922646+0000","last_undegraded":"2024-02-16T10:31:06.922646+0000","last_fullsized":"2024-02-16T10:31:06.922646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:05.173479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003196+0000","last_change":"2024-02-16T10:30:28.083725+0000","last_active":"2024-02-16T10:32:01.003196+0000","last_peered":"2024-02-16T10:32:01.003196+0000","last_clean":"2024-02-16T10:32:01.003196+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:01.003196+0000","last_undegraded":"2024-02-16T10:32:01.003196+0000","last_fullsized":"2024-02-16T10:32:01.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:08:02.265809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928210+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:31:06.928210+0000","last_peered":"2024-02-16T10:31:06.928210+0000","last_clean":"2024-02-16T10:31:06.928210+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:31:06.928210+0000","last_undegraded":"2024-02-16T10:31:06.928210+0000","last_fullsized":"2024-02-16T10:31:06.928210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915480+0000","last_change":"2024-02-16T10:30:30.096518+0000","last_active":"2024-02-16T10:31:06.915480+0000","last_peered":"2024-02-16T10:31:06.915480+0000","last_clean":"2024-02-16T10:31:06.915480+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:31:06.915480+0000","last_undegraded":"2024-02-16T10:31:06.915480+0000","last_fullsized":"2024-02-16T10:31:06.915480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:33.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.296534+0000","last_change":"2024-02-16T10:30:32.090307+0000","last_active":"2024-02-16T10:31:55.296534+0000","last_peered":"2024-02-16T10:31:55.296534+0000","last_clean":"2024-02-16T10:31:55.296534+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:31:55.296534+0000","last_undegraded":"2024-02-16T10:31:55.296534+0000","last_fullsized":"2024-02-16T10:31:55.296534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:14.119162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911888+0000","last_change":"2024-02-16T10:30:34.119744+0000","last_active":"2024-02-16T10:31:06.911888+0000","last_peered":"2024-02-16T10:31:06.911888+0000","last_clean":"2024-02-16T10:31:06.911888+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:31:06.911888+0000","last_undegraded":"2024-02-16T10:31:06.911888+0000","last_fullsized":"2024-02-16T10:31:06.911888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:56.895959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498313+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:31:54.498313+0000","last_peered":"2024-02-16T10:31:54.498313+0000","last_clean":"2024-02-16T10:31:54.498313+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:31:54.498313+0000","last_undegraded":"2024-02-16T10:31:54.498313+0000","last_fullsized":"2024-02-16T10:31:54.498313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:27.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912785+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:31:06.912785+0000","last_peered":"2024-02-16T10:31:06.912785+0000","last_clean":"2024-02-16T10:31:06.912785+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:31:06.912785+0000","last_undegraded":"2024-02-16T10:31:06.912785+0000","last_fullsized":"2024-02-16T10:31:06.912785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:54.625844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936294+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:06.936294+0000","last_peered":"2024-02-16T10:31:06.936294+0000","last_clean":"2024-02-16T10:31:06.936294+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:06.936294+0000","last_undegraded":"2024-02-16T10:31:06.936294+0000","last_fullsized":"2024-02-16T10:31:06.936294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:44.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'51","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.941425+0000","last_change":"2024-02-16T10:30:32.092432+0000","last_active":"2024-02-16T10:32:00.941425+0000","last_peered":"2024-02-16T10:32:00.941425+0000","last_clean":"2024-02-16T10:32:00.941425+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:00.941425+0000","last_undegraded":"2024-02-16T10:32:00.941425+0000","last_fullsized":"2024-02-16T10:32:00.941425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:34.487177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913394+0000","last_change":"2024-02-16T10:30:34.119818+0000","last_active":"2024-02-16T10:31:06.913394+0000","last_peered":"2024-02-16T10:31:06.913394+0000","last_clean":"2024-02-16T10:31:06.913394+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:31:06.913394+0000","last_undegraded":"2024-02-16T10:31:06.913394+0000","last_fullsized":"2024-02-16T10:31:06.913394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:36.501122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.987273+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:00.987273+0000","last_peered":"2024-02-16T10:32:00.987273+0000","last_clean":"2024-02-16T10:32:00.987273+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:00.987273+0000","last_undegraded":"2024-02-16T10:32:00.987273+0000","last_fullsized":"2024-02-16T10:32:00.987273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930607+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:31:06.930607+0000","last_peered":"2024-02-16T10:31:06.930607+0000","last_clean":"2024-02-16T10:31:06.930607+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:31:06.930607+0000","last_undegraded":"2024-02-16T10:31:06.930607+0000","last_fullsized":"2024-02-16T10:31:06.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911567+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:31:06.911567+0000","last_peered":"2024-02-16T10:31:06.911567+0000","last_clean":"2024-02-16T10:31:06.911567+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:31:06.911567+0000","last_undegraded":"2024-02-16T10:31:06.911567+0000","last_fullsized":"2024-02-16T10:31:06.911567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:36.991486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917057+0000","last_change":"2024-02-16T10:30:30.075709+0000","last_active":"2024-02-16T10:31:06.917057+0000","last_peered":"2024-02-16T10:31:06.917057+0000","last_clean":"2024-02-16T10:31:06.917057+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:31:06.917057+0000","last_undegraded":"2024-02-16T10:31:06.917057+0000","last_fullsized":"2024-02-16T10:31:06.917057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:26.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.297577+0000","last_change":"2024-02-16T10:30:32.122498+0000","last_active":"2024-02-16T10:31:55.297577+0000","last_peered":"2024-02-16T10:31:55.297577+0000","last_clean":"2024-02-16T10:31:55.297577+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:31:55.297577+0000","last_undegraded":"2024-02-16T10:31:55.297577+0000","last_fullsized":"2024-02-16T10:31:55.297577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:17.677726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925017+0000","last_change":"2024-02-16T10:30:34.125516+0000","last_active":"2024-02-16T10:31:06.925017+0000","last_peered":"2024-02-16T10:31:06.925017+0000","last_clean":"2024-02-16T10:31:06.925017+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:31:06.925017+0000","last_undegraded":"2024-02-16T10:31:06.925017+0000","last_fullsized":"2024-02-16T10:31:06.925017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914711+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914711+0000","last_peered":"2024-02-16T10:31:06.914711+0000","last_clean":"2024-02-16T10:31:06.914711+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914711+0000","last_undegraded":"2024-02-16T10:31:06.914711+0000","last_fullsized":"2024-02-16T10:31:06.914711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:24.665857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354694+0000","last_change":"2024-02-16T10:30:28.087170+0000","last_active":"2024-02-16T10:31:55.354694+0000","last_peered":"2024-02-16T10:31:55.354694+0000","last_clean":"2024-02-16T10:31:55.354694+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:31:55.354694+0000","last_undegraded":"2024-02-16T10:31:55.354694+0000","last_fullsized":"2024-02-16T10:31:55.354694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:43.039912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912283+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912283+0000","last_peered":"2024-02-16T10:31:06.912283+0000","last_clean":"2024-02-16T10:31:06.912283+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912283+0000","last_undegraded":"2024-02-16T10:31:06.912283+0000","last_fullsized":"2024-02-16T10:31:06.912283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915313+0000","last_change":"2024-02-16T10:30:30.076018+0000","last_active":"2024-02-16T10:31:06.915313+0000","last_peered":"2024-02-16T10:31:06.915313+0000","last_clean":"2024-02-16T10:31:06.915313+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:31:06.915313+0000","last_undegraded":"2024-02-16T10:31:06.915313+0000","last_fullsized":"2024-02-16T10:31:06.915313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:08.463191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.324566+0000","last_change":"2024-02-16T10:30:32.119391+0000","last_active":"2024-02-16T10:31:55.324566+0000","last_peered":"2024-02-16T10:31:55.324566+0000","last_clean":"2024-02-16T10:31:55.324566+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:31:55.324566+0000","last_undegraded":"2024-02-16T10:31:55.324566+0000","last_fullsized":"2024-02-16T10:31:55.324566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:54.882014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927434+0000","last_change":"2024-02-16T10:30:34.124775+0000","last_active":"2024-02-16T10:31:06.927434+0000","last_peered":"2024-02-16T10:31:06.927434+0000","last_clean":"2024-02-16T10:31:06.927434+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:31:06.927434+0000","last_undegraded":"2024-02-16T10:31:06.927434+0000","last_fullsized":"2024-02-16T10:31:06.927434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:35.295960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917230+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917230+0000","last_peered":"2024-02-16T10:31:06.917230+0000","last_clean":"2024-02-16T10:31:06.917230+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917230+0000","last_undegraded":"2024-02-16T10:31:06.917230+0000","last_fullsized":"2024-02-16T10:31:06.917230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.882409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930153+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930153+0000","last_peered":"2024-02-16T10:31:06.930153+0000","last_clean":"2024-02-16T10:31:06.930153+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930153+0000","last_undegraded":"2024-02-16T10:31:06.930153+0000","last_fullsized":"2024-02-16T10:31:06.930153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.163010+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.163010+0000","last_peered":"2024-02-16T10:31:11.163010+0000","last_clean":"2024-02-16T10:31:11.163010+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.163010+0000","last_undegraded":"2024-02-16T10:31:11.163010+0000","last_fullsized":"2024-02-16T10:31:11.163010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:31.255409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925657+0000","last_change":"2024-02-16T10:30:30.091253+0000","last_active":"2024-02-16T10:31:06.925657+0000","last_peered":"2024-02-16T10:31:06.925657+0000","last_clean":"2024-02-16T10:31:06.925657+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:31:06.925657+0000","last_undegraded":"2024-02-16T10:31:06.925657+0000","last_fullsized":"2024-02-16T10:31:06.925657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:43.522418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930647+0000","last_change":"2024-02-16T10:30:32.123357+0000","last_active":"2024-02-16T10:31:06.930647+0000","last_peered":"2024-02-16T10:31:06.930647+0000","last_clean":"2024-02-16T10:31:06.930647+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:31:06.930647+0000","last_undegraded":"2024-02-16T10:31:06.930647+0000","last_fullsized":"2024-02-16T10:31:06.930647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:56:50.568670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'240","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.251519+0000","last_change":"2024-02-16T10:30:34.143270+0000","last_active":"2024-02-16T10:32:01.251519+0000","last_peered":"2024-02-16T10:32:01.251519+0000","last_clean":"2024-02-16T10:32:01.251519+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:01.251519+0000","last_undegraded":"2024-02-16T10:32:01.251519+0000","last_fullsized":"2024-02-16T10:32:01.251519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:51.931876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913269+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913269+0000","last_peered":"2024-02-16T10:31:06.913269+0000","last_clean":"2024-02-16T10:31:06.913269+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913269+0000","last_undegraded":"2024-02-16T10:31:06.913269+0000","last_fullsized":"2024-02-16T10:31:06.913269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:47:45.661564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913938+0000","last_change":"2024-02-16T10:30:28.068653+0000","last_active":"2024-02-16T10:31:06.913938+0000","last_peered":"2024-02-16T10:31:06.913938+0000","last_clean":"2024-02-16T10:31:06.913938+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:31:06.913938+0000","last_undegraded":"2024-02-16T10:31:06.913938+0000","last_fullsized":"2024-02-16T10:31:06.913938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:19.170808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.971149+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.971149+0000","last_peered":"2024-02-16T10:31:11.971149+0000","last_clean":"2024-02-16T10:31:11.971149+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.971149+0000","last_undegraded":"2024-02-16T10:31:11.971149+0000","last_fullsized":"2024-02-16T10:31:11.971149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912004+0000","last_change":"2024-02-16T10:30:30.097916+0000","last_active":"2024-02-16T10:31:06.912004+0000","last_peered":"2024-02-16T10:31:06.912004+0000","last_clean":"2024-02-16T10:31:06.912004+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:31:06.912004+0000","last_undegraded":"2024-02-16T10:31:06.912004+0000","last_fullsized":"2024-02-16T10:31:06.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:31.161114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.284137+0000","last_change":"2024-02-16T10:30:32.097289+0000","last_active":"2024-02-16T10:31:55.284137+0000","last_peered":"2024-02-16T10:31:55.284137+0000","last_clean":"2024-02-16T10:31:55.284137+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:31:55.284137+0000","last_undegraded":"2024-02-16T10:31:55.284137+0000","last_fullsized":"2024-02-16T10:31:55.284137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:01.486352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923897+0000","last_change":"2024-02-16T10:30:34.135806+0000","last_active":"2024-02-16T10:31:06.923897+0000","last_peered":"2024-02-16T10:31:06.923897+0000","last_clean":"2024-02-16T10:31:06.923897+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:31:06.923897+0000","last_undegraded":"2024-02-16T10:31:06.923897+0000","last_fullsized":"2024-02-16T10:31:06.923897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.688719+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.688719+0000","last_peered":"2024-02-16T10:31:12.688719+0000","last_clean":"2024-02-16T10:31:12.688719+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.688719+0000","last_undegraded":"2024-02-16T10:31:12.688719+0000","last_fullsized":"2024-02-16T10:31:12.688719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'13","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003577+0000","last_change":"2024-02-16T10:30:28.068349+0000","last_active":"2024-02-16T10:32:01.003577+0000","last_peered":"2024-02-16T10:32:01.003577+0000","last_clean":"2024-02-16T10:32:01.003577+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:01.003577+0000","last_undegraded":"2024-02-16T10:32:01.003577+0000","last_fullsized":"2024-02-16T10:32:01.003577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926497+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926497+0000","last_peered":"2024-02-16T10:31:06.926497+0000","last_clean":"2024-02-16T10:31:06.926497+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926497+0000","last_undegraded":"2024-02-16T10:31:06.926497+0000","last_fullsized":"2024-02-16T10:31:06.926497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:35.881032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914335+0000","last_change":"2024-02-16T10:30:30.074767+0000","last_active":"2024-02-16T10:31:06.914335+0000","last_peered":"2024-02-16T10:31:06.914335+0000","last_clean":"2024-02-16T10:31:06.914335+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:31:06.914335+0000","last_undegraded":"2024-02-16T10:31:06.914335+0000","last_fullsized":"2024-02-16T10:31:06.914335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:17.473427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.286151+0000","last_change":"2024-02-16T10:30:32.089195+0000","last_active":"2024-02-16T10:31:55.286151+0000","last_peered":"2024-02-16T10:31:55.286151+0000","last_clean":"2024-02-16T10:31:55.286151+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:31:55.286151+0000","last_undegraded":"2024-02-16T10:31:55.286151+0000","last_fullsized":"2024-02-16T10:31:55.286151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:43.979549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914695+0000","last_change":"2024-02-16T10:30:34.138612+0000","last_active":"2024-02-16T10:31:06.914695+0000","last_peered":"2024-02-16T10:31:06.914695+0000","last_clean":"2024-02-16T10:31:06.914695+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:31:06.914695+0000","last_undegraded":"2024-02-16T10:31:06.914695+0000","last_fullsized":"2024-02-16T10:31:06.914695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:16.947910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931060+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931060+0000","last_peered":"2024-02-16T10:31:06.931060+0000","last_clean":"2024-02-16T10:31:06.931060+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931060+0000","last_undegraded":"2024-02-16T10:31:06.931060+0000","last_fullsized":"2024-02-16T10:31:06.931060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:04.374041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498061+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.498061+0000","last_peered":"2024-02-16T10:31:54.498061+0000","last_clean":"2024-02-16T10:31:54.498061+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.498061+0000","last_undegraded":"2024-02-16T10:31:54.498061+0000","last_fullsized":"2024-02-16T10:31:54.498061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.347024+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:31:55.347024+0000","last_peered":"2024-02-16T10:31:55.347024+0000","last_clean":"2024-02-16T10:31:55.347024+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:31:55.347024+0000","last_undegraded":"2024-02-16T10:31:55.347024+0000","last_fullsized":"2024-02-16T10:31:55.347024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:13.928686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.910958+0000","last_change":"2024-02-16T10:30:30.098954+0000","last_active":"2024-02-16T10:31:06.910958+0000","last_peered":"2024-02-16T10:31:06.910958+0000","last_clean":"2024-02-16T10:31:06.910958+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:31:06.910958+0000","last_undegraded":"2024-02-16T10:31:06.910958+0000","last_fullsized":"2024-02-16T10:31:06.910958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'25","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.320914+0000","last_change":"2024-02-16T10:30:32.120059+0000","last_active":"2024-02-16T10:31:55.320914+0000","last_peered":"2024-02-16T10:31:55.320914+0000","last_clean":"2024-02-16T10:31:55.320914+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:31:55.320914+0000","last_undegraded":"2024-02-16T10:31:55.320914+0000","last_fullsized":"2024-02-16T10:31:55.320914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:54.720052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915718+0000","last_change":"2024-02-16T10:30:34.139182+0000","last_active":"2024-02-16T10:31:06.915718+0000","last_peered":"2024-02-16T10:31:06.915718+0000","last_clean":"2024-02-16T10:31:06.915718+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:31:06.915718+0000","last_undegraded":"2024-02-16T10:31:06.915718+0000","last_fullsized":"2024-02-16T10:31:06.915718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:33.233363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.660952+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.660952+0000","last_peered":"2024-02-16T10:31:11.660952+0000","last_clean":"2024-02-16T10:31:11.660952+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.660952+0000","last_undegraded":"2024-02-16T10:31:11.660952+0000","last_fullsized":"2024-02-16T10:31:11.660952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:08.234713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.002993+0000","last_change":"2024-02-16T10:30:28.068221+0000","last_active":"2024-02-16T10:32:01.002993+0000","last_peered":"2024-02-16T10:32:01.002993+0000","last_clean":"2024-02-16T10:32:01.002993+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:01.002993+0000","last_undegraded":"2024-02-16T10:32:01.002993+0000","last_fullsized":"2024-02-16T10:32:01.002993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:33.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928894+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:31:06.928894+0000","last_peered":"2024-02-16T10:31:06.928894+0000","last_clean":"2024-02-16T10:31:06.928894+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:31:06.928894+0000","last_undegraded":"2024-02-16T10:31:06.928894+0000","last_fullsized":"2024-02-16T10:31:06.928894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'7","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.193889+0000","last_change":"2024-02-16T10:30:30.090010+0000","last_active":"2024-02-16T10:32:02.193889+0000","last_peered":"2024-02-16T10:32:02.193889+0000","last_clean":"2024-02-16T10:32:02.193889+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:02.193889+0000","last_undegraded":"2024-02-16T10:32:02.193889+0000","last_fullsized":"2024-02-16T10:32:02.193889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:04.245545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.974431+0000","last_change":"2024-02-16T10:30:32.120625+0000","last_active":"2024-02-16T10:32:00.974431+0000","last_peered":"2024-02-16T10:32:00.974431+0000","last_clean":"2024-02-16T10:32:00.974431+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:00.974431+0000","last_undegraded":"2024-02-16T10:32:00.974431+0000","last_fullsized":"2024-02-16T10:32:00.974431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:00:10.689555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926215+0000","last_change":"2024-02-16T10:30:34.104811+0000","last_active":"2024-02-16T10:31:06.926215+0000","last_peered":"2024-02-16T10:31:06.926215+0000","last_clean":"2024-02-16T10:31:06.926215+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:31:06.926215+0000","last_undegraded":"2024-02-16T10:31:06.926215+0000","last_fullsized":"2024-02-16T10:31:06.926215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:05.490555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923461+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923461+0000","last_peered":"2024-02-16T10:31:06.923461+0000","last_clean":"2024-02-16T10:31:06.923461+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923461+0000","last_undegraded":"2024-02-16T10:31:06.923461+0000","last_fullsized":"2024-02-16T10:31:06.923461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:05.711450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930585+0000","last_change":"2024-02-16T10:30:28.085439+0000","last_active":"2024-02-16T10:31:06.930585+0000","last_peered":"2024-02-16T10:31:06.930585+0000","last_clean":"2024-02-16T10:31:06.930585+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:31:06.930585+0000","last_undegraded":"2024-02-16T10:31:06.930585+0000","last_fullsized":"2024-02-16T10:31:06.930585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:24.178735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906798+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:31:06.906798+0000","last_peered":"2024-02-16T10:31:06.906798+0000","last_clean":"2024-02-16T10:31:06.906798+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:31:06.906798+0000","last_undegraded":"2024-02-16T10:31:06.906798+0000","last_fullsized":"2024-02-16T10:31:06.906798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354785+0000","last_change":"2024-02-16T10:30:28.066897+0000","last_active":"2024-02-16T10:31:55.354785+0000","last_peered":"2024-02-16T10:31:55.354785+0000","last_clean":"2024-02-16T10:31:55.354785+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:31:55.354785+0000","last_undegraded":"2024-02-16T10:31:55.354785+0000","last_fullsized":"2024-02-16T10:31:55.354785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924256+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:31:06.924256+0000","last_peered":"2024-02-16T10:31:06.924256+0000","last_clean":"2024-02-16T10:31:06.924256+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:31:06.924256+0000","last_undegraded":"2024-02-16T10:31:06.924256+0000","last_fullsized":"2024-02-16T10:31:06.924256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497934+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:31:54.497934+0000","last_peered":"2024-02-16T10:31:54.497934+0000","last_clean":"2024-02-16T10:31:54.497934+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:31:54.497934+0000","last_undegraded":"2024-02-16T10:31:54.497934+0000","last_fullsized":"2024-02-16T10:31:54.497934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:39.952356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918764+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:31:06.918764+0000","last_peered":"2024-02-16T10:31:06.918764+0000","last_clean":"2024-02-16T10:31:06.918764+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:31:06.918764+0000","last_undegraded":"2024-02-16T10:31:06.918764+0000","last_fullsized":"2024-02-16T10:31:06.918764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:44:00.902889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.367527+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:31:55.367527+0000","last_peered":"2024-02-16T10:31:55.367527+0000","last_clean":"2024-02-16T10:31:55.367527+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:31:55.367527+0000","last_undegraded":"2024-02-16T10:31:55.367527+0000","last_fullsized":"2024-02-16T10:31:55.367527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927369+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:31:06.927369+0000","last_peered":"2024-02-16T10:31:06.927369+0000","last_clean":"2024-02-16T10:31:06.927369+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:31:06.927369+0000","last_undegraded":"2024-02-16T10:31:06.927369+0000","last_fullsized":"2024-02-16T10:31:06.927369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003265+0000","last_change":"2024-02-16T10:30:28.070344+0000","last_active":"2024-02-16T10:32:01.003265+0000","last_peered":"2024-02-16T10:32:01.003265+0000","last_clean":"2024-02-16T10:32:01.003265+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:01.003265+0000","last_undegraded":"2024-02-16T10:32:01.003265+0000","last_fullsized":"2024-02-16T10:32:01.003265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929450+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:31:06.929450+0000","last_peered":"2024-02-16T10:31:06.929450+0000","last_clean":"2024-02-16T10:31:06.929450+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:31:06.929450+0000","last_undegraded":"2024-02-16T10:31:06.929450+0000","last_fullsized":"2024-02-16T10:31:06.929450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922892+0000","last_change":"2024-02-16T10:30:28.084698+0000","last_active":"2024-02-16T10:31:06.922892+0000","last_peered":"2024-02-16T10:31:06.922892+0000","last_clean":"2024-02-16T10:31:06.922892+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:31:06.922892+0000","last_undegraded":"2024-02-16T10:31:06.922892+0000","last_fullsized":"2024-02-16T10:31:06.922892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925916+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:31:06.925916+0000","last_peered":"2024-02-16T10:31:06.925916+0000","last_clean":"2024-02-16T10:31:06.925916+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:31:06.925916+0000","last_undegraded":"2024-02-16T10:31:06.925916+0000","last_fullsized":"2024-02-16T10:31:06.925916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197265+0000","last_change":"2024-02-16T10:30:28.088710+0000","last_active":"2024-02-16T10:31:11.197265+0000","last_peered":"2024-02-16T10:31:11.197265+0000","last_clean":"2024-02-16T10:31:11.197265+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:31:11.197265+0000","last_undegraded":"2024-02-16T10:31:11.197265+0000","last_fullsized":"2024-02-16T10:31:11.197265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922587+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:31:06.922587+0000","last_peered":"2024-02-16T10:31:06.922587+0000","last_clean":"2024-02-16T10:31:06.922587+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:31:06.922587+0000","last_undegraded":"2024-02-16T10:31:06.922587+0000","last_fullsized":"2024-02-16T10:31:06.922587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498941+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:31:54.498941+0000","last_peered":"2024-02-16T10:31:54.498941+0000","last_clean":"2024-02-16T10:31:54.498941+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:31:54.498941+0000","last_undegraded":"2024-02-16T10:31:54.498941+0000","last_fullsized":"2024-02-16T10:31:54.498941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930315+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:31:06.930315+0000","last_peered":"2024-02-16T10:31:06.930315+0000","last_clean":"2024-02-16T10:31:06.930315+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:31:06.930315+0000","last_undegraded":"2024-02-16T10:31:06.930315+0000","last_fullsized":"2024-02-16T10:31:06.930315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:36:57.326356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996262+0000","last_change":"2024-02-16T10:30:28.082754+0000","last_active":"2024-02-16T10:31:11.996262+0000","last_peered":"2024-02-16T10:31:11.996262+0000","last_clean":"2024-02-16T10:31:11.996262+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:31:11.996262+0000","last_undegraded":"2024-02-16T10:31:11.996262+0000","last_fullsized":"2024-02-16T10:31:11.996262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:05:11.823357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913459+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:31:06.913459+0000","last_peered":"2024-02-16T10:31:06.913459+0000","last_clean":"2024-02-16T10:31:06.913459+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:31:06.913459+0000","last_undegraded":"2024-02-16T10:31:06.913459+0000","last_fullsized":"2024-02-16T10:31:06.913459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:00:10.245816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003021+0000","last_change":"2024-02-16T10:30:28.069630+0000","last_active":"2024-02-16T10:32:01.003021+0000","last_peered":"2024-02-16T10:32:01.003021+0000","last_clean":"2024-02-16T10:32:01.003021+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:01.003021+0000","last_undegraded":"2024-02-16T10:32:01.003021+0000","last_fullsized":"2024-02-16T10:32:01.003021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:21:11.835947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924942+0000","last_change":"2024-02-16T10:30:26.099907+0000","last_active":"2024-02-16T10:31:06.924942+0000","last_peered":"2024-02-16T10:31:06.924942+0000","last_clean":"2024-02-16T10:31:06.924942+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:31:06.924942+0000","last_undegraded":"2024-02-16T10:31:06.924942+0000","last_fullsized":"2024-02-16T10:31:06.924942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.687640+0000","last_change":"2024-02-16T10:30:28.065907+0000","last_active":"2024-02-16T10:31:12.687640+0000","last_peered":"2024-02-16T10:31:12.687640+0000","last_clean":"2024-02-16T10:31:12.687640+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:31:12.687640+0000","last_undegraded":"2024-02-16T10:31:12.687640+0000","last_fullsized":"2024-02-16T10:31:12.687640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922132+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:31:06.922132+0000","last_peered":"2024-02-16T10:31:06.922132+0000","last_clean":"2024-02-16T10:31:06.922132+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:31:06.922132+0000","last_undegraded":"2024-02-16T10:31:06.922132+0000","last_fullsized":"2024-02-16T10:31:06.922132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927080+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:31:06.927080+0000","last_peered":"2024-02-16T10:31:06.927080+0000","last_clean":"2024-02-16T10:31:06.927080+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:31:06.927080+0000","last_undegraded":"2024-02-16T10:31:06.927080+0000","last_fullsized":"2024-02-16T10:31:06.927080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:15.461099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919178+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:31:06.919178+0000","last_peered":"2024-02-16T10:31:06.919178+0000","last_clean":"2024-02-16T10:31:06.919178+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:31:06.919178+0000","last_undegraded":"2024-02-16T10:31:06.919178+0000","last_fullsized":"2024-02-16T10:31:06.919178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686094+0000","last_change":"2024-02-16T10:30:28.065620+0000","last_active":"2024-02-16T10:31:12.686094+0000","last_peered":"2024-02-16T10:31:12.686094+0000","last_clean":"2024-02-16T10:31:12.686094+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:31:12.686094+0000","last_undegraded":"2024-02-16T10:31:12.686094+0000","last_fullsized":"2024-02-16T10:31:12.686094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925237+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:31:06.925237+0000","last_peered":"2024-02-16T10:31:06.925237+0000","last_clean":"2024-02-16T10:31:06.925237+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:31:06.925237+0000","last_undegraded":"2024-02-16T10:31:06.925237+0000","last_fullsized":"2024-02-16T10:31:06.925237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:28:35.916782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197558+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:31:11.197558+0000","last_peered":"2024-02-16T10:31:11.197558+0000","last_clean":"2024-02-16T10:31:11.197558+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:31:11.197558+0000","last_undegraded":"2024-02-16T10:31:11.197558+0000","last_fullsized":"2024-02-16T10:31:11.197558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930984+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:31:06.930984+0000","last_peered":"2024-02-16T10:31:06.930984+0000","last_clean":"2024-02-16T10:31:06.930984+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:31:06.930984+0000","last_undegraded":"2024-02-16T10:31:06.930984+0000","last_fullsized":"2024-02-16T10:31:06.930984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:45.770711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003087+0000","last_change":"2024-02-16T10:30:28.087215+0000","last_active":"2024-02-16T10:32:01.003087+0000","last_peered":"2024-02-16T10:32:01.003087+0000","last_clean":"2024-02-16T10:32:01.003087+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:01.003087+0000","last_undegraded":"2024-02-16T10:32:01.003087+0000","last_fullsized":"2024-02-16T10:32:01.003087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:06.402688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923234+0000","last_change":"2024-02-16T10:30:26.083864+0000","last_active":"2024-02-16T10:31:06.923234+0000","last_peered":"2024-02-16T10:31:06.923234+0000","last_clean":"2024-02-16T10:31:06.923234+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:31:06.923234+0000","last_undegraded":"2024-02-16T10:31:06.923234+0000","last_fullsized":"2024-02-16T10:31:06.923234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917305+0000","last_change":"2024-02-16T10:30:28.072935+0000","last_active":"2024-02-16T10:31:06.917305+0000","last_peered":"2024-02-16T10:31:06.917305+0000","last_clean":"2024-02-16T10:31:06.917305+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:31:06.917305+0000","last_undegraded":"2024-02-16T10:31:06.917305+0000","last_fullsized":"2024-02-16T10:31:06.917305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934783+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:31:06.934783+0000","last_peered":"2024-02-16T10:31:06.934783+0000","last_clean":"2024-02-16T10:31:06.934783+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:31:06.934783+0000","last_undegraded":"2024-02-16T10:31:06.934783+0000","last_fullsized":"2024-02-16T10:31:06.934783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:02.701519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.982355+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:31:11.982355+0000","last_peered":"2024-02-16T10:31:11.982355+0000","last_clean":"2024-02-16T10:31:11.982355+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:31:11.982355+0000","last_undegraded":"2024-02-16T10:31:11.982355+0000","last_fullsized":"2024-02-16T10:31:11.982355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:33.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932493+0000","last_change":"2024-02-16T10:30:28.088605+0000","last_active":"2024-02-16T10:31:06.932493+0000","last_peered":"2024-02-16T10:31:06.932493+0000","last_clean":"2024-02-16T10:31:06.932493+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:31:06.932493+0000","last_undegraded":"2024-02-16T10:31:06.932493+0000","last_fullsized":"2024-02-16T10:31:06.932493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925231+0000","last_change":"2024-02-16T10:30:26.100409+0000","last_active":"2024-02-16T10:31:06.925231+0000","last_peered":"2024-02-16T10:31:06.925231+0000","last_clean":"2024-02-16T10:31:06.925231+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:31:06.925231+0000","last_undegraded":"2024-02-16T10:31:06.925231+0000","last_fullsized":"2024-02-16T10:31:06.925231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498959+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.498959+0000","last_peered":"2024-02-16T10:31:54.498959+0000","last_clean":"2024-02-16T10:31:54.498959+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.498959+0000","last_undegraded":"2024-02-16T10:31:54.498959+0000","last_fullsized":"2024-02-16T10:31:54.498959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:02.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705690,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.75}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69299999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":8.2560000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":24.481999999999999,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.503},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":18.614999999999998,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.72899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:10.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-16T10:32:10.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd6561ce640 1 Processor -- start 2024-02-16T10:32:10.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd6561ce640 1 -- start start 2024-02-16T10:32:10.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd6561ce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd65012e3d0 0x7fd65012e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd6561ce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65012ecf0 con 0x7fd65006e050 2024-02-16T10:32:10.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd6561ce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd650071600 con 0x7fd65012e3d0 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd65012e3d0 0x7fd65012e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd65012e3d0 0x7fd65012e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50470/0 (socket says 172.21.15.107:50470) 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64effd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd65006e050 0x7fd65006e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41090/0 (socket says 172.21.15.107:41090) 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64f7fe640 1 -- 172.21.15.107:0/1387212608 learned_addr learned my addr 172.21.15.107:0/1387212608 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64f7fe640 1 -- 172.21.15.107:0/1387212608 >> v1:172.21.15.107:6789/0 conn(0x7fd65006e050 legacy=0x7fd65006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.567+0000 7fd64f7fe640 1 -- 172.21.15.107:0/1387212608 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd650070fc0 con 0x7fd65012e3d0 2024-02-16T10:32:10.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64f7fe640 1 --2- 172.21.15.107:0/1387212608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65012e3d0 0x7fd65012e7b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd6440097f0 tx=0x7fd64401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbd5cc6bf386fbf server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64e7fc640 1 -- 172.21.15.107:0/1387212608 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6440ab530 con 0x7fd65012e3d0 2024-02-16T10:32:10.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64e7fc640 1 -- 172.21.15.107:0/1387212608 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440a7050 con 0x7fd65012e3d0 2024-02-16T10:32:10.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64e7fc640 1 -- 172.21.15.107:0/1387212608 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6440ab7e0 con 0x7fd65012e3d0 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- 172.21.15.107:0/1387212608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65012e3d0 msgr2=0x7fd65012e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 --2- 172.21.15.107:0/1387212608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65012e3d0 0x7fd65012e7b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd6440097f0 tx=0x7fd64401c430 comp rx=0 tx=0).stop 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- 172.21.15.107:0/1387212608 shutdown_connections 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 --2- 172.21.15.107:0/1387212608 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65012e3d0 0x7fd65012e7b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- 172.21.15.107:0/1387212608 >> 172.21.15.107:0/1387212608 conn(0x7fd65009df50 msgr2=0x7fd65006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:10.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- 172.21.15.107:0/1387212608 shutdown_connections 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- 172.21.15.107:0/1387212608 wait complete. 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 Processor -- start 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- start start 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd6561ce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6501203c0 con 0x7fd65006e050 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50480/0 (socket says 172.21.15.107:50480) 2024-02-16T10:32:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.571+0000 7fd64f7fe640 1 -- 172.21.15.107:0/712137954 learned_addr learned my addr 172.21.15.107:0/712137954 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd64f7fe640 1 -- 172.21.15.107:0/712137954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440094d0 con 0x7fd65006e050 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd64f7fe640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd644019040 tx=0x7fd64401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6440b6630 con 0x7fd65006e050 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440b67b0 con 0x7fd65006e050 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd650133c30 con 0x7fd65006e050 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6440b6a90 con 0x7fd65006e050 2024-02-16T10:32:10.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65011f770 con 0x7fd65006e050 2024-02-16T10:32:10.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fd6440b2040 con 0x7fd65006e050 2024-02-16T10:32:10.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd650062980 con 0x7fd65006e050 2024-02-16T10:32:10.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 0x7fd63c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:10.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fd6440e2ef0 con 0x7fd65006e050 2024-02-16T10:32:10.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd64effd640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 0x7fd63c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:10.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.575+0000 7fd64effd640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 0x7fd63c037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd640001600 tx=0x7fd640007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:10.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.579+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6440bd950 con 0x7fd65006e050 2024-02-16T10:32:10.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.747+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd650073f80 con 0x7fd65006e050 2024-02-16T10:32:10.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd637fff640 1 -- 172.21.15.107:0/712137954 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+20936 (secure 0 0 0) 0x7fd6440b0070 con 0x7fd65006e050 2024-02-16T10:32:10.756 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:10.757 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":33,"fsid":"dfa5632e-b877-4440-87a8-22335bb237e0","created":"2024-02-16T10:30:00.867029+0000","modified":"2024-02-16T10:31:06.901524+0000","last_up_change":"2024-02-16T10:30:09.953578+0000","last_in_change":"2024-02-16T10:30:02.125284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-16T10:30:11.897035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-02-16T10:30:16.742733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-02-16T10:30:24.057958+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-02-16T10:30:26.425888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-02-16T10:30:28.225670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-02-16T10:30:30.261846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-02-16T10:30:32.167046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-02-16T10:30:34.313568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e30b1f56-9d73-4706-ad70-510f64ec8246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6801","nonce":1630367885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6803","nonce":1630367885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6807","nonce":1630367885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1630367885},{"type":"v1","addr":"172.21.15.107:6805","nonce":1630367885}]},"public_addr":"172.21.15.107:6801/1630367885","cluster_addr":"172.21.15.107:6803/1630367885","heartbeat_back_addr":"172.21.15.107:6807/1630367885","heartbeat_front_addr":"172.21.15.107:6805/1630367885","state":["exists","up"]},{"osd":1,"uuid":"1da30104-8813-42b7-a590-7292fa7f6ab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6805","nonce":802812406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6810","nonce":802812406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6817","nonce":802812406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":802812406},{"type":"v1","addr":"172.21.15.138:6813","nonce":802812406}]},"public_addr":"172.21.15.138:6805/802812406","cluster_addr":"172.21.15.138:6810/802812406","heartbeat_back_addr":"172.21.15.138:6817/802812406","heartbeat_front_addr":"172.21.15.138:6813/802812406","state":["exists","up"]},{"osd":2,"uuid":"45c7343b-43ff-4d86-8d32-4b563fcd2be0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6815","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6816","nonce":3134970710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6819","nonce":3134970710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6823","nonce":3134970710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3134970710},{"type":"v1","addr":"172.21.15.138:6821","nonce":3134970710}]},"public_addr":"172.21.15.138:6816/3134970710","cluster_addr":"172.21.15.138:6819/3134970710","heartbeat_back_addr":"172.21.15.138:6823/3134970710","heartbeat_front_addr":"172.21.15.138:6821/3134970710","state":["exists","up"]},{"osd":3,"uuid":"04ceea14-48fe-40ac-8dbe-2a18fd6d4796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6801","nonce":756089529}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6804","nonce":756089529}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6809","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6811","nonce":756089529}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":756089529},{"type":"v1","addr":"172.21.15.138:6807","nonce":756089529}]},"public_addr":"172.21.15.138:6801/756089529","cluster_addr":"172.21.15.138:6804/756089529","heartbeat_back_addr":"172.21.15.138:6811/756089529","heartbeat_front_addr":"172.21.15.138:6807/756089529","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.534819+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.231540+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.512871+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-16T10:30:07.523709+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]},{"pgid":"5.15","mappings":[{"from":0,"to":2}]},{"pgid":"5.1e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-16T10:32:10.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 msgr2=0x7fd63c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 0x7fd63c037ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd640001600 tx=0x7fd640007a50 comp rx=0 tx=0).stop 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 msgr2=0x7fd65012ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd644019040 tx=0x7fd64401ac70 comp rx=0 tx=0).stop 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 shutdown_connections 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fd63c035a10 0x7fd63c037ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 --2- 172.21.15.107:0/712137954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65006e050 0x7fd65012ca70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 >> 172.21.15.107:0/712137954 conn(0x7fd65009df50 msgr2=0x7fd650132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:10.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 shutdown_connections 2024-02-16T10:32:10.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:10.751+0000 7fd6561ce640 1 -- 172.21.15.107:0/712137954 wait complete. 2024-02-16T10:32:11.774 INFO:tasks.ceph:Scrubbing osd.0 2024-02-16T10:32:11.775 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:32:11.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc972216640 1 Processor -- start 2024-02-16T10:32:11.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc972216640 1 -- start start 2024-02-16T10:32:11.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc972216640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc96c12de40 0x7fc96c130230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc972216640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c12aad0 con 0x7fc96c12af00 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc972216640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c12b9f0 con 0x7fc96c12de40 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc96affd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc96c12de40 0x7fc96c130230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc96b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc96c12af00 0x7fc96c12b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41098/0 (socket says 172.21.15.107:41098) 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc96b7fe640 1 -- 172.21.15.107:0/2567148560 learned_addr learned my addr 172.21.15.107:0/2567148560 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc96affd640 1 -- 172.21.15.107:0/2567148560 >> v1:172.21.15.107:6789/0 conn(0x7fc96c12af00 legacy=0x7fc96c12b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:11.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.903+0000 7fc96affd640 1 -- 172.21.15.107:0/2567148560 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c12ad00 con 0x7fc96c12de40 2024-02-16T10:32:11.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96affd640 1 --2- 172.21.15.107:0/2567148560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12de40 0x7fc96c130230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc960009740 tx=0x7fc96001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69090e1b7ed7da6f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:11.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96a7fc640 1 -- 172.21.15.107:0/2567148560 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9600ab530 con 0x7fc96c12de40 2024-02-16T10:32:11.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96a7fc640 1 -- 172.21.15.107:0/2567148560 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9600a7050 con 0x7fc96c12de40 2024-02-16T10:32:11.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96a7fc640 1 -- 172.21.15.107:0/2567148560 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9600ab7e0 con 0x7fc96c12de40 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- 172.21.15.107:0/2567148560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12de40 msgr2=0x7fc96c130230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 --2- 172.21.15.107:0/2567148560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12de40 0x7fc96c130230 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc960009740 tx=0x7fc96001c370 comp rx=0 tx=0).stop 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- 172.21.15.107:0/2567148560 shutdown_connections 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 --2- 172.21.15.107:0/2567148560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12de40 0x7fc96c130230 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- 172.21.15.107:0/2567148560 >> 172.21.15.107:0/2567148560 conn(0x7fc96c09a390 msgr2=0x7fc96c09a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:11.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- 172.21.15.107:0/2567148560 shutdown_connections 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- 172.21.15.107:0/2567148560 wait complete. 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 Processor -- start 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- start start 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc972216640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c126ea0 con 0x7fc96c12af00 2024-02-16T10:32:11.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50492/0 (socket says 172.21.15.107:50492) 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96b7fe640 1 -- 172.21.15.107:0/2722329930 learned_addr learned my addr 172.21.15.107:0/2722329930 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.907+0000 7fc96b7fe640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009420 con 0x7fc96c12af00 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc96b7fe640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c480 tx=0x7fc95c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc95c005c20 con 0x7fc96c12af00 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c005d80 con 0x7fc96c12af00 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c127690 con 0x7fc96c12af00 2024-02-16T10:32:11.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc95c0071a0 con 0x7fc96c12af00 2024-02-16T10:32:11.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c124ea0 con 0x7fc96c12af00 2024-02-16T10:32:11.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc96c06c3e0 con 0x7fc96c12af00 2024-02-16T10:32:11.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fc95c007300 con 0x7fc96c12af00 2024-02-16T10:32:11.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 0x7fc958037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:11.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fc95c047d30 con 0x7fc96c12af00 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 0x7fc9580442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc958044970 con 0x7fc958041e00 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95c04a3a0 con 0x7fc96c12af00 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc96bfff640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 0x7fc9580442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc96affd640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 0x7fc958037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc96bfff640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 0x7fc9580442a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:11.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc96affd640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 0x7fc958037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ad000 tx=0x7fc960008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:11.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.911+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== osd.0 v2:172.21.15.107:6800/1630367885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc958044970 con 0x7fc958041e00 2024-02-16T10:32:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.923+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 --> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc96c062980 con 0x7fc958041e00 2024-02-16T10:32:11.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.923+0000 7fc953fff640 1 -- 172.21.15.107:0/2722329930 <== osd.0 v2:172.21.15.107:6800/1630367885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc96c062980 con 0x7fc958041e00 2024-02-16T10:32:11.930 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-02-16T10:32:11.931 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:32:11.931 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-02-16T10:32:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 msgr2=0x7fc9580442a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 0x7fc9580442a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 msgr2=0x7fc958037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:11.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 0x7fc958037ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ad000 tx=0x7fc960008040 comp rx=0 tx=0).stop 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 msgr2=0x7fc96c125260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c480 tx=0x7fc95c00c940 comp rx=0 tx=0).stop 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 shutdown_connections 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:6800/1630367885,v1:172.21.15.107:6801/1630367885] conn(0x7fc958041e00 0x7fc9580442a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fc958035a10 0x7fc958037ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 --2- 172.21.15.107:0/2722329930 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc96c12af00 0x7fc96c125260 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:11.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 >> 172.21.15.107:0/2722329930 conn(0x7fc96c09a390 msgr2=0x7fc96c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 shutdown_connections 2024-02-16T10:32:11.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:11.927+0000 7fc972216640 1 -- 172.21.15.107:0/2722329930 wait complete. 2024-02-16T10:32:11.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-16T10:32:12.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf774b5640 1 Processor -- start 2024-02-16T10:32:12.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf774b5640 1 -- start start 2024-02-16T10:32:12.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf774b5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf7012e840 0x7fdf7006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf774b5640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700700c0 con 0x7fdf7012e460 2024-02-16T10:32:12.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf774b5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70070730 con 0x7fdf7012e840 2024-02-16T10:32:12.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf7012e840 0x7fdf7006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdf7012e840 0x7fdf7006e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50494/0 (socket says 172.21.15.107:50494) 2024-02-16T10:32:12.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 -- 172.21.15.107:0/3448029138 learned_addr learned my addr 172.21.15.107:0/3448029138 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 -- 172.21.15.107:0/3448029138 >> v1:172.21.15.107:6789/0 conn(0x7fdf7012e460 legacy=0x7fdf7006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 -- 172.21.15.107:0/3448029138 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70070fd0 con 0x7fdf7012e840 2024-02-16T10:32:12.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf67fff640 1 -- 172.21.15.107:0/3448029138 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645906555 0 0) 0x7fdf700700c0 con 0x7fdf7012e460 2024-02-16T10:32:12.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.055+0000 7fdf74a50640 1 --2- 172.21.15.107:0/3448029138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e840 0x7fdf7006e550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fdf600097f0 tx=0x7fdf6001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c754a3d86e528309 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf67fff640 1 -- 172.21.15.107:0/3448029138 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf600ac570 con 0x7fdf7012e840 2024-02-16T10:32:12.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf67fff640 1 -- 172.21.15.107:0/3448029138 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf600ac6d0 con 0x7fdf7012e840 2024-02-16T10:32:12.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf67fff640 1 -- 172.21.15.107:0/3448029138 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf600ac990 con 0x7fdf7012e840 2024-02-16T10:32:12.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/3448029138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e840 msgr2=0x7fdf7006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 --2- 172.21.15.107:0/3448029138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e840 0x7fdf7006e550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fdf600097f0 tx=0x7fdf6001c400 comp rx=0 tx=0).stop 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/3448029138 shutdown_connections 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 --2- 172.21.15.107:0/3448029138 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e840 0x7fdf7006e550 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/3448029138 >> 172.21.15.107:0/3448029138 conn(0x7fdf7009dd80 msgr2=0x7fdf7006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/3448029138 shutdown_connections 2024-02-16T10:32:12.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/3448029138 wait complete. 2024-02-16T10:32:12.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 Processor -- start 2024-02-16T10:32:12.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- start start 2024-02-16T10:32:12.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70118e80 con 0x7fdf7012e460 2024-02-16T10:32:12.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf75251640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf75251640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50508/0 (socket says 172.21.15.107:50508) 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf75251640 1 -- 172.21.15.107:0/526438532 learned_addr learned my addr 172.21.15.107:0/526438532 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf75251640 1 -- 172.21.15.107:0/526438532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600094d0 con 0x7fdf7012e460 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf75251640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c400 tx=0x7fdf6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0054d0 con 0x7fdf7012e460 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c003600 con 0x7fdf7012e460 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70119e40 con 0x7fdf7012e460 2024-02-16T10:32:12.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c003960 con 0x7fdf7012e460 2024-02-16T10:32:12.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.059+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70133010 con 0x7fdf7012e460 2024-02-16T10:32:12.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf70133790 con 0x7fdf7012e460 2024-02-16T10:32:12.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fdf6c003ac0 con 0x7fdf7012e460 2024-02-16T10:32:12.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf65ffb640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 0x7fdf54037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fdf6c047e10 con 0x7fdf7012e460 2024-02-16T10:32:12.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf74a50640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 0x7fdf54037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.063+0000 7fdf74a50640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 0x7fdf54037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf600ae000 tx=0x7fdf60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.067+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf6c019bc0 con 0x7fdf7012e460 2024-02-16T10:32:12.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.227+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf70062980 con 0x7fdf54035a10 2024-02-16T10:32:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.227+0000 7fdf65ffb640 1 -- 172.21.15.107:0/526438532 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdf70062980 con 0x7fdf54035a10 2024-02-16T10:32:12.234 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 msgr2=0x7fdf54037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 0x7fdf54037ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf600ae000 tx=0x7fdf60008040 comp rx=0 tx=0).stop 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 msgr2=0x7fdf70116cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c400 tx=0x7fdf6c00c8c0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 shutdown_connections 2024-02-16T10:32:12.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fdf54035a10 0x7fdf54037ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 --2- 172.21.15.107:0/526438532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf7012e460 0x7fdf70116cb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 >> 172.21.15.107:0/526438532 conn(0x7fdf7009dd80 msgr2=0x7fdf7009e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 shutdown_connections 2024-02-16T10:32:12.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.231+0000 7fdf774b5640 1 -- 172.21.15.107:0/526438532 wait complete. 2024-02-16T10:32:12.253 INFO:tasks.ceph:Scrubbing osd.1 2024-02-16T10:32:12.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:32:12.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e9446640 1 Processor -- start 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e9446640 1 -- start start 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e9446640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb2e406c6a0 0x7fb2e4130ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e9446640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e4067600 con 0x7fb2e412c060 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e9446640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e412be60 con 0x7fb2e406c6a0 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e2ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb2e412c060 0x7fb2e412c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41112/0 (socket says 172.21.15.107:41112) 2024-02-16T10:32:12.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e2ffd640 1 -- 172.21.15.107:0/1530385579 learned_addr learned my addr 172.21.15.107:0/1530385579 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:12.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e27fc640 1 --2- 172.21.15.107:0/1530385579 >> v2:172.21.15.107:3300/0 conn(0x7fb2e406c6a0 0x7fb2e4130ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e1ffb640 1 -- 172.21.15.107:0/1530385579 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907702547 0 0) 0x7fb2e4067600 con 0x7fb2e412c060 2024-02-16T10:32:12.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e1ffb640 1 -- 172.21.15.107:0/1530385579 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2cc003530 con 0x7fb2e412c060 2024-02-16T10:32:12.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e27fc640 1 -- 172.21.15.107:0/1530385579 >> v1:172.21.15.107:6789/0 conn(0x7fb2e412c060 legacy=0x7fb2e412c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.363+0000 7fb2e27fc640 1 -- 172.21.15.107:0/1530385579 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e406d0f0 con 0x7fb2e406c6a0 2024-02-16T10:32:12.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e27fc640 1 --2- 172.21.15.107:0/1530385579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4130ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009740 tx=0x7fb2d801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6b2af0b9f47be3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e1ffb640 1 -- 172.21.15.107:0/1530385579 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80ac570 con 0x7fb2e406c6a0 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e1ffb640 1 -- 172.21.15.107:0/1530385579 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d80ac6d0 con 0x7fb2e406c6a0 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e1ffb640 1 -- 172.21.15.107:0/1530385579 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80ac970 con 0x7fb2e406c6a0 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/1530385579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 msgr2=0x7fb2e4130ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 --2- 172.21.15.107:0/1530385579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4130ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009740 tx=0x7fb2d801c400 comp rx=0 tx=0).stop 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/1530385579 shutdown_connections 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 --2- 172.21.15.107:0/1530385579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4130ed0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/1530385579 >> 172.21.15.107:0/1530385579 conn(0x7fb2e409cda0 msgr2=0x7fb2e406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/1530385579 shutdown_connections 2024-02-16T10:32:12.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/1530385579 wait complete. 2024-02-16T10:32:12.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 Processor -- start 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- start start 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4114720 con 0x7fb2e406c6a0 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50534/0 (socket says 172.21.15.107:50534) 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e2ffd640 1 -- 172.21.15.107:0/3522972130 learned_addr learned my addr 172.21.15.107:0/3522972130 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e2ffd640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009420 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e2ffd640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c3d0 tx=0x7fb2d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d4005ce0 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4005e40 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.367+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4113f30 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2d4007220 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4130450 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2e4129ac0 con 0x7fb2e406c6a0 2024-02-16T10:32:12.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb2d4007440 con 0x7fb2e406c6a0 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 0x7fb2d0037e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb2d4047eb0 con 0x7fb2e406c6a0 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 0x7fb2d00442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2d0044980 con 0x7fb2d0041e10 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2d404a520 con 0x7fb2e406c6a0 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e27fc640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 0x7fb2d0037e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e37fe640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 0x7fb2d00442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e27fc640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 0x7fb2d0037e80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80ae000 tx=0x7fb2d80a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2e37fe640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 0x7fb2d00442b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.371+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== osd.1 v2:172.21.15.138:6802/802812406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb2d0044980 con 0x7fb2d0041e10 2024-02-16T10:32:12.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 --> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb2e4114c90 con 0x7fb2d0041e10 2024-02-16T10:32:12.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2cb7fe640 1 -- 172.21.15.107:0/3522972130 <== osd.1 v2:172.21.15.138:6802/802812406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb2e4114c90 con 0x7fb2d0041e10 2024-02-16T10:32:12.392 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-02-16T10:32:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:32:12.393 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 msgr2=0x7fb2d00442b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 0x7fb2d00442b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 msgr2=0x7fb2d0037e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 0x7fb2d0037e80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80ae000 tx=0x7fb2d80a6070 comp rx=0 tx=0).stop 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 msgr2=0x7fb2e4121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c3d0 tx=0x7fb2d400c890 comp rx=0 tx=0).stop 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 shutdown_connections 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6802/802812406,v1:172.21.15.138:6805/802812406] conn(0x7fb2d0041e10 0x7fb2d00442b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb2d00359c0 0x7fb2d0037e80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 --2- 172.21.15.107:0/3522972130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb2e406c6a0 0x7fb2e4121640 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 >> 172.21.15.107:0/3522972130 conn(0x7fb2e409cda0 msgr2=0x7fb2e4125100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 shutdown_connections 2024-02-16T10:32:12.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.387+0000 7fb2e9446640 1 -- 172.21.15.107:0/3522972130 wait complete. 2024-02-16T10:32:12.406 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-16T10:32:12.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-02-16T10:32:12.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.503+0000 7ffba6b40640 1 Processor -- start 2024-02-16T10:32:12.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.503+0000 7ffba6b40640 1 -- start start 2024-02-16T10:32:12.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffba012ef80 0x7ffba0131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba0072450 con 0x7ffba006f8b0 2024-02-16T10:32:12.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba012bed0 con 0x7ffba012ef80 2024-02-16T10:32:12.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffba012ef80 0x7ffba0131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba48dc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffba006f8b0 0x7ffba012c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41124/0 (socket says 172.21.15.107:41124) 2024-02-16T10:32:12.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba48dc640 1 -- 172.21.15.107:0/1552728670 learned_addr learned my addr 172.21.15.107:0/1552728670 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:12.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9ffff640 1 -- 172.21.15.107:0/1552728670 >> v1:172.21.15.107:6789/0 conn(0x7ffba006f8b0 legacy=0x7ffba012c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9ffff640 1 -- 172.21.15.107:0/1552728670 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0112bd0 con 0x7ffba012ef80 2024-02-16T10:32:12.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9ffff640 1 --2- 172.21.15.107:0/1552728670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba012ef80 0x7ffba0131370 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009740 tx=0x7ffb8801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319951af4b1f2168 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9f7fe640 1 -- 172.21.15.107:0/1552728670 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb880ab530 con 0x7ffba012ef80 2024-02-16T10:32:12.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9f7fe640 1 -- 172.21.15.107:0/1552728670 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb880a7050 con 0x7ffba012ef80 2024-02-16T10:32:12.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffb9f7fe640 1 -- 172.21.15.107:0/1552728670 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb880ab7e0 con 0x7ffba012ef80 2024-02-16T10:32:12.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- 172.21.15.107:0/1552728670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba012ef80 msgr2=0x7ffba0131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 --2- 172.21.15.107:0/1552728670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba012ef80 0x7ffba0131370 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009740 tx=0x7ffb8801c370 comp rx=0 tx=0).stop 2024-02-16T10:32:12.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- 172.21.15.107:0/1552728670 shutdown_connections 2024-02-16T10:32:12.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 --2- 172.21.15.107:0/1552728670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba012ef80 0x7ffba0131370 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- 172.21.15.107:0/1552728670 >> 172.21.15.107:0/1552728670 conn(0x7ffba009a1c0 msgr2=0x7ffba009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- 172.21.15.107:0/1552728670 shutdown_connections 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.507+0000 7ffba6b40640 1 -- 172.21.15.107:0/1552728670 wait complete. 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 Processor -- start 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 -- start start 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0124b40 con 0x7ffba006f8b0 2024-02-16T10:32:12.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba48dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba48dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50548/0 (socket says 172.21.15.107:50548) 2024-02-16T10:32:12.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba48dc640 1 -- 172.21.15.107:0/903579953 learned_addr learned my addr 172.21.15.107:0/903579953 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba48dc640 1 -- 172.21.15.107:0/903579953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88009420 con 0x7ffba006f8b0 2024-02-16T10:32:12.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba48dc640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c480 tx=0x7ffb9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb90005c20 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90005d80 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0128190 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb900071a0 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba0125680 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7ffb90007300 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0125240 con 0x7ffba006f8b0 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 0x7ffb84037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ffb90047d30 con 0x7ffba006f8b0 2024-02-16T10:32:12.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9ffff640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 0x7ffb84037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.511+0000 7ffb9ffff640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 0x7ffb84037f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffb880ad000 tx=0x7ffb880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.515+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffba0125240 con 0x7ffba006f8b0 2024-02-16T10:32:12.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.663+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffba012cb30 con 0x7ffb84035a40 2024-02-16T10:32:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffb9d7fa640 1 -- 172.21.15.107:0/903579953 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb880ab780 con 0x7ffb84035a40 2024-02-16T10:32:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 msgr2=0x7ffb84037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 0x7ffb84037f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffb880ad000 tx=0x7ffb880a6000 comp rx=0 tx=0).stop 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 msgr2=0x7ffba01220c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c480 tx=0x7ffb9000c940 comp rx=0 tx=0).stop 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 shutdown_connections 2024-02-16T10:32:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7ffb84035a40 0x7ffb84037f00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 --2- 172.21.15.107:0/903579953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffba006f8b0 0x7ffba01220c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 >> 172.21.15.107:0/903579953 conn(0x7ffba009a1c0 msgr2=0x7ffba0126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 shutdown_connections 2024-02-16T10:32:12.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.667+0000 7ffba6b40640 1 -- 172.21.15.107:0/903579953 wait complete. 2024-02-16T10:32:12.687 INFO:tasks.ceph:Scrubbing osd.2 2024-02-16T10:32:12.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:32:12.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bf7fd640 1 Processor -- start 2024-02-16T10:32:12.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bf7fd640 1 -- start start 2024-02-16T10:32:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bf7fd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79b812f030 0x7f79b8131420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bf7fd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b809ae90 con 0x7f79b812c0e0 2024-02-16T10:32:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bf7fd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80682c0 con 0x7f79b812f030 2024-02-16T10:32:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bd599640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f79b812c0e0 0x7f79b812c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41140/0 (socket says 172.21.15.107:41140) 2024-02-16T10:32:12.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bd599640 1 -- 172.21.15.107:0/4001911578 learned_addr learned my addr 172.21.15.107:0/4001911578 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bcd98640 1 --2- 172.21.15.107:0/4001911578 >> v2:172.21.15.107:3300/0 conn(0x7f79b812f030 0x7f79b8131420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bcd98640 1 -- 172.21.15.107:0/4001911578 >> v1:172.21.15.107:6789/0 conn(0x7f79b812c0e0 legacy=0x7f79b812c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79bcd98640 1 -- 172.21.15.107:0/4001911578 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b809ab10 con 0x7f79b812f030 2024-02-16T10:32:12.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.807+0000 7f79affff640 1 -- 172.21.15.107:0/4001911578 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648264235 0 0) 0x7f79b809ae90 con 0x7f79b812c0e0 2024-02-16T10:32:12.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bcd98640 1 --2- 172.21.15.107:0/4001911578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812f030 0x7f79b8131420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009740 tx=0x7f79b401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162094ce1190c5e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79affff640 1 -- 172.21.15.107:0/4001911578 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40a8050 con 0x7f79b812f030 2024-02-16T10:32:12.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79affff640 1 -- 172.21.15.107:0/4001911578 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40ac520 con 0x7f79b812f030 2024-02-16T10:32:12.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79affff640 1 -- 172.21.15.107:0/4001911578 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79b40ac7e0 con 0x7f79b812f030 2024-02-16T10:32:12.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- 172.21.15.107:0/4001911578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812f030 msgr2=0x7f79b8131420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/4001911578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812f030 0x7f79b8131420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009740 tx=0x7f79b401c370 comp rx=0 tx=0).stop 2024-02-16T10:32:12.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- 172.21.15.107:0/4001911578 shutdown_connections 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/4001911578 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812f030 0x7f79b8131420 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- 172.21.15.107:0/4001911578 >> 172.21.15.107:0/4001911578 conn(0x7f79b809d2c0 msgr2=0x7f79b809d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- 172.21.15.107:0/4001911578 shutdown_connections 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- 172.21.15.107:0/4001911578 wait complete. 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 Processor -- start 2024-02-16T10:32:12.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- start start 2024-02-16T10:32:12.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bf7fd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b811de00 con 0x7f79b812c0e0 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bd599640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bd599640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50564/0 (socket says 172.21.15.107:50564) 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bd599640 1 -- 172.21.15.107:0/2694144870 learned_addr learned my addr 172.21.15.107:0/2694144870 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.811+0000 7f79bd599640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4009420 con 0x7f79b812c0e0 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bd599640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c420 tx=0x7f79a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a80074d0 con 0x7f79b812c0e0 2024-02-16T10:32:12.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8007630 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b811c5c0 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a8004960 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b811cd90 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79b811dfa0 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f79a8004ac0 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 0x7f799c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f79a8047dc0 con 0x7f79b812c0e0 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 0x7f799c0442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f799c044970 con 0x7f799c041e00 2024-02-16T10:32:12.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79a804a430 con 0x7f79b812c0e0 2024-02-16T10:32:12.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bcd98640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 0x7f799c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bdd9a640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 0x7f799c0442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bdd9a640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 0x7f799c0442a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.815+0000 7f79bcd98640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 0x7f799c037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79b40ae000 tx=0x7f79b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.819+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== osd.2 v2:172.21.15.138:6815/3134970710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f799c044970 con 0x7f799c041e00 2024-02-16T10:32:12.836 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 --> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79b8134180 con 0x7f799c041e00 2024-02-16T10:32:12.837 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79adffb640 1 -- 172.21.15.107:0/2694144870 <== osd.2 v2:172.21.15.138:6815/3134970710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f79b0011040 con 0x7f799c041e00 2024-02-16T10:32:12.837 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-02-16T10:32:12.837 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:32:12.837 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-02-16T10:32:12.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 msgr2=0x7f799c0442a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.838 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 0x7f799c0442a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 msgr2=0x7f799c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 0x7f799c037ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79b40ae000 tx=0x7f79b4008040 comp rx=0 tx=0).stop 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 msgr2=0x7f79b812a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c420 tx=0x7f79a800c8e0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 shutdown_connections 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6815/3134970710,v1:172.21.15.138:6816/3134970710] conn(0x7f799c041e00 0x7f799c0442a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.839 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f799c035a10 0x7f799c037ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 --2- 172.21.15.107:0/2694144870 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79b812c0e0 0x7f79b812a4c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 >> 172.21.15.107:0/2694144870 conn(0x7f79b809d2c0 msgr2=0x7f79b8071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 shutdown_connections 2024-02-16T10:32:12.840 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.831+0000 7f79bf7fd640 1 -- 172.21.15.107:0/2694144870 wait complete. 2024-02-16T10:32:12.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-16T10:32:12.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4ecb2b640 1 Processor -- start 2024-02-16T10:32:12.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4ecb2b640 1 -- start start 2024-02-16T10:32:12.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4ecb2b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4e806f8b0 0x7fa4e812c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4ecb2b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e8072450 con 0x7fa4e812c750 2024-02-16T10:32:12.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4ecb2b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e812cb60 con 0x7fa4e806f8b0 2024-02-16T10:32:12.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e659c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa4e806f8b0 0x7fa4e812c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4dffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa4e812c750 0x7fa4e8128690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41144/0 (socket says 172.21.15.107:41144) 2024-02-16T10:32:12.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4dffff640 1 -- 172.21.15.107:0/3069173778 learned_addr learned my addr 172.21.15.107:0/3069173778 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:12.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e659c640 1 -- 172.21.15.107:0/3069173778 >> v1:172.21.15.107:6789/0 conn(0x7fa4e812c750 legacy=0x7fa4e8128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e659c640 1 -- 172.21.15.107:0/3069173778 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e812bed0 con 0x7fa4e806f8b0 2024-02-16T10:32:12.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e659c640 1 --2- 172.21.15.107:0/3069173778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812c210 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009740 tx=0x7fa4d001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07c459e3b8f4f9a server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e5d9b640 1 -- 172.21.15.107:0/3069173778 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00ab530 con 0x7fa4e806f8b0 2024-02-16T10:32:12.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e5d9b640 1 -- 172.21.15.107:0/3069173778 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d00a7050 con 0x7fa4e806f8b0 2024-02-16T10:32:12.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.967+0000 7fa4e5d9b640 1 -- 172.21.15.107:0/3069173778 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00ab7e0 con 0x7fa4e806f8b0 2024-02-16T10:32:12.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/3069173778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 msgr2=0x7fa4e812c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:12.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/3069173778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812c210 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009740 tx=0x7fa4d001c370 comp rx=0 tx=0).stop 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/3069173778 shutdown_connections 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/3069173778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812c210 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/3069173778 >> 172.21.15.107:0/3069173778 conn(0x7fa4e809a1c0 msgr2=0x7fa4e809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/3069173778 shutdown_connections 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/3069173778 wait complete. 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 Processor -- start 2024-02-16T10:32:12.976 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- start start 2024-02-16T10:32:12.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8114380 con 0x7fa4e806f8b0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4e659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50576/0 (socket says 172.21.15.107:50576) 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4e659c640 1 -- 172.21.15.107:0/4004209714 learned_addr learned my addr 172.21.15.107:0/4004209714 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4e659c640 1 -- 172.21.15.107:0/4004209714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009420 con 0x7fa4e806f8b0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4e659c640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0019fa0 tx=0x7fa4d0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00abea0 con 0x7fa4e806f8b0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e81134c0 con 0x7fa4e806f8b0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e8114e30 con 0x7fa4e806f8b0 2024-02-16T10:32:12.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00b4540 con 0x7fa4e806f8b0 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e8114560 con 0x7fa4e806f8b0 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fa4d00b2040 con 0x7fa4e806f8b0 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e8062980 con 0x7fa4e806f8b0 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 0x7fa4c8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fa4d00e2850 con 0x7fa4e806f8b0 2024-02-16T10:32:12.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.971+0000 7fa4dffff640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 0x7fa4c8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:12.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.975+0000 7fa4dffff640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 0x7fa4c8037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001610 tx=0x7fa4d8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:12.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:12.975+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa4d00bc3b0 con 0x7fa4e806f8b0 2024-02-16T10:32:13.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.135+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4e8114160 con 0x7fa4c8035a10 2024-02-16T10:32:13.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.135+0000 7fa4deffd640 1 -- 172.21.15.107:0/4004209714 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4e8114160 con 0x7fa4c8035a10 2024-02-16T10:32:13.142 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2024-02-16T10:32:13.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 msgr2=0x7fa4c8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 0x7fa4c8037ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001610 tx=0x7fa4d8007ad0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 msgr2=0x7fa4e812faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0019fa0 tx=0x7fa4d0019110 comp rx=0 tx=0).stop 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 shutdown_connections 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fa4c8035a10 0x7fa4c8037ed0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 --2- 172.21.15.107:0/4004209714 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4e806f8b0 0x7fa4e812faf0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 >> 172.21.15.107:0/4004209714 conn(0x7fa4e809a1c0 msgr2=0x7fa4e806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 shutdown_connections 2024-02-16T10:32:13.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.139+0000 7fa4ecb2b640 1 -- 172.21.15.107:0/4004209714 wait complete. 2024-02-16T10:32:13.160 INFO:tasks.ceph:Scrubbing osd.3 2024-02-16T10:32:13.161 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-16T10:32:13.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.279+0000 7f9a35937640 1 Processor -- start 2024-02-16T10:32:13.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.279+0000 7f9a35937640 1 -- start start 2024-02-16T10:32:13.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.279+0000 7f9a35937640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a30126c60 0x7f9a30127040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.279+0000 7f9a35937640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a30071e90 con 0x7f9a30127580 2024-02-16T10:32:13.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.279+0000 7f9a35937640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a30070ae0 con 0x7f9a30126c60 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9a30126c60 0x7f9a30127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a267fc640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9a30127580 0x7f9a3012a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41154/0 (socket says 172.21.15.107:41154) 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a267fc640 1 -- 172.21.15.107:0/2301957353 learned_addr learned my addr 172.21.15.107:0/2301957353 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2effd640 1 -- 172.21.15.107:0/2301957353 >> v1:172.21.15.107:6789/0 conn(0x7f9a30127580 legacy=0x7f9a3012a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2effd640 1 -- 172.21.15.107:0/2301957353 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30071b80 con 0x7f9a30126c60 2024-02-16T10:32:13.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2e7fc640 1 -- 172.21.15.107:0/2301957353 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173030014 0 0) 0x7f9a30071e90 con 0x7f9a30127580 2024-02-16T10:32:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2effd640 1 --2- 172.21.15.107:0/2301957353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a30127040 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a8e0 tx=0x7f9a2001d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a9363225a68c74 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2e7fc640 1 -- 172.21.15.107:0/2301957353 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a200a66e0 con 0x7f9a30126c60 2024-02-16T10:32:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2e7fc640 1 -- 172.21.15.107:0/2301957353 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200a6840 con 0x7f9a30126c60 2024-02-16T10:32:13.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a2e7fc640 1 -- 172.21.15.107:0/2301957353 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a200a6b00 con 0x7f9a30126c60 2024-02-16T10:32:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 -- 172.21.15.107:0/2301957353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 msgr2=0x7f9a30127040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 --2- 172.21.15.107:0/2301957353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a30127040 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000a8e0 tx=0x7f9a2001d740 comp rx=0 tx=0).stop 2024-02-16T10:32:13.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 -- 172.21.15.107:0/2301957353 shutdown_connections 2024-02-16T10:32:13.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 --2- 172.21.15.107:0/2301957353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a30127040 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 -- 172.21.15.107:0/2301957353 >> 172.21.15.107:0/2301957353 conn(0x7f9a3009a390 msgr2=0x7f9a3009a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 -- 172.21.15.107:0/2301957353 shutdown_connections 2024-02-16T10:32:13.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.283+0000 7f9a35937640 1 -- 172.21.15.107:0/2301957353 wait complete. 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 Processor -- start 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 -- start start 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a301263d0 con 0x7f9a30126c60 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50606/0 (socket says 172.21.15.107:50606) 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2effd640 1 -- 172.21.15.107:0/222379637 learned_addr learned my addr 172.21.15.107:0/222379637 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2effd640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2000a5c0 con 0x7f9a30126c60 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2effd640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9a200b1040 tx=0x7f9a2001a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a200ae780 con 0x7f9a30126c60 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200ae8e0 con 0x7f9a30126c60 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a30118da0 con 0x7f9a30126c60 2024-02-16T10:32:13.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a200aeb80 con 0x7f9a30126c60 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a30118320 con 0x7f9a30126c60 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a30117510 con 0x7f9a30126c60 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f9a200b5040 con 0x7f9a30126c60 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 0x7f9a10037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f9a200e2e70 con 0x7f9a30126c60 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 0x7f9a100442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a10044970 con 0x7f9a10041e00 2024-02-16T10:32:13.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a200e54e0 con 0x7f9a30126c60 2024-02-16T10:32:13.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a267fc640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 0x7f9a10037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.287+0000 7f9a2f7fe640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 0x7f9a100442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.291+0000 7f9a267fc640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 0x7f9a10037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.291+0000 7f9a2f7fe640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 0x7f9a100442a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.291+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== osd.3 v2:172.21.15.138:6800/756089529 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a10044970 con 0x7f9a10041e00 2024-02-16T10:32:13.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 --> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a301277d0 con 0x7f9a10041e00 2024-02-16T10:32:13.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a2cff9640 1 -- 172.21.15.107:0/222379637 <== osd.3 v2:172.21.15.138:6800/756089529 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a301277d0 con 0x7f9a10041e00 2024-02-16T10:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-02-16T10:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-16T10:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-02-16T10:32:13.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 msgr2=0x7f9a100442a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 0x7f9a100442a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 msgr2=0x7f9a10037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 0x7f9a10037ed0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007fd0 tx=0x7f9a18007920 comp rx=0 tx=0).stop 2024-02-16T10:32:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 msgr2=0x7f9a301c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9a200b1040 tx=0x7f9a2001a4e0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 shutdown_connections 2024-02-16T10:32:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6800/756089529,v1:172.21.15.138:6801/756089529] conn(0x7f9a10041e00 0x7f9a100442a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f9a10035a10 0x7f9a10037ed0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 --2- 172.21.15.107:0/222379637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9a30126c60 0x7f9a301c3590 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 >> 172.21.15.107:0/222379637 conn(0x7f9a3009a390 msgr2=0x7f9a30124f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 shutdown_connections 2024-02-16T10:32:13.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.303+0000 7f9a35937640 1 -- 172.21.15.107:0/222379637 wait complete. 2024-02-16T10:32:13.325 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-16T10:32:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.431+0000 7f417e72d640 1 Processor -- start 2024-02-16T10:32:13.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.431+0000 7f417e72d640 1 -- start start 2024-02-16T10:32:13.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f417812ef80 0x7f4178131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178072450 con 0x7f417806f8b0 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417812bed0 con 0x7f417812ef80 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f417812ef80 0x7f4178131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f417812ef80 0x7f4178131370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50608/0 (socket says 172.21.15.107:50608) 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 -- 172.21.15.107:0/2087465823 learned_addr learned my addr 172.21.15.107:0/2087465823 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:13.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 -- 172.21.15.107:0/2087465823 >> v1:172.21.15.107:6789/0 conn(0x7f417806f8b0 legacy=0x7f417812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 -- 172.21.15.107:0/2087465823 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178112bd0 con 0x7f417812ef80 2024-02-16T10:32:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f41777fe640 1 --2- 172.21.15.107:0/2087465823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417812ef80 0x7f4178131370 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f416c0097f0 tx=0x7f416c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d0252ef9353c7f server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f4176ffd640 1 -- 172.21.15.107:0/2087465823 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c0ab530 con 0x7f417812ef80 2024-02-16T10:32:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f4176ffd640 1 -- 172.21.15.107:0/2087465823 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0a7050 con 0x7f417812ef80 2024-02-16T10:32:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f4176ffd640 1 -- 172.21.15.107:0/2087465823 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c0ab7e0 con 0x7f417812ef80 2024-02-16T10:32:13.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- 172.21.15.107:0/2087465823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417812ef80 msgr2=0x7f4178131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 --2- 172.21.15.107:0/2087465823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417812ef80 0x7f4178131370 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f416c0097f0 tx=0x7f416c01c430 comp rx=0 tx=0).stop 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- 172.21.15.107:0/2087465823 shutdown_connections 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 --2- 172.21.15.107:0/2087465823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417812ef80 0x7f4178131370 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- 172.21.15.107:0/2087465823 >> 172.21.15.107:0/2087465823 conn(0x7f417809a1c0 msgr2=0x7f417809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- 172.21.15.107:0/2087465823 shutdown_connections 2024-02-16T10:32:13.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.435+0000 7f417e72d640 1 -- 172.21.15.107:0/2087465823 wait complete. 2024-02-16T10:32:13.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 Processor -- start 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 -- start start 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178124b40 con 0x7f417806f8b0 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4177fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4177fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50612/0 (socket says 172.21.15.107:50612) 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4177fff640 1 -- 172.21.15.107:0/484049844 learned_addr learned my addr 172.21.15.107:0/484049844 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4177fff640 1 -- 172.21.15.107:0/484049844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094d0 con 0x7f417806f8b0 2024-02-16T10:32:13.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4177fff640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f416800c480 tx=0x7f416800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4168005150 con 0x7f417806f8b0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680052b0 con 0x7f417806f8b0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4178128190 con 0x7f417806f8b0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4168007030 con 0x7f417806f8b0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178125680 con 0x7f417806f8b0 2024-02-16T10:32:13.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f4168007190 con 0x7f417806f8b0 2024-02-16T10:32:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178125240 con 0x7f417806f8b0 2024-02-16T10:32:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 0x7f4164037f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4168047cd0 con 0x7f417806f8b0 2024-02-16T10:32:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f41777fe640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 0x7f4164037f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.439+0000 7f41777fe640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 0x7f4164037f00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f416c0ad000 tx=0x7f416c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.443+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4178125240 con 0x7f417806f8b0 2024-02-16T10:32:13.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.603+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f417812cb30 con 0x7f4164035a40 2024-02-16T10:32:13.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.603+0000 7f4174ff9640 1 -- 172.21.15.107:0/484049844 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f416c0ac730 con 0x7f4164035a40 2024-02-16T10:32:13.609 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2024-02-16T10:32:13.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 msgr2=0x7f4164037f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 0x7f4164037f00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f416c0ad000 tx=0x7f416c0a6000 comp rx=0 tx=0).stop 2024-02-16T10:32:13.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 msgr2=0x7f41781220c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f416800c480 tx=0x7f416800c940 comp rx=0 tx=0).stop 2024-02-16T10:32:13.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 shutdown_connections 2024-02-16T10:32:13.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f4164035a40 0x7f4164037f00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 --2- 172.21.15.107:0/484049844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f417806f8b0 0x7f41781220c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 >> 172.21.15.107:0/484049844 conn(0x7f417809a1c0 msgr2=0x7f4178126340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 shutdown_connections 2024-02-16T10:32:13.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.607+0000 7f417e72d640 1 -- 172.21.15.107:0/484049844 wait complete. 2024-02-16T10:32:13.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb380e30640 1 Processor -- start 2024-02-16T10:32:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb380e30640 1 -- start start 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb380e30640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb37c12e7b0 0x7fb37c06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb380e30640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c071600 con 0x7fb37c12e3d0 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb380e30640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c070fc0 con 0x7fb37c12e7b0 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb379d9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb37c12e7b0 0x7fb37c06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb37a59c640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb37c12e3d0 0x7fb37c06e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41166/0 (socket says 172.21.15.107:41166) 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb379d9b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb37c12e7b0 0x7fb37c06e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50624/0 (socket says 172.21.15.107:50624) 2024-02-16T10:32:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb37a59c640 1 -- 172.21.15.107:0/2747867059 learned_addr learned my addr 172.21.15.107:0/2747867059 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb379d9b640 1 -- 172.21.15.107:0/2747867059 >> v1:172.21.15.107:6789/0 conn(0x7fb37c12e3d0 legacy=0x7fb37c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb37959a640 1 -- 172.21.15.107:0/2747867059 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465436183 0 0) 0x7fb37c071600 con 0x7fb37c12e3d0 2024-02-16T10:32:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.735+0000 7fb379d9b640 1 -- 172.21.15.107:0/2747867059 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c071aa0 con 0x7fb37c12e7b0 2024-02-16T10:32:13.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb379d9b640 1 --2- 172.21.15.107:0/2747867059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e7b0 0x7fb37c06e760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb370009740 tx=0x7fb37001cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6adefabcfef144b server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37959a640 1 -- 172.21.15.107:0/2747867059 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3700ab530 con 0x7fb37c12e7b0 2024-02-16T10:32:13.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37959a640 1 -- 172.21.15.107:0/2747867059 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3700a7050 con 0x7fb37c12e7b0 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37959a640 1 -- 172.21.15.107:0/2747867059 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3700ab7e0 con 0x7fb37c12e7b0 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- 172.21.15.107:0/2747867059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e7b0 msgr2=0x7fb37c06e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 --2- 172.21.15.107:0/2747867059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e7b0 0x7fb37c06e760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb370009740 tx=0x7fb37001cd40 comp rx=0 tx=0).stop 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- 172.21.15.107:0/2747867059 shutdown_connections 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 --2- 172.21.15.107:0/2747867059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e7b0 0x7fb37c06e760 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- 172.21.15.107:0/2747867059 >> 172.21.15.107:0/2747867059 conn(0x7fb37c09df50 msgr2=0x7fb37c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- 172.21.15.107:0/2747867059 shutdown_connections 2024-02-16T10:32:13.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- 172.21.15.107:0/2747867059 wait complete. 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 Processor -- start 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- start start 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb380e30640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c11f5f0 con 0x7fb37c12e3d0 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50626/0 (socket says 172.21.15.107:50626) 2024-02-16T10:32:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37a59c640 1 -- 172.21.15.107:0/4099031233 learned_addr learned my addr 172.21.15.107:0/4099031233 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37a59c640 1 -- 172.21.15.107:0/4099031233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009420 con 0x7fb37c12e3d0 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.739+0000 7fb37a59c640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c420 tx=0x7fb36c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb36c0074d0 con 0x7fb37c12e3d0 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c007630 con 0x7fb37c12e3d0 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c12dd30 con 0x7fb37c12e3d0 2024-02-16T10:32:13.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb36c004960 con 0x7fb37c12e3d0 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c11f270 con 0x7fb37c12e3d0 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fb36c004ac0 con 0x7fb37c12e3d0 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c11fd00 con 0x7fb37c12e3d0 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 0x7fb35c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb36c047dd0 con 0x7fb37c12e3d0 2024-02-16T10:32:13.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb379d9b640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 0x7fb35c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:13.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.743+0000 7fb379d9b640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 0x7fb35c037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ad000 tx=0x7fb370008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:13.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.747+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb36c01abc0 con 0x7fb37c12e3d0 2024-02-16T10:32:13.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.899+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb37c062980 con 0x7fb35c035a10 2024-02-16T10:32:13.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.943+0000 7fb36affd640 1 -- 172.21.15.107:0/4099031233 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673568 (secure 0 0 0) 0x7fb37c062980 con 0x7fb35c035a10 2024-02-16T10:32:13.953 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:13.964 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 msgr2=0x7fb35c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 0x7fb35c037ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ad000 tx=0x7fb370008040 comp rx=0 tx=0).stop 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 msgr2=0x7fb37c12c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c420 tx=0x7fb36c00c8e0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 shutdown_connections 2024-02-16T10:32:13.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fb35c035a10 0x7fb35c037ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 --2- 172.21.15.107:0/4099031233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb37c12e3d0 0x7fb37c12c450 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:13.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 >> 172.21.15.107:0/4099031233 conn(0x7fb37c09df50 msgr2=0x7fb37c132040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:13.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 shutdown_connections 2024-02-16T10:32:13.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:13.955+0000 7fb380e30640 1 -- 172.21.15.107:0/4099031233 wait complete. 2024-02-16T10:32:13.981 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-02-16T10:32:13.864195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-825,"num_objects":-16,"num_object_clones":0,"num_object_copies":-34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":340,"num_read_kb":338,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006779"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916908+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:31:06.916908+0000","last_peered":"2024-02-16T10:31:06.916908+0000","last_clean":"2024-02-16T10:31:06.916908+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:31:06.916908+0000","last_undegraded":"2024-02-16T10:31:06.916908+0000","last_fullsized":"2024-02-16T10:31:06.916908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354394+0000","last_change":"2024-02-16T10:30:28.072642+0000","last_active":"2024-02-16T10:31:55.354394+0000","last_peered":"2024-02-16T10:31:55.354394+0000","last_clean":"2024-02-16T10:31:55.354394+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:31:55.354394+0000","last_undegraded":"2024-02-16T10:31:55.354394+0000","last_fullsized":"2024-02-16T10:31:55.354394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929412+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:31:06.929412+0000","last_peered":"2024-02-16T10:31:06.929412+0000","last_clean":"2024-02-16T10:31:06.929412+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:31:06.929412+0000","last_undegraded":"2024-02-16T10:31:06.929412+0000","last_fullsized":"2024-02-16T10:31:06.929412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918157+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918157+0000","last_peered":"2024-02-16T10:31:06.918157+0000","last_clean":"2024-02-16T10:31:06.918157+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918157+0000","last_undegraded":"2024-02-16T10:31:06.918157+0000","last_fullsized":"2024-02-16T10:31:06.918157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:41.510090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976695+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:31:11.976695+0000","last_peered":"2024-02-16T10:31:11.976695+0000","last_clean":"2024-02-16T10:31:11.976695+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:31:11.976695+0000","last_undegraded":"2024-02-16T10:31:11.976695+0000","last_fullsized":"2024-02-16T10:31:11.976695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:13.252426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920793+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920793+0000","last_peered":"2024-02-16T10:31:06.920793+0000","last_clean":"2024-02-16T10:31:06.920793+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920793+0000","last_undegraded":"2024-02-16T10:31:06.920793+0000","last_fullsized":"2024-02-16T10:31:06.920793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:41.339005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914702+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:31:06.914702+0000","last_peered":"2024-02-16T10:31:06.914702+0000","last_clean":"2024-02-16T10:31:06.914702+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:31:06.914702+0000","last_undegraded":"2024-02-16T10:31:06.914702+0000","last_fullsized":"2024-02-16T10:31:06.914702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920918+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.920918+0000","last_peered":"2024-02-16T10:31:06.920918+0000","last_clean":"2024-02-16T10:31:06.920918+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.920918+0000","last_undegraded":"2024-02-16T10:31:06.920918+0000","last_fullsized":"2024-02-16T10:31:06.920918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:09.881305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.503530+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.503530+0000","last_peered":"2024-02-16T10:31:54.503530+0000","last_clean":"2024-02-16T10:31:54.503530+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.503530+0000","last_undegraded":"2024-02-16T10:31:54.503530+0000","last_fullsized":"2024-02-16T10:31:54.503530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:17.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003130+0000","last_change":"2024-02-16T10:30:28.081973+0000","last_active":"2024-02-16T10:32:01.003130+0000","last_peered":"2024-02-16T10:32:01.003130+0000","last_clean":"2024-02-16T10:32:01.003130+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:01.003130+0000","last_undegraded":"2024-02-16T10:32:01.003130+0000","last_fullsized":"2024-02-16T10:32:01.003130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908534+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908534+0000","last_peered":"2024-02-16T10:31:06.908534+0000","last_clean":"2024-02-16T10:31:06.908534+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908534+0000","last_undegraded":"2024-02-16T10:31:06.908534+0000","last_fullsized":"2024-02-16T10:31:06.908534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925777+0000","last_change":"2024-02-16T10:30:28.083981+0000","last_active":"2024-02-16T10:31:06.925777+0000","last_peered":"2024-02-16T10:31:06.925777+0000","last_clean":"2024-02-16T10:31:06.925777+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:31:06.925777+0000","last_undegraded":"2024-02-16T10:31:06.925777+0000","last_fullsized":"2024-02-16T10:31:06.925777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:38.936680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916403+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.916403+0000","last_peered":"2024-02-16T10:31:06.916403+0000","last_clean":"2024-02-16T10:31:06.916403+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.916403+0000","last_undegraded":"2024-02-16T10:31:06.916403+0000","last_fullsized":"2024-02-16T10:31:06.916403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:03.972499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354647+0000","last_change":"2024-02-16T10:30:28.078739+0000","last_active":"2024-02-16T10:31:55.354647+0000","last_peered":"2024-02-16T10:31:55.354647+0000","last_clean":"2024-02-16T10:31:55.354647+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:31:55.354647+0000","last_undegraded":"2024-02-16T10:31:55.354647+0000","last_fullsized":"2024-02-16T10:31:55.354647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925042+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925042+0000","last_peered":"2024-02-16T10:31:06.925042+0000","last_clean":"2024-02-16T10:31:06.925042+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925042+0000","last_undegraded":"2024-02-16T10:31:06.925042+0000","last_fullsized":"2024-02-16T10:31:06.925042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686117+0000","last_change":"2024-02-16T10:30:28.063141+0000","last_active":"2024-02-16T10:31:12.686117+0000","last_peered":"2024-02-16T10:31:12.686117+0000","last_clean":"2024-02-16T10:31:12.686117+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:31:12.686117+0000","last_undegraded":"2024-02-16T10:31:12.686117+0000","last_fullsized":"2024-02-16T10:31:12.686117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915013+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:31:06.915013+0000","last_peered":"2024-02-16T10:31:06.915013+0000","last_clean":"2024-02-16T10:31:06.915013+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:31:06.915013+0000","last_undegraded":"2024-02-16T10:31:06.915013+0000","last_fullsized":"2024-02-16T10:31:06.915013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:03.383909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929156+0000","last_change":"2024-02-16T10:30:26.098135+0000","last_active":"2024-02-16T10:31:06.929156+0000","last_peered":"2024-02-16T10:31:06.929156+0000","last_clean":"2024-02-16T10:31:06.929156+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:31:06.929156+0000","last_undegraded":"2024-02-16T10:31:06.929156+0000","last_fullsized":"2024-02-16T10:31:06.929156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915167+0000","last_change":"2024-02-16T10:30:28.080080+0000","last_active":"2024-02-16T10:31:06.915167+0000","last_peered":"2024-02-16T10:31:06.915167+0000","last_clean":"2024-02-16T10:31:06.915167+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:31:06.915167+0000","last_undegraded":"2024-02-16T10:31:06.915167+0000","last_fullsized":"2024-02-16T10:31:06.915167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.994634+0000","last_change":"2024-02-16T10:30:26.086548+0000","last_active":"2024-02-16T10:32:00.994634+0000","last_peered":"2024-02-16T10:32:00.994634+0000","last_clean":"2024-02-16T10:32:00.994634+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:00.994634+0000","last_undegraded":"2024-02-16T10:32:00.994634+0000","last_fullsized":"2024-02-16T10:32:00.994634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366482+0000","last_change":"2024-02-16T10:30:28.082308+0000","last_active":"2024-02-16T10:31:55.366482+0000","last_peered":"2024-02-16T10:31:55.366482+0000","last_clean":"2024-02-16T10:31:55.366482+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:31:55.366482+0000","last_undegraded":"2024-02-16T10:31:55.366482+0000","last_fullsized":"2024-02-16T10:31:55.366482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926645+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:31:06.926645+0000","last_peered":"2024-02-16T10:31:06.926645+0000","last_clean":"2024-02-16T10:31:06.926645+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:31:06.926645+0000","last_undegraded":"2024-02-16T10:31:06.926645+0000","last_fullsized":"2024-02-16T10:31:06.926645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:01:26.177115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927940+0000","last_change":"2024-02-16T10:30:28.066522+0000","last_active":"2024-02-16T10:31:06.927940+0000","last_peered":"2024-02-16T10:31:06.927940+0000","last_clean":"2024-02-16T10:31:06.927940+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:31:06.927940+0000","last_undegraded":"2024-02-16T10:31:06.927940+0000","last_fullsized":"2024-02-16T10:31:06.927940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925646+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:31:06.925646+0000","last_peered":"2024-02-16T10:31:06.925646+0000","last_clean":"2024-02-16T10:31:06.925646+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:31:06.925646+0000","last_undegraded":"2024-02-16T10:31:06.925646+0000","last_fullsized":"2024-02-16T10:31:06.925646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.655926+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.655926+0000","last_peered":"2024-02-16T10:31:11.655926+0000","last_clean":"2024-02-16T10:31:11.655926+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.655926+0000","last_undegraded":"2024-02-16T10:31:11.655926+0000","last_fullsized":"2024-02-16T10:31:11.655926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927666+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:31:06.927666+0000","last_peered":"2024-02-16T10:31:06.927666+0000","last_clean":"2024-02-16T10:31:06.927666+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:31:06.927666+0000","last_undegraded":"2024-02-16T10:31:06.927666+0000","last_fullsized":"2024-02-16T10:31:06.927666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657215+0000","last_change":"2024-02-16T10:30:28.084327+0000","last_active":"2024-02-16T10:31:11.657215+0000","last_peered":"2024-02-16T10:31:11.657215+0000","last_clean":"2024-02-16T10:31:11.657215+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:31:11.657215+0000","last_undegraded":"2024-02-16T10:31:11.657215+0000","last_fullsized":"2024-02-16T10:31:11.657215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:06.450863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919484+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:31:06.919484+0000","last_peered":"2024-02-16T10:31:06.919484+0000","last_clean":"2024-02-16T10:31:06.919484+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:31:06.919484+0000","last_undegraded":"2024-02-16T10:31:06.919484+0000","last_fullsized":"2024-02-16T10:31:06.919484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:40:58.824376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.985103+0000","last_change":"2024-02-16T10:30:36.142641+0000","last_active":"2024-02-16T10:32:00.985103+0000","last_peered":"2024-02-16T10:32:00.985103+0000","last_clean":"2024-02-16T10:32:00.985103+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:00.985103+0000","last_undegraded":"2024-02-16T10:32:00.985103+0000","last_fullsized":"2024-02-16T10:32:00.985103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:21.049073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.684138+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:31:12.684138+0000","last_peered":"2024-02-16T10:31:12.684138+0000","last_clean":"2024-02-16T10:31:12.684138+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:31:12.684138+0000","last_undegraded":"2024-02-16T10:31:12.684138+0000","last_fullsized":"2024-02-16T10:31:12.684138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:54.640122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919653+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:31:06.919653+0000","last_peered":"2024-02-16T10:31:06.919653+0000","last_clean":"2024-02-16T10:31:06.919653+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:31:06.919653+0000","last_undegraded":"2024-02-16T10:31:06.919653+0000","last_fullsized":"2024-02-16T10:31:06.919653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.559382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.938309+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.938309+0000","last_peered":"2024-02-16T10:31:06.938309+0000","last_clean":"2024-02-16T10:31:06.938309+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.938309+0000","last_undegraded":"2024-02-16T10:31:06.938309+0000","last_fullsized":"2024-02-16T10:31:06.938309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:35.001597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.095503+0000","last_change":"2024-02-16T10:30:32.121571+0000","last_active":"2024-02-16T10:32:09.095503+0000","last_peered":"2024-02-16T10:32:09.095503+0000","last_clean":"2024-02-16T10:32:09.095503+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:09.095503+0000","last_undegraded":"2024-02-16T10:32:09.095503+0000","last_fullsized":"2024-02-16T10:32:09.095503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:16:46.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928644+0000","last_change":"2024-02-16T10:30:34.125614+0000","last_active":"2024-02-16T10:31:06.928644+0000","last_peered":"2024-02-16T10:31:06.928644+0000","last_clean":"2024-02-16T10:31:06.928644+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:31:06.928644+0000","last_undegraded":"2024-02-16T10:31:06.928644+0000","last_fullsized":"2024-02-16T10:31:06.928644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.441324+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:49.441324+0000","last_peered":"2024-02-16T10:31:49.441324+0000","last_clean":"2024-02-16T10:31:49.441324+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:49.441324+0000","last_undegraded":"2024-02-16T10:31:49.441324+0000","last_fullsized":"2024-02-16T10:31:49.441324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:10:28.899004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996497+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:11.996497+0000","last_peered":"2024-02-16T10:31:11.996497+0000","last_clean":"2024-02-16T10:31:11.996497+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:11.996497+0000","last_undegraded":"2024-02-16T10:31:11.996497+0000","last_fullsized":"2024-02-16T10:31:11.996497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:02.014700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907578+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:31:06.907578+0000","last_peered":"2024-02-16T10:31:06.907578+0000","last_clean":"2024-02-16T10:31:06.907578+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:31:06.907578+0000","last_undegraded":"2024-02-16T10:31:06.907578+0000","last_fullsized":"2024-02-16T10:31:06.907578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:54.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932531+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:06.932531+0000","last_peered":"2024-02-16T10:31:06.932531+0000","last_clean":"2024-02-16T10:31:06.932531+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:06.932531+0000","last_undegraded":"2024-02-16T10:31:06.932531+0000","last_fullsized":"2024-02-16T10:31:06.932531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:01.288368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927053+0000","last_change":"2024-02-16T10:30:32.097568+0000","last_active":"2024-02-16T10:31:06.927053+0000","last_peered":"2024-02-16T10:31:06.927053+0000","last_clean":"2024-02-16T10:31:06.927053+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:31:06.927053+0000","last_undegraded":"2024-02-16T10:31:06.927053+0000","last_fullsized":"2024-02-16T10:31:06.927053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:48.421929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926352+0000","last_change":"2024-02-16T10:30:34.132449+0000","last_active":"2024-02-16T10:31:06.926352+0000","last_peered":"2024-02-16T10:31:06.926352+0000","last_clean":"2024-02-16T10:31:06.926352+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:31:06.926352+0000","last_undegraded":"2024-02-16T10:31:06.926352+0000","last_fullsized":"2024-02-16T10:31:06.926352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924189+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924189+0000","last_peered":"2024-02-16T10:31:06.924189+0000","last_clean":"2024-02-16T10:31:06.924189+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924189+0000","last_undegraded":"2024-02-16T10:31:06.924189+0000","last_fullsized":"2024-02-16T10:31:06.924189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003292+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.003292+0000","last_peered":"2024-02-16T10:32:01.003292+0000","last_clean":"2024-02-16T10:32:01.003292+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.003292+0000","last_undegraded":"2024-02-16T10:32:01.003292+0000","last_fullsized":"2024-02-16T10:32:01.003292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:16.057698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915976+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:31:06.915976+0000","last_peered":"2024-02-16T10:31:06.915976+0000","last_clean":"2024-02-16T10:31:06.915976+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:31:06.915976+0000","last_undegraded":"2024-02-16T10:31:06.915976+0000","last_fullsized":"2024-02-16T10:31:06.915976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:43.231923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932467+0000","last_change":"2024-02-16T10:30:30.080558+0000","last_active":"2024-02-16T10:31:06.932467+0000","last_peered":"2024-02-16T10:31:06.932467+0000","last_clean":"2024-02-16T10:31:06.932467+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:31:06.932467+0000","last_undegraded":"2024-02-16T10:31:06.932467+0000","last_fullsized":"2024-02-16T10:31:06.932467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914049+0000","last_change":"2024-02-16T10:30:32.096519+0000","last_active":"2024-02-16T10:31:06.914049+0000","last_peered":"2024-02-16T10:31:06.914049+0000","last_clean":"2024-02-16T10:31:06.914049+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:31:06.914049+0000","last_undegraded":"2024-02-16T10:31:06.914049+0000","last_fullsized":"2024-02-16T10:31:06.914049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:11.152738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":305,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.868105+0000","last_change":"2024-02-16T10:30:34.141896+0000","last_active":"2024-02-16T10:32:08.868105+0000","last_peered":"2024-02-16T10:32:08.868105+0000","last_clean":"2024-02-16T10:32:08.868105+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:08.868105+0000","last_undegraded":"2024-02-16T10:32:08.868105+0000","last_fullsized":"2024-02-16T10:32:08.868105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:26:47.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911474+0000","last_change":"2024-02-16T10:30:36.135895+0000","last_active":"2024-02-16T10:31:06.911474+0000","last_peered":"2024-02-16T10:31:06.911474+0000","last_clean":"2024-02-16T10:31:06.911474+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:31:06.911474+0000","last_undegraded":"2024-02-16T10:31:06.911474+0000","last_fullsized":"2024-02-16T10:31:06.911474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:07:52.487219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003499+0000","last_change":"2024-02-16T10:30:28.088671+0000","last_active":"2024-02-16T10:32:01.003499+0000","last_peered":"2024-02-16T10:32:01.003499+0000","last_clean":"2024-02-16T10:32:01.003499+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:01.003499+0000","last_undegraded":"2024-02-16T10:32:01.003499+0000","last_fullsized":"2024-02-16T10:32:01.003499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:22.037922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915727+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:31:06.915727+0000","last_peered":"2024-02-16T10:31:06.915727+0000","last_clean":"2024-02-16T10:31:06.915727+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:31:06.915727+0000","last_undegraded":"2024-02-16T10:31:06.915727+0000","last_fullsized":"2024-02-16T10:31:06.915727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:43:23.730310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928540+0000","last_change":"2024-02-16T10:30:30.101708+0000","last_active":"2024-02-16T10:31:06.928540+0000","last_peered":"2024-02-16T10:31:06.928540+0000","last_clean":"2024-02-16T10:31:06.928540+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:31:06.928540+0000","last_undegraded":"2024-02-16T10:31:06.928540+0000","last_fullsized":"2024-02-16T10:31:06.928540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:12.591167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.061418+0000","last_change":"2024-02-16T10:30:32.098362+0000","last_active":"2024-02-16T10:32:09.061418+0000","last_peered":"2024-02-16T10:32:09.061418+0000","last_clean":"2024-02-16T10:32:09.061418+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:09.061418+0000","last_undegraded":"2024-02-16T10:32:09.061418+0000","last_fullsized":"2024-02-16T10:32:09.061418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:06.260410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":333,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.876481+0000","last_change":"2024-02-16T10:30:34.123300+0000","last_active":"2024-02-16T10:32:08.876481+0000","last_peered":"2024-02-16T10:32:08.876481+0000","last_clean":"2024-02-16T10:32:08.876481+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:08.876481+0000","last_undegraded":"2024-02-16T10:32:08.876481+0000","last_fullsized":"2024-02-16T10:32:08.876481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:29.136206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914537+0000","last_change":"2024-02-16T10:30:28.076250+0000","last_active":"2024-02-16T10:31:06.914537+0000","last_peered":"2024-02-16T10:31:06.914537+0000","last_clean":"2024-02-16T10:31:06.914537+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:31:06.914537+0000","last_undegraded":"2024-02-16T10:31:06.914537+0000","last_fullsized":"2024-02-16T10:31:06.914537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:55.536607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916055+0000","last_change":"2024-02-16T10:30:26.085100+0000","last_active":"2024-02-16T10:31:06.916055+0000","last_peered":"2024-02-16T10:31:06.916055+0000","last_clean":"2024-02-16T10:31:06.916055+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:31:06.916055+0000","last_undegraded":"2024-02-16T10:31:06.916055+0000","last_fullsized":"2024-02-16T10:31:06.916055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914345+0000","last_change":"2024-02-16T10:30:30.090540+0000","last_active":"2024-02-16T10:31:06.914345+0000","last_peered":"2024-02-16T10:31:06.914345+0000","last_clean":"2024-02-16T10:31:06.914345+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:31:06.914345+0000","last_undegraded":"2024-02-16T10:31:06.914345+0000","last_fullsized":"2024-02-16T10:31:06.914345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:57.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'41","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.121417+0000","last_change":"2024-02-16T10:30:32.090733+0000","last_active":"2024-02-16T10:32:09.121417+0000","last_peered":"2024-02-16T10:32:09.121417+0000","last_clean":"2024-02-16T10:32:09.121417+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:09.121417+0000","last_undegraded":"2024-02-16T10:32:09.121417+0000","last_fullsized":"2024-02-16T10:32:09.121417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:14.959048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927184+0000","last_change":"2024-02-16T10:30:34.130521+0000","last_active":"2024-02-16T10:31:06.927184+0000","last_peered":"2024-02-16T10:31:06.927184+0000","last_clean":"2024-02-16T10:31:06.927184+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:31:06.927184+0000","last_undegraded":"2024-02-16T10:31:06.927184+0000","last_fullsized":"2024-02-16T10:31:06.927184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:37:16.619978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.089594+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:31:55.089594+0000","last_peered":"2024-02-16T10:31:55.089594+0000","last_clean":"2024-02-16T10:31:55.089594+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:31:55.089594+0000","last_undegraded":"2024-02-16T10:31:55.089594+0000","last_fullsized":"2024-02-16T10:31:55.089594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:35.549647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.355411+0000","last_change":"2024-02-16T10:30:28.072768+0000","last_active":"2024-02-16T10:31:55.355411+0000","last_peered":"2024-02-16T10:31:55.355411+0000","last_clean":"2024-02-16T10:31:55.355411+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:31:55.355411+0000","last_undegraded":"2024-02-16T10:31:55.355411+0000","last_fullsized":"2024-02-16T10:31:55.355411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:37.895601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921914+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:31:06.921914+0000","last_peered":"2024-02-16T10:31:06.921914+0000","last_clean":"2024-02-16T10:31:06.921914+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:31:06.921914+0000","last_undegraded":"2024-02-16T10:31:06.921914+0000","last_fullsized":"2024-02-16T10:31:06.921914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925241+0000","last_change":"2024-02-16T10:30:30.092397+0000","last_active":"2024-02-16T10:31:06.925241+0000","last_peered":"2024-02-16T10:31:06.925241+0000","last_clean":"2024-02-16T10:31:06.925241+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:31:06.925241+0000","last_undegraded":"2024-02-16T10:31:06.925241+0000","last_fullsized":"2024-02-16T10:31:06.925241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:17:37.092874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.998292+0000","last_change":"2024-02-16T10:30:32.120960+0000","last_active":"2024-02-16T10:32:08.998292+0000","last_peered":"2024-02-16T10:32:08.998292+0000","last_clean":"2024-02-16T10:32:08.998292+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:08.998292+0000","last_undegraded":"2024-02-16T10:32:08.998292+0000","last_fullsized":"2024-02-16T10:32:08.998292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:09:15.954493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925210+0000","last_change":"2024-02-16T10:30:34.135930+0000","last_active":"2024-02-16T10:31:06.925210+0000","last_peered":"2024-02-16T10:31:06.925210+0000","last_clean":"2024-02-16T10:31:06.925210+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:31:06.925210+0000","last_undegraded":"2024-02-16T10:31:06.925210+0000","last_fullsized":"2024-02-16T10:31:06.925210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:08.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.305924+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:31:49.305924+0000","last_peered":"2024-02-16T10:31:49.305924+0000","last_clean":"2024-02-16T10:31:49.305924+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:31:49.305924+0000","last_undegraded":"2024-02-16T10:31:49.305924+0000","last_fullsized":"2024-02-16T10:31:49.305924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:11.750748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.201148+0000","last_change":"2024-02-16T10:30:28.064067+0000","last_active":"2024-02-16T10:31:11.201148+0000","last_peered":"2024-02-16T10:31:11.201148+0000","last_clean":"2024-02-16T10:31:11.201148+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:31:11.201148+0000","last_undegraded":"2024-02-16T10:31:11.201148+0000","last_fullsized":"2024-02-16T10:31:11.201148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:05.987067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927937+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:31:06.927937+0000","last_peered":"2024-02-16T10:31:06.927937+0000","last_clean":"2024-02-16T10:31:06.927937+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:31:06.927937+0000","last_undegraded":"2024-02-16T10:31:06.927937+0000","last_fullsized":"2024-02-16T10:31:06.927937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:28:20.023353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926646+0000","last_change":"2024-02-16T10:30:30.080329+0000","last_active":"2024-02-16T10:31:06.926646+0000","last_peered":"2024-02-16T10:31:06.926646+0000","last_clean":"2024-02-16T10:31:06.926646+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:31:06.926646+0000","last_undegraded":"2024-02-16T10:31:06.926646+0000","last_fullsized":"2024-02-16T10:31:06.926646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:12:30.180346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.132075+0000","last_change":"2024-02-16T10:30:32.116257+0000","last_active":"2024-02-16T10:32:09.132075+0000","last_peered":"2024-02-16T10:32:09.132075+0000","last_clean":"2024-02-16T10:32:09.132075+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:09.132075+0000","last_undegraded":"2024-02-16T10:32:09.132075+0000","last_fullsized":"2024-02-16T10:32:09.132075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:52.854962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":304,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.878917+0000","last_change":"2024-02-16T10:30:34.135819+0000","last_active":"2024-02-16T10:32:08.878917+0000","last_peered":"2024-02-16T10:32:08.878917+0000","last_clean":"2024-02-16T10:32:08.878917+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:08.878917+0000","last_undegraded":"2024-02-16T10:32:08.878917+0000","last_fullsized":"2024-02-16T10:32:08.878917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927141+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:31:06.927141+0000","last_peered":"2024-02-16T10:31:06.927141+0000","last_clean":"2024-02-16T10:31:06.927141+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:31:06.927141+0000","last_undegraded":"2024-02-16T10:31:06.927141+0000","last_fullsized":"2024-02-16T10:31:06.927141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:55.920641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.657202+0000","last_change":"2024-02-16T10:30:28.068604+0000","last_active":"2024-02-16T10:31:11.657202+0000","last_peered":"2024-02-16T10:31:11.657202+0000","last_clean":"2024-02-16T10:31:11.657202+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:31:11.657202+0000","last_undegraded":"2024-02-16T10:31:11.657202+0000","last_fullsized":"2024-02-16T10:31:11.657202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924328+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:31:06.924328+0000","last_peered":"2024-02-16T10:31:06.924328+0000","last_clean":"2024-02-16T10:31:06.924328+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:31:06.924328+0000","last_undegraded":"2024-02-16T10:31:06.924328+0000","last_fullsized":"2024-02-16T10:31:06.924328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:56.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926096+0000","last_change":"2024-02-16T10:30:30.081734+0000","last_active":"2024-02-16T10:31:06.926096+0000","last_peered":"2024-02-16T10:31:06.926096+0000","last_clean":"2024-02-16T10:31:06.926096+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:31:06.926096+0000","last_undegraded":"2024-02-16T10:31:06.926096+0000","last_fullsized":"2024-02-16T10:31:06.926096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:06.703746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.012085+0000","last_change":"2024-02-16T10:30:32.122915+0000","last_active":"2024-02-16T10:32:09.012085+0000","last_peered":"2024-02-16T10:32:09.012085+0000","last_clean":"2024-02-16T10:32:09.012085+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:09.012085+0000","last_undegraded":"2024-02-16T10:32:09.012085+0000","last_fullsized":"2024-02-16T10:32:09.012085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:06.755062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924769+0000","last_change":"2024-02-16T10:30:34.118800+0000","last_active":"2024-02-16T10:31:06.924769+0000","last_peered":"2024-02-16T10:31:06.924769+0000","last_clean":"2024-02-16T10:31:06.924769+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:31:06.924769+0000","last_undegraded":"2024-02-16T10:31:06.924769+0000","last_fullsized":"2024-02-16T10:31:06.924769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929435+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:31:06.929435+0000","last_peered":"2024-02-16T10:31:06.929435+0000","last_clean":"2024-02-16T10:31:06.929435+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:31:06.929435+0000","last_undegraded":"2024-02-16T10:31:06.929435+0000","last_fullsized":"2024-02-16T10:31:06.929435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:56.882445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.683838+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:31:12.683838+0000","last_peered":"2024-02-16T10:31:12.683838+0000","last_clean":"2024-02-16T10:31:12.683838+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:31:12.683838+0000","last_undegraded":"2024-02-16T10:31:12.683838+0000","last_fullsized":"2024-02-16T10:31:12.683838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:52.232418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926917+0000","last_change":"2024-02-16T10:30:26.098753+0000","last_active":"2024-02-16T10:31:06.926917+0000","last_peered":"2024-02-16T10:31:06.926917+0000","last_clean":"2024-02-16T10:31:06.926917+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:31:06.926917+0000","last_undegraded":"2024-02-16T10:31:06.926917+0000","last_fullsized":"2024-02-16T10:31:06.926917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:32.992237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.829449+0000","last_change":"2024-02-16T10:30:30.080515+0000","last_active":"2024-02-16T10:32:08.829449+0000","last_peered":"2024-02-16T10:32:08.829449+0000","last_clean":"2024-02-16T10:32:08.829449+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:08.829449+0000","last_undegraded":"2024-02-16T10:32:08.829449+0000","last_fullsized":"2024-02-16T10:32:08.829449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:03.555320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.018256+0000","last_change":"2024-02-16T10:30:32.094520+0000","last_active":"2024-02-16T10:32:09.018256+0000","last_peered":"2024-02-16T10:32:09.018256+0000","last_clean":"2024-02-16T10:32:09.018256+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:09.018256+0000","last_undegraded":"2024-02-16T10:32:09.018256+0000","last_fullsized":"2024-02-16T10:32:09.018256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:31.069304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.933898+0000","last_change":"2024-02-16T10:30:34.141827+0000","last_active":"2024-02-16T10:31:06.933898+0000","last_peered":"2024-02-16T10:31:06.933898+0000","last_clean":"2024-02-16T10:31:06.933898+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:31:06.933898+0000","last_undegraded":"2024-02-16T10:31:06.933898+0000","last_fullsized":"2024-02-16T10:31:06.933898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:38.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911244+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:31:06.911244+0000","last_peered":"2024-02-16T10:31:06.911244+0000","last_clean":"2024-02-16T10:31:06.911244+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:31:06.911244+0000","last_undegraded":"2024-02-16T10:31:06.911244+0000","last_fullsized":"2024-02-16T10:31:06.911244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:00.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.202587+0000","last_change":"2024-02-16T10:30:28.086917+0000","last_active":"2024-02-16T10:31:11.202587+0000","last_peered":"2024-02-16T10:31:11.202587+0000","last_clean":"2024-02-16T10:31:11.202587+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:31:11.202587+0000","last_undegraded":"2024-02-16T10:31:11.202587+0000","last_fullsized":"2024-02-16T10:31:11.202587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:28:44.394736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921051+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:31:06.921051+0000","last_peered":"2024-02-16T10:31:06.921051+0000","last_clean":"2024-02-16T10:31:06.921051+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:31:06.921051+0000","last_undegraded":"2024-02-16T10:31:06.921051+0000","last_fullsized":"2024-02-16T10:31:06.921051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926662+0000","last_change":"2024-02-16T10:30:30.082304+0000","last_active":"2024-02-16T10:31:06.926662+0000","last_peered":"2024-02-16T10:31:06.926662+0000","last_clean":"2024-02-16T10:31:06.926662+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:31:06.926662+0000","last_undegraded":"2024-02-16T10:31:06.926662+0000","last_fullsized":"2024-02-16T10:31:06.926662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:59.066509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.979225+0000","last_change":"2024-02-16T10:30:32.091187+0000","last_active":"2024-02-16T10:32:08.979225+0000","last_peered":"2024-02-16T10:32:08.979225+0000","last_clean":"2024-02-16T10:32:08.979225+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:08.979225+0000","last_undegraded":"2024-02-16T10:32:08.979225+0000","last_fullsized":"2024-02-16T10:32:08.979225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:44:59.563800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":335,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.868935+0000","last_change":"2024-02-16T10:30:34.129069+0000","last_active":"2024-02-16T10:32:08.868935+0000","last_peered":"2024-02-16T10:32:08.868935+0000","last_clean":"2024-02-16T10:32:08.868935+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:08.868935+0000","last_undegraded":"2024-02-16T10:32:08.868935+0000","last_fullsized":"2024-02-16T10:32:08.868935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:33.083249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.374319+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:31:55.374319+0000","last_peered":"2024-02-16T10:31:55.374319+0000","last_clean":"2024-02-16T10:31:55.374319+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:31:55.374319+0000","last_undegraded":"2024-02-16T10:31:55.374319+0000","last_fullsized":"2024-02-16T10:31:55.374319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922972+0000","last_change":"2024-02-16T10:30:28.063099+0000","last_active":"2024-02-16T10:31:06.922972+0000","last_peered":"2024-02-16T10:31:06.922972+0000","last_clean":"2024-02-16T10:31:06.922972+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:31:06.922972+0000","last_undegraded":"2024-02-16T10:31:06.922972+0000","last_fullsized":"2024-02-16T10:31:06.922972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.987828+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:31:11.987828+0000","last_peered":"2024-02-16T10:31:11.987828+0000","last_clean":"2024-02-16T10:31:11.987828+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:31:11.987828+0000","last_undegraded":"2024-02-16T10:31:11.987828+0000","last_fullsized":"2024-02-16T10:31:11.987828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:21.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.841775+0000","last_change":"2024-02-16T10:30:30.090962+0000","last_active":"2024-02-16T10:32:08.841775+0000","last_peered":"2024-02-16T10:32:08.841775+0000","last_clean":"2024-02-16T10:32:08.841775+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:08.841775+0000","last_undegraded":"2024-02-16T10:32:08.841775+0000","last_fullsized":"2024-02-16T10:32:08.841775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:08.415016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928037+0000","last_change":"2024-02-16T10:30:32.123949+0000","last_active":"2024-02-16T10:31:06.928037+0000","last_peered":"2024-02-16T10:31:06.928037+0000","last_clean":"2024-02-16T10:31:06.928037+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:31:06.928037+0000","last_undegraded":"2024-02-16T10:31:06.928037+0000","last_fullsized":"2024-02-16T10:31:06.928037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:03.303232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":378,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.871611+0000","last_change":"2024-02-16T10:30:34.117090+0000","last_active":"2024-02-16T10:32:08.871611+0000","last_peered":"2024-02-16T10:32:08.871611+0000","last_clean":"2024-02-16T10:32:08.871611+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:08.871611+0000","last_undegraded":"2024-02-16T10:32:08.871611+0000","last_fullsized":"2024-02-16T10:32:08.871611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:18.696186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908544+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:31:06.908544+0000","last_peered":"2024-02-16T10:31:06.908544+0000","last_clean":"2024-02-16T10:31:06.908544+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:31:06.908544+0000","last_undegraded":"2024-02-16T10:31:06.908544+0000","last_fullsized":"2024-02-16T10:31:06.908544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:36.807430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497874+0000","last_change":"2024-02-16T10:30:28.085134+0000","last_active":"2024-02-16T10:31:54.497874+0000","last_peered":"2024-02-16T10:31:54.497874+0000","last_clean":"2024-02-16T10:31:54.497874+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:31:54.497874+0000","last_undegraded":"2024-02-16T10:31:54.497874+0000","last_fullsized":"2024-02-16T10:31:54.497874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:38:01.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913722+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:31:06.913722+0000","last_peered":"2024-02-16T10:31:06.913722+0000","last_clean":"2024-02-16T10:31:06.913722+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:31:06.913722+0000","last_undegraded":"2024-02-16T10:31:06.913722+0000","last_fullsized":"2024-02-16T10:31:06.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:18.440901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929645+0000","last_change":"2024-02-16T10:30:30.102962+0000","last_active":"2024-02-16T10:31:06.929645+0000","last_peered":"2024-02-16T10:31:06.929645+0000","last_clean":"2024-02-16T10:31:06.929645+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:31:06.929645+0000","last_undegraded":"2024-02-16T10:31:06.929645+0000","last_fullsized":"2024-02-16T10:31:06.929645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:37:30.267642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.101887+0000","last_change":"2024-02-16T10:30:32.094067+0000","last_active":"2024-02-16T10:32:09.101887+0000","last_peered":"2024-02-16T10:32:09.101887+0000","last_clean":"2024-02-16T10:32:09.101887+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:09.101887+0000","last_undegraded":"2024-02-16T10:32:09.101887+0000","last_fullsized":"2024-02-16T10:32:09.101887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:49.917930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913640+0000","last_change":"2024-02-16T10:30:34.143148+0000","last_active":"2024-02-16T10:31:06.913640+0000","last_peered":"2024-02-16T10:31:06.913640+0000","last_clean":"2024-02-16T10:31:06.913640+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:31:06.913640+0000","last_undegraded":"2024-02-16T10:31:06.913640+0000","last_fullsized":"2024-02-16T10:31:06.913640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:03.500298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919017+0000","last_change":"2024-02-16T10:30:36.124467+0000","last_active":"2024-02-16T10:31:06.919017+0000","last_peered":"2024-02-16T10:31:06.919017+0000","last_clean":"2024-02-16T10:31:06.919017+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:31:06.919017+0000","last_undegraded":"2024-02-16T10:31:06.919017+0000","last_fullsized":"2024-02-16T10:31:06.919017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:29:10.069376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.009909+0000","last_change":"2024-02-16T10:30:28.084181+0000","last_active":"2024-02-16T10:31:12.009909+0000","last_peered":"2024-02-16T10:31:12.009909+0000","last_clean":"2024-02-16T10:31:12.009909+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:31:12.009909+0000","last_undegraded":"2024-02-16T10:31:12.009909+0000","last_fullsized":"2024-02-16T10:31:12.009909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:30.459984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911425+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:31:06.911425+0000","last_peered":"2024-02-16T10:31:06.911425+0000","last_clean":"2024-02-16T10:31:06.911425+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:31:06.911425+0000","last_undegraded":"2024-02-16T10:31:06.911425+0000","last_fullsized":"2024-02-16T10:31:06.911425+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:30:07.851696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920241+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:31:06.920241+0000","last_peered":"2024-02-16T10:31:06.920241+0000","last_clean":"2024-02-16T10:31:06.920241+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:31:06.920241+0000","last_undegraded":"2024-02-16T10:31:06.920241+0000","last_fullsized":"2024-02-16T10:31:06.920241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:25:05.014023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919063+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:31:06.919063+0000","last_peered":"2024-02-16T10:31:06.919063+0000","last_clean":"2024-02-16T10:31:06.919063+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:31:06.919063+0000","last_undegraded":"2024-02-16T10:31:06.919063+0000","last_fullsized":"2024-02-16T10:31:06.919063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:37.376276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929597+0000","last_change":"2024-02-16T10:30:30.091282+0000","last_active":"2024-02-16T10:31:06.929597+0000","last_peered":"2024-02-16T10:31:06.929597+0000","last_clean":"2024-02-16T10:31:06.929597+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:31:06.929597+0000","last_undegraded":"2024-02-16T10:31:06.929597+0000","last_fullsized":"2024-02-16T10:31:06.929597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:45.940628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":161,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.114727+0000","last_change":"2024-02-16T10:30:32.125750+0000","last_active":"2024-02-16T10:32:09.114727+0000","last_peered":"2024-02-16T10:32:09.114727+0000","last_clean":"2024-02-16T10:32:09.114727+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:09.114727+0000","last_undegraded":"2024-02-16T10:32:09.114727+0000","last_fullsized":"2024-02-16T10:32:09.114727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:57:39.174937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927452+0000","last_change":"2024-02-16T10:30:34.135655+0000","last_active":"2024-02-16T10:31:06.927452+0000","last_peered":"2024-02-16T10:31:06.927452+0000","last_clean":"2024-02-16T10:31:06.927452+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:31:06.927452+0000","last_undegraded":"2024-02-16T10:31:06.927452+0000","last_fullsized":"2024-02-16T10:31:06.927452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:22.389333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.026066+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:01.026066+0000","last_peered":"2024-02-16T10:32:01.026066+0000","last_clean":"2024-02-16T10:32:01.026066+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:01.026066+0000","last_undegraded":"2024-02-16T10:32:01.026066+0000","last_fullsized":"2024-02-16T10:32:01.026066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:51.053720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.685163+0000","last_change":"2024-02-16T10:30:28.069523+0000","last_active":"2024-02-16T10:31:12.685163+0000","last_peered":"2024-02-16T10:31:12.685163+0000","last_clean":"2024-02-16T10:31:12.685163+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:31:12.685163+0000","last_undegraded":"2024-02-16T10:31:12.685163+0000","last_fullsized":"2024-02-16T10:31:12.685163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:45.890737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912556+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:31:06.912556+0000","last_peered":"2024-02-16T10:31:06.912556+0000","last_clean":"2024-02-16T10:31:06.912556+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:31:06.912556+0000","last_undegraded":"2024-02-16T10:31:06.912556+0000","last_fullsized":"2024-02-16T10:31:06.912556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:30:23.164569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.966566+0000","last_change":"2024-02-16T10:30:26.098916+0000","last_active":"2024-02-16T10:31:11.966566+0000","last_peered":"2024-02-16T10:31:11.966566+0000","last_clean":"2024-02-16T10:31:11.966566+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:31:11.966566+0000","last_undegraded":"2024-02-16T10:31:11.966566+0000","last_fullsized":"2024-02-16T10:31:11.966566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934263+0000","last_change":"2024-02-16T10:30:30.102474+0000","last_active":"2024-02-16T10:31:06.934263+0000","last_peered":"2024-02-16T10:31:06.934263+0000","last_clean":"2024-02-16T10:31:06.934263+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:31:06.934263+0000","last_undegraded":"2024-02-16T10:31:06.934263+0000","last_fullsized":"2024-02-16T10:31:06.934263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:06.503438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'250","reported_seq":432,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.109415+0000","last_change":"2024-02-16T10:30:32.096480+0000","last_active":"2024-02-16T10:32:09.109415+0000","last_peered":"2024-02-16T10:32:09.109415+0000","last_clean":"2024-02-16T10:32:09.109415+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:09.109415+0000","last_undegraded":"2024-02-16T10:32:09.109415+0000","last_fullsized":"2024-02-16T10:32:09.109415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:13.908498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923579+0000","last_change":"2024-02-16T10:30:34.141970+0000","last_active":"2024-02-16T10:31:06.923579+0000","last_peered":"2024-02-16T10:31:06.923579+0000","last_clean":"2024-02-16T10:31:06.923579+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:31:06.923579+0000","last_undegraded":"2024-02-16T10:31:06.923579+0000","last_fullsized":"2024-02-16T10:31:06.923579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:53.614440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.457111+0000","last_change":"2024-02-16T10:30:36.139509+0000","last_active":"2024-02-16T10:31:49.457111+0000","last_peered":"2024-02-16T10:31:49.457111+0000","last_clean":"2024-02-16T10:31:49.457111+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:31:49.457111+0000","last_undegraded":"2024-02-16T10:31:49.457111+0000","last_fullsized":"2024-02-16T10:31:49.457111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:50.619455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003297+0000","last_change":"2024-02-16T10:30:28.079105+0000","last_active":"2024-02-16T10:32:01.003297+0000","last_peered":"2024-02-16T10:32:01.003297+0000","last_clean":"2024-02-16T10:32:01.003297+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:01.003297+0000","last_undegraded":"2024-02-16T10:32:01.003297+0000","last_fullsized":"2024-02-16T10:32:01.003297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908820+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:31:06.908820+0000","last_peered":"2024-02-16T10:31:06.908820+0000","last_clean":"2024-02-16T10:31:06.908820+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:31:06.908820+0000","last_undegraded":"2024-02-16T10:31:06.908820+0000","last_fullsized":"2024-02-16T10:31:06.908820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924324+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:31:06.924324+0000","last_peered":"2024-02-16T10:31:06.924324+0000","last_clean":"2024-02-16T10:31:06.924324+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:31:06.924324+0000","last_undegraded":"2024-02-16T10:31:06.924324+0000","last_fullsized":"2024-02-16T10:31:06.924324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915764+0000","last_change":"2024-02-16T10:30:30.078068+0000","last_active":"2024-02-16T10:31:06.915764+0000","last_peered":"2024-02-16T10:31:06.915764+0000","last_clean":"2024-02-16T10:31:06.915764+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:31:06.915764+0000","last_undegraded":"2024-02-16T10:31:06.915764+0000","last_fullsized":"2024-02-16T10:31:06.915764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:54:40.026302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.261541+0000","last_change":"2024-02-16T10:30:32.091702+0000","last_active":"2024-02-16T10:32:00.261541+0000","last_peered":"2024-02-16T10:32:00.261541+0000","last_clean":"2024-02-16T10:32:00.261541+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:00.261541+0000","last_undegraded":"2024-02-16T10:32:00.261541+0000","last_fullsized":"2024-02-16T10:32:00.261541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:33.175979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927804+0000","last_change":"2024-02-16T10:30:34.138200+0000","last_active":"2024-02-16T10:31:06.927804+0000","last_peered":"2024-02-16T10:31:06.927804+0000","last_clean":"2024-02-16T10:31:06.927804+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:31:06.927804+0000","last_undegraded":"2024-02-16T10:31:06.927804+0000","last_fullsized":"2024-02-16T10:31:06.927804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:20.815431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917885+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:31:06.917885+0000","last_peered":"2024-02-16T10:31:06.917885+0000","last_clean":"2024-02-16T10:31:06.917885+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:31:06.917885+0000","last_undegraded":"2024-02-16T10:31:06.917885+0000","last_fullsized":"2024-02-16T10:31:06.917885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:43:08.274614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.205515+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:31:11.205515+0000","last_peered":"2024-02-16T10:31:11.205515+0000","last_clean":"2024-02-16T10:31:11.205515+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:31:11.205515+0000","last_undegraded":"2024-02-16T10:31:11.205515+0000","last_fullsized":"2024-02-16T10:31:11.205515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:00:17.537169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915962+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:31:06.915962+0000","last_peered":"2024-02-16T10:31:06.915962+0000","last_clean":"2024-02-16T10:31:06.915962+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:31:06.915962+0000","last_undegraded":"2024-02-16T10:31:06.915962+0000","last_fullsized":"2024-02-16T10:31:06.915962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:08:53.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912749+0000","last_change":"2024-02-16T10:30:26.084253+0000","last_active":"2024-02-16T10:31:06.912749+0000","last_peered":"2024-02-16T10:31:06.912749+0000","last_clean":"2024-02-16T10:31:06.912749+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:31:06.912749+0000","last_undegraded":"2024-02-16T10:31:06.912749+0000","last_fullsized":"2024-02-16T10:31:06.912749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927392+0000","last_change":"2024-02-16T10:30:30.080063+0000","last_active":"2024-02-16T10:31:06.927392+0000","last_peered":"2024-02-16T10:31:06.927392+0000","last_clean":"2024-02-16T10:31:06.927392+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:31:06.927392+0000","last_undegraded":"2024-02-16T10:31:06.927392+0000","last_fullsized":"2024-02-16T10:31:06.927392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:09:12.944183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928152+0000","last_change":"2024-02-16T10:30:32.125409+0000","last_active":"2024-02-16T10:31:06.928152+0000","last_peered":"2024-02-16T10:31:06.928152+0000","last_clean":"2024-02-16T10:31:06.928152+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:31:06.928152+0000","last_undegraded":"2024-02-16T10:31:06.928152+0000","last_fullsized":"2024-02-16T10:31:06.928152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:35:51.048004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934645+0000","last_change":"2024-02-16T10:30:34.141949+0000","last_active":"2024-02-16T10:31:06.934645+0000","last_peered":"2024-02-16T10:31:06.934645+0000","last_clean":"2024-02-16T10:31:06.934645+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:31:06.934645+0000","last_undegraded":"2024-02-16T10:31:06.934645+0000","last_fullsized":"2024-02-16T10:31:06.934645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:14:10.316154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.339887+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:31:55.339887+0000","last_peered":"2024-02-16T10:31:55.339887+0000","last_clean":"2024-02-16T10:31:55.339887+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:31:55.339887+0000","last_undegraded":"2024-02-16T10:31:55.339887+0000","last_fullsized":"2024-02-16T10:31:55.339887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:25.468581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354549+0000","last_change":"2024-02-16T10:30:28.065872+0000","last_active":"2024-02-16T10:31:55.354549+0000","last_peered":"2024-02-16T10:31:55.354549+0000","last_clean":"2024-02-16T10:31:55.354549+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:31:55.354549+0000","last_undegraded":"2024-02-16T10:31:55.354549+0000","last_fullsized":"2024-02-16T10:31:55.354549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:47.785280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914991+0000","last_change":"2024-02-16T10:30:26.087305+0000","last_active":"2024-02-16T10:31:06.914991+0000","last_peered":"2024-02-16T10:31:06.914991+0000","last_clean":"2024-02-16T10:31:06.914991+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:31:06.914991+0000","last_undegraded":"2024-02-16T10:31:06.914991+0000","last_fullsized":"2024-02-16T10:31:06.914991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927469+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:31:06.927469+0000","last_peered":"2024-02-16T10:31:06.927469+0000","last_clean":"2024-02-16T10:31:06.927469+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:31:06.927469+0000","last_undegraded":"2024-02-16T10:31:06.927469+0000","last_fullsized":"2024-02-16T10:31:06.927469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:10:37.997088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926744+0000","last_change":"2024-02-16T10:30:30.079568+0000","last_active":"2024-02-16T10:31:06.926744+0000","last_peered":"2024-02-16T10:31:06.926744+0000","last_clean":"2024-02-16T10:31:06.926744+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:31:06.926744+0000","last_undegraded":"2024-02-16T10:31:06.926744+0000","last_fullsized":"2024-02-16T10:31:06.926744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:12.104297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'64","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.068923+0000","last_change":"2024-02-16T10:30:32.088251+0000","last_active":"2024-02-16T10:32:09.068923+0000","last_peered":"2024-02-16T10:32:09.068923+0000","last_clean":"2024-02-16T10:32:09.068923+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:09.068923+0000","last_undegraded":"2024-02-16T10:32:09.068923+0000","last_fullsized":"2024-02-16T10:32:09.068923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:38:58.667315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906656+0000","last_change":"2024-02-16T10:30:34.119623+0000","last_active":"2024-02-16T10:31:06.906656+0000","last_peered":"2024-02-16T10:31:06.906656+0000","last_clean":"2024-02-16T10:31:06.906656+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:31:06.906656+0000","last_undegraded":"2024-02-16T10:31:06.906656+0000","last_fullsized":"2024-02-16T10:31:06.906656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:22.098837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.337862+0000","last_change":"2024-02-16T10:30:36.121926+0000","last_active":"2024-02-16T10:31:55.337862+0000","last_peered":"2024-02-16T10:31:55.337862+0000","last_clean":"2024-02-16T10:31:55.337862+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:31:55.337862+0000","last_undegraded":"2024-02-16T10:31:55.337862+0000","last_fullsized":"2024-02-16T10:31:55.337862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:27:43.916489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919422+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:31:06.919422+0000","last_peered":"2024-02-16T10:31:06.919422+0000","last_clean":"2024-02-16T10:31:06.919422+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:31:06.919422+0000","last_undegraded":"2024-02-16T10:31:06.919422+0000","last_fullsized":"2024-02-16T10:31:06.919422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:27:43.149715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929126+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:31:06.929126+0000","last_peered":"2024-02-16T10:31:06.929126+0000","last_clean":"2024-02-16T10:31:06.929126+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:31:06.929126+0000","last_undegraded":"2024-02-16T10:31:06.929126+0000","last_fullsized":"2024-02-16T10:31:06.929126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:05:37.836053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926258+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:31:06.926258+0000","last_peered":"2024-02-16T10:31:06.926258+0000","last_clean":"2024-02-16T10:31:06.926258+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:31:06.926258+0000","last_undegraded":"2024-02-16T10:31:06.926258+0000","last_fullsized":"2024-02-16T10:31:06.926258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:57.781963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915178+0000","last_change":"2024-02-16T10:30:30.100081+0000","last_active":"2024-02-16T10:31:06.915178+0000","last_peered":"2024-02-16T10:31:06.915178+0000","last_clean":"2024-02-16T10:31:06.915178+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:31:06.915178+0000","last_undegraded":"2024-02-16T10:31:06.915178+0000","last_fullsized":"2024-02-16T10:31:06.915178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:56:04.710974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911662+0000","last_change":"2024-02-16T10:30:32.101750+0000","last_active":"2024-02-16T10:31:06.911662+0000","last_peered":"2024-02-16T10:31:06.911662+0000","last_clean":"2024-02-16T10:31:06.911662+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:31:06.911662+0000","last_undegraded":"2024-02-16T10:31:06.911662+0000","last_fullsized":"2024-02-16T10:31:06.911662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:22:20.084891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":281,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.865547+0000","last_change":"2024-02-16T10:30:34.111985+0000","last_active":"2024-02-16T10:32:08.865547+0000","last_peered":"2024-02-16T10:32:08.865547+0000","last_clean":"2024-02-16T10:32:08.865547+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:08.865547+0000","last_undegraded":"2024-02-16T10:32:08.865547+0000","last_fullsized":"2024-02-16T10:32:08.865547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932415+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:31:06.932415+0000","last_peered":"2024-02-16T10:31:06.932415+0000","last_clean":"2024-02-16T10:31:06.932415+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:31:06.932415+0000","last_undegraded":"2024-02-16T10:31:06.932415+0000","last_fullsized":"2024-02-16T10:31:06.932415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:46.560489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922019+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:06.922019+0000","last_peered":"2024-02-16T10:31:06.922019+0000","last_clean":"2024-02-16T10:31:06.922019+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:06.922019+0000","last_undegraded":"2024-02-16T10:31:06.922019+0000","last_fullsized":"2024-02-16T10:31:06.922019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:17.413905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936126+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:31:06.936126+0000","last_peered":"2024-02-16T10:31:06.936126+0000","last_clean":"2024-02-16T10:31:06.936126+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:31:06.936126+0000","last_undegraded":"2024-02-16T10:31:06.936126+0000","last_fullsized":"2024-02-16T10:31:06.936126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:27.417317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928021+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:31:06.928021+0000","last_peered":"2024-02-16T10:31:06.928021+0000","last_clean":"2024-02-16T10:31:06.928021+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:31:06.928021+0000","last_undegraded":"2024-02-16T10:31:06.928021+0000","last_fullsized":"2024-02-16T10:31:06.928021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:53.078787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915715+0000","last_change":"2024-02-16T10:30:30.097705+0000","last_active":"2024-02-16T10:31:06.915715+0000","last_peered":"2024-02-16T10:31:06.915715+0000","last_clean":"2024-02-16T10:31:06.915715+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:31:06.915715+0000","last_undegraded":"2024-02-16T10:31:06.915715+0000","last_fullsized":"2024-02-16T10:31:06.915715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:01.461744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920148+0000","last_change":"2024-02-16T10:30:32.121333+0000","last_active":"2024-02-16T10:31:06.920148+0000","last_peered":"2024-02-16T10:31:06.920148+0000","last_clean":"2024-02-16T10:31:06.920148+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:31:06.920148+0000","last_undegraded":"2024-02-16T10:31:06.920148+0000","last_fullsized":"2024-02-16T10:31:06.920148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:10.723393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.874380+0000","last_change":"2024-02-16T10:30:34.123666+0000","last_active":"2024-02-16T10:32:08.874380+0000","last_peered":"2024-02-16T10:32:08.874380+0000","last_clean":"2024-02-16T10:32:08.874380+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:08.874380+0000","last_undegraded":"2024-02-16T10:32:08.874380+0000","last_fullsized":"2024-02-16T10:32:08.874380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:37.246851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924998+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:31:06.924998+0000","last_peered":"2024-02-16T10:31:06.924998+0000","last_clean":"2024-02-16T10:31:06.924998+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:31:06.924998+0000","last_undegraded":"2024-02-16T10:31:06.924998+0000","last_fullsized":"2024-02-16T10:31:06.924998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:20:59.097534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907950+0000","last_change":"2024-02-16T10:30:28.059745+0000","last_active":"2024-02-16T10:31:06.907950+0000","last_peered":"2024-02-16T10:31:06.907950+0000","last_clean":"2024-02-16T10:31:06.907950+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:31:06.907950+0000","last_undegraded":"2024-02-16T10:31:06.907950+0000","last_fullsized":"2024-02-16T10:31:06.907950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:30:20.455470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926582+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:31:06.926582+0000","last_peered":"2024-02-16T10:31:06.926582+0000","last_clean":"2024-02-16T10:31:06.926582+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:31:06.926582+0000","last_undegraded":"2024-02-16T10:31:06.926582+0000","last_fullsized":"2024-02-16T10:31:06.926582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934928+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:31:06.934928+0000","last_peered":"2024-02-16T10:31:06.934928+0000","last_clean":"2024-02-16T10:31:06.934928+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:31:06.934928+0000","last_undegraded":"2024-02-16T10:31:06.934928+0000","last_fullsized":"2024-02-16T10:31:06.934928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:43:19.170328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912208+0000","last_change":"2024-02-16T10:30:30.090784+0000","last_active":"2024-02-16T10:31:06.912208+0000","last_peered":"2024-02-16T10:31:06.912208+0000","last_clean":"2024-02-16T10:31:06.912208+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:31:06.912208+0000","last_undegraded":"2024-02-16T10:31:06.912208+0000","last_fullsized":"2024-02-16T10:31:06.912208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:16.786621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'85","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.088977+0000","last_change":"2024-02-16T10:30:32.086049+0000","last_active":"2024-02-16T10:32:09.088977+0000","last_peered":"2024-02-16T10:32:09.088977+0000","last_clean":"2024-02-16T10:32:09.088977+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:09.088977+0000","last_undegraded":"2024-02-16T10:32:09.088977+0000","last_fullsized":"2024-02-16T10:32:09.088977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:07.411102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924423+0000","last_change":"2024-02-16T10:30:34.118806+0000","last_active":"2024-02-16T10:31:06.924423+0000","last_peered":"2024-02-16T10:31:06.924423+0000","last_clean":"2024-02-16T10:31:06.924423+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:31:06.924423+0000","last_undegraded":"2024-02-16T10:31:06.924423+0000","last_fullsized":"2024-02-16T10:31:06.924423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:49.040182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917565+0000","last_change":"2024-02-16T10:30:36.134096+0000","last_active":"2024-02-16T10:31:06.917565+0000","last_peered":"2024-02-16T10:31:06.917565+0000","last_clean":"2024-02-16T10:31:06.917565+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:31:06.917565+0000","last_undegraded":"2024-02-16T10:31:06.917565+0000","last_fullsized":"2024-02-16T10:31:06.917565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:20.709724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915771+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:31:06.915771+0000","last_peered":"2024-02-16T10:31:06.915771+0000","last_clean":"2024-02-16T10:31:06.915771+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:31:06.915771+0000","last_undegraded":"2024-02-16T10:31:06.915771+0000","last_fullsized":"2024-02-16T10:31:06.915771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:31.149744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003456+0000","last_change":"2024-02-16T10:30:28.065560+0000","last_active":"2024-02-16T10:32:01.003456+0000","last_peered":"2024-02-16T10:32:01.003456+0000","last_clean":"2024-02-16T10:32:01.003456+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:01.003456+0000","last_undegraded":"2024-02-16T10:32:01.003456+0000","last_fullsized":"2024-02-16T10:32:01.003456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924689+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:31:06.924689+0000","last_peered":"2024-02-16T10:31:06.924689+0000","last_clean":"2024-02-16T10:31:06.924689+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:31:06.924689+0000","last_undegraded":"2024-02-16T10:31:06.924689+0000","last_fullsized":"2024-02-16T10:31:06.924689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:04.250123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912078+0000","last_change":"2024-02-16T10:30:30.099282+0000","last_active":"2024-02-16T10:31:06.912078+0000","last_peered":"2024-02-16T10:31:06.912078+0000","last_clean":"2024-02-16T10:31:06.912078+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:31:06.912078+0000","last_undegraded":"2024-02-16T10:31:06.912078+0000","last_fullsized":"2024-02-16T10:31:06.912078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:02:05.396237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.126987+0000","last_change":"2024-02-16T10:30:32.117290+0000","last_active":"2024-02-16T10:32:09.126987+0000","last_peered":"2024-02-16T10:32:09.126987+0000","last_clean":"2024-02-16T10:32:09.126987+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:09.126987+0000","last_undegraded":"2024-02-16T10:32:09.126987+0000","last_fullsized":"2024-02-16T10:32:09.126987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:56:10.257963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914793+0000","last_change":"2024-02-16T10:30:34.138222+0000","last_active":"2024-02-16T10:31:06.914793+0000","last_peered":"2024-02-16T10:31:06.914793+0000","last_clean":"2024-02-16T10:31:06.914793+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:31:06.914793+0000","last_undegraded":"2024-02-16T10:31:06.914793+0000","last_fullsized":"2024-02-16T10:31:06.914793+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:07:46.290268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927061+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:31:06.927061+0000","last_peered":"2024-02-16T10:31:06.927061+0000","last_clean":"2024-02-16T10:31:06.927061+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:31:06.927061+0000","last_undegraded":"2024-02-16T10:31:06.927061+0000","last_fullsized":"2024-02-16T10:31:06.927061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:29.115943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686067+0000","last_change":"2024-02-16T10:30:28.065164+0000","last_active":"2024-02-16T10:31:12.686067+0000","last_peered":"2024-02-16T10:31:12.686067+0000","last_clean":"2024-02-16T10:31:12.686067+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:31:12.686067+0000","last_undegraded":"2024-02-16T10:31:12.686067+0000","last_fullsized":"2024-02-16T10:31:12.686067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915272+0000","last_change":"2024-02-16T10:30:26.089582+0000","last_active":"2024-02-16T10:31:06.915272+0000","last_peered":"2024-02-16T10:31:06.915272+0000","last_clean":"2024-02-16T10:31:06.915272+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:31:06.915272+0000","last_undegraded":"2024-02-16T10:31:06.915272+0000","last_fullsized":"2024-02-16T10:31:06.915272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918652+0000","last_change":"2024-02-16T10:30:30.101510+0000","last_active":"2024-02-16T10:31:06.918652+0000","last_peered":"2024-02-16T10:31:06.918652+0000","last_clean":"2024-02-16T10:31:06.918652+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:31:06.918652+0000","last_undegraded":"2024-02-16T10:31:06.918652+0000","last_fullsized":"2024-02-16T10:31:06.918652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:57:18.360523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:47.841019+0000","last_change":"2024-02-16T10:30:32.096419+0000","last_active":"2024-02-16T10:31:47.841019+0000","last_peered":"2024-02-16T10:31:47.841019+0000","last_clean":"2024-02-16T10:31:47.841019+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:31:47.841019+0000","last_undegraded":"2024-02-16T10:31:47.841019+0000","last_fullsized":"2024-02-16T10:31:47.841019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:10:42.963873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908228+0000","last_change":"2024-02-16T10:30:34.143222+0000","last_active":"2024-02-16T10:31:06.908228+0000","last_peered":"2024-02-16T10:31:06.908228+0000","last_clean":"2024-02-16T10:31:06.908228+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:31:06.908228+0000","last_undegraded":"2024-02-16T10:31:06.908228+0000","last_fullsized":"2024-02-16T10:31:06.908228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:15.922444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926743+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926743+0000","last_peered":"2024-02-16T10:31:06.926743+0000","last_clean":"2024-02-16T10:31:06.926743+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926743+0000","last_undegraded":"2024-02-16T10:31:06.926743+0000","last_fullsized":"2024-02-16T10:31:06.926743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:59.110103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.998018+0000","last_change":"2024-02-16T10:30:28.063758+0000","last_active":"2024-02-16T10:31:11.998018+0000","last_peered":"2024-02-16T10:31:11.998018+0000","last_clean":"2024-02-16T10:31:11.998018+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:31:11.998018+0000","last_undegraded":"2024-02-16T10:31:11.998018+0000","last_fullsized":"2024-02-16T10:31:11.998018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922326+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:31:06.922326+0000","last_peered":"2024-02-16T10:31:06.922326+0000","last_clean":"2024-02-16T10:31:06.922326+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:31:06.922326+0000","last_undegraded":"2024-02-16T10:31:06.922326+0000","last_fullsized":"2024-02-16T10:31:06.922326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:05:41.945799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908145+0000","last_change":"2024-02-16T10:30:30.080008+0000","last_active":"2024-02-16T10:31:06.908145+0000","last_peered":"2024-02-16T10:31:06.908145+0000","last_clean":"2024-02-16T10:31:06.908145+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:31:06.908145+0000","last_undegraded":"2024-02-16T10:31:06.908145+0000","last_fullsized":"2024-02-16T10:31:06.908145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:54.244747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'37","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.055302+0000","last_change":"2024-02-16T10:30:32.092783+0000","last_active":"2024-02-16T10:32:09.055302+0000","last_peered":"2024-02-16T10:32:09.055302+0000","last_clean":"2024-02-16T10:32:09.055302+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:09.055302+0000","last_undegraded":"2024-02-16T10:32:09.055302+0000","last_fullsized":"2024-02-16T10:32:09.055302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:55:45.366198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911478+0000","last_change":"2024-02-16T10:30:34.111884+0000","last_active":"2024-02-16T10:31:06.911478+0000","last_peered":"2024-02-16T10:31:06.911478+0000","last_clean":"2024-02-16T10:31:06.911478+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:31:06.911478+0000","last_undegraded":"2024-02-16T10:31:06.911478+0000","last_fullsized":"2024-02-16T10:31:06.911478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922646+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922646+0000","last_peered":"2024-02-16T10:31:06.922646+0000","last_clean":"2024-02-16T10:31:06.922646+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922646+0000","last_undegraded":"2024-02-16T10:31:06.922646+0000","last_fullsized":"2024-02-16T10:31:06.922646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:14:05.173479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'5","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003196+0000","last_change":"2024-02-16T10:30:28.083725+0000","last_active":"2024-02-16T10:32:01.003196+0000","last_peered":"2024-02-16T10:32:01.003196+0000","last_clean":"2024-02-16T10:32:01.003196+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:01.003196+0000","last_undegraded":"2024-02-16T10:32:01.003196+0000","last_fullsized":"2024-02-16T10:32:01.003196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:08:02.265809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928210+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:31:06.928210+0000","last_peered":"2024-02-16T10:31:06.928210+0000","last_clean":"2024-02-16T10:31:06.928210+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:31:06.928210+0000","last_undegraded":"2024-02-16T10:31:06.928210+0000","last_fullsized":"2024-02-16T10:31:06.928210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:00:02.386366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915480+0000","last_change":"2024-02-16T10:30:30.096518+0000","last_active":"2024-02-16T10:31:06.915480+0000","last_peered":"2024-02-16T10:31:06.915480+0000","last_clean":"2024-02-16T10:31:06.915480+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:31:06.915480+0000","last_undegraded":"2024-02-16T10:31:06.915480+0000","last_fullsized":"2024-02-16T10:31:06.915480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:10:33.218041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'31","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.034499+0000","last_change":"2024-02-16T10:30:32.090307+0000","last_active":"2024-02-16T10:32:09.034499+0000","last_peered":"2024-02-16T10:32:09.034499+0000","last_clean":"2024-02-16T10:32:09.034499+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:09.034499+0000","last_undegraded":"2024-02-16T10:32:09.034499+0000","last_fullsized":"2024-02-16T10:32:09.034499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:14.119162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911888+0000","last_change":"2024-02-16T10:30:34.119744+0000","last_active":"2024-02-16T10:31:06.911888+0000","last_peered":"2024-02-16T10:31:06.911888+0000","last_clean":"2024-02-16T10:31:06.911888+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:31:06.911888+0000","last_undegraded":"2024-02-16T10:31:06.911888+0000","last_fullsized":"2024-02-16T10:31:06.911888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:56.895959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498313+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:31:54.498313+0000","last_peered":"2024-02-16T10:31:54.498313+0000","last_clean":"2024-02-16T10:31:54.498313+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:31:54.498313+0000","last_undegraded":"2024-02-16T10:31:54.498313+0000","last_fullsized":"2024-02-16T10:31:54.498313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:46:27.042111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912785+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:31:06.912785+0000","last_peered":"2024-02-16T10:31:06.912785+0000","last_clean":"2024-02-16T10:31:06.912785+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:31:06.912785+0000","last_undegraded":"2024-02-16T10:31:06.912785+0000","last_fullsized":"2024-02-16T10:31:06.912785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:54.625844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936294+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:06.936294+0000","last_peered":"2024-02-16T10:31:06.936294+0000","last_clean":"2024-02-16T10:31:06.936294+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:06.936294+0000","last_undegraded":"2024-02-16T10:31:06.936294+0000","last_fullsized":"2024-02-16T10:31:06.936294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:02:44.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'57","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.026549+0000","last_change":"2024-02-16T10:30:32.092432+0000","last_active":"2024-02-16T10:32:09.026549+0000","last_peered":"2024-02-16T10:32:09.026549+0000","last_clean":"2024-02-16T10:32:09.026549+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:09.026549+0000","last_undegraded":"2024-02-16T10:32:09.026549+0000","last_fullsized":"2024-02-16T10:32:09.026549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:34.487177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913394+0000","last_change":"2024-02-16T10:30:34.119818+0000","last_active":"2024-02-16T10:31:06.913394+0000","last_peered":"2024-02-16T10:31:06.913394+0000","last_clean":"2024-02-16T10:31:06.913394+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:31:06.913394+0000","last_undegraded":"2024-02-16T10:31:06.913394+0000","last_fullsized":"2024-02-16T10:31:06.913394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:32:36.501122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.987273+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:00.987273+0000","last_peered":"2024-02-16T10:32:00.987273+0000","last_clean":"2024-02-16T10:32:00.987273+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:00.987273+0000","last_undegraded":"2024-02-16T10:32:00.987273+0000","last_fullsized":"2024-02-16T10:32:00.987273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930607+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:31:06.930607+0000","last_peered":"2024-02-16T10:31:06.930607+0000","last_clean":"2024-02-16T10:31:06.930607+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:31:06.930607+0000","last_undegraded":"2024-02-16T10:31:06.930607+0000","last_fullsized":"2024-02-16T10:31:06.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:05:23.244240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911567+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:31:06.911567+0000","last_peered":"2024-02-16T10:31:06.911567+0000","last_clean":"2024-02-16T10:31:06.911567+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:31:06.911567+0000","last_undegraded":"2024-02-16T10:31:06.911567+0000","last_fullsized":"2024-02-16T10:31:06.911567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:41:36.991486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917057+0000","last_change":"2024-02-16T10:30:30.075709+0000","last_active":"2024-02-16T10:31:06.917057+0000","last_peered":"2024-02-16T10:31:06.917057+0000","last_clean":"2024-02-16T10:31:06.917057+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:31:06.917057+0000","last_undegraded":"2024-02-16T10:31:06.917057+0000","last_fullsized":"2024-02-16T10:31:06.917057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:26.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.040668+0000","last_change":"2024-02-16T10:30:32.122498+0000","last_active":"2024-02-16T10:32:09.040668+0000","last_peered":"2024-02-16T10:32:09.040668+0000","last_clean":"2024-02-16T10:32:09.040668+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:09.040668+0000","last_undegraded":"2024-02-16T10:32:09.040668+0000","last_fullsized":"2024-02-16T10:32:09.040668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:58:17.677726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925017+0000","last_change":"2024-02-16T10:30:34.125516+0000","last_active":"2024-02-16T10:31:06.925017+0000","last_peered":"2024-02-16T10:31:06.925017+0000","last_clean":"2024-02-16T10:31:06.925017+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:31:06.925017+0000","last_undegraded":"2024-02-16T10:31:06.925017+0000","last_fullsized":"2024-02-16T10:31:06.925017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:33.536109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914711+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914711+0000","last_peered":"2024-02-16T10:31:06.914711+0000","last_clean":"2024-02-16T10:31:06.914711+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914711+0000","last_undegraded":"2024-02-16T10:31:06.914711+0000","last_fullsized":"2024-02-16T10:31:06.914711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:03:24.665857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354694+0000","last_change":"2024-02-16T10:30:28.087170+0000","last_active":"2024-02-16T10:31:55.354694+0000","last_peered":"2024-02-16T10:31:55.354694+0000","last_clean":"2024-02-16T10:31:55.354694+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:31:55.354694+0000","last_undegraded":"2024-02-16T10:31:55.354694+0000","last_fullsized":"2024-02-16T10:31:55.354694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:45:43.039912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912283+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912283+0000","last_peered":"2024-02-16T10:31:06.912283+0000","last_clean":"2024-02-16T10:31:06.912283+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912283+0000","last_undegraded":"2024-02-16T10:31:06.912283+0000","last_fullsized":"2024-02-16T10:31:06.912283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915313+0000","last_change":"2024-02-16T10:30:30.076018+0000","last_active":"2024-02-16T10:31:06.915313+0000","last_peered":"2024-02-16T10:31:06.915313+0000","last_clean":"2024-02-16T10:31:06.915313+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:31:06.915313+0000","last_undegraded":"2024-02-16T10:31:06.915313+0000","last_fullsized":"2024-02-16T10:31:06.915313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:08.463191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.949525+0000","last_change":"2024-02-16T10:30:32.119391+0000","last_active":"2024-02-16T10:32:08.949525+0000","last_peered":"2024-02-16T10:32:08.949525+0000","last_clean":"2024-02-16T10:32:08.949525+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:08.949525+0000","last_undegraded":"2024-02-16T10:32:08.949525+0000","last_fullsized":"2024-02-16T10:32:08.949525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:54.882014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927434+0000","last_change":"2024-02-16T10:30:34.124775+0000","last_active":"2024-02-16T10:31:06.927434+0000","last_peered":"2024-02-16T10:31:06.927434+0000","last_clean":"2024-02-16T10:31:06.927434+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:31:06.927434+0000","last_undegraded":"2024-02-16T10:31:06.927434+0000","last_fullsized":"2024-02-16T10:31:06.927434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:35.295960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917230+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917230+0000","last_peered":"2024-02-16T10:31:06.917230+0000","last_clean":"2024-02-16T10:31:06.917230+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917230+0000","last_undegraded":"2024-02-16T10:31:06.917230+0000","last_fullsized":"2024-02-16T10:31:06.917230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.882409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930153+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930153+0000","last_peered":"2024-02-16T10:31:06.930153+0000","last_clean":"2024-02-16T10:31:06.930153+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930153+0000","last_undegraded":"2024-02-16T10:31:06.930153+0000","last_fullsized":"2024-02-16T10:31:06.930153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.163010+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.163010+0000","last_peered":"2024-02-16T10:31:11.163010+0000","last_clean":"2024-02-16T10:31:11.163010+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.163010+0000","last_undegraded":"2024-02-16T10:31:11.163010+0000","last_fullsized":"2024-02-16T10:31:11.163010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:31.255409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925657+0000","last_change":"2024-02-16T10:30:30.091253+0000","last_active":"2024-02-16T10:31:06.925657+0000","last_peered":"2024-02-16T10:31:06.925657+0000","last_clean":"2024-02-16T10:31:06.925657+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:31:06.925657+0000","last_undegraded":"2024-02-16T10:31:06.925657+0000","last_fullsized":"2024-02-16T10:31:06.925657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:48:43.522418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930647+0000","last_change":"2024-02-16T10:30:32.123357+0000","last_active":"2024-02-16T10:31:06.930647+0000","last_peered":"2024-02-16T10:31:06.930647+0000","last_clean":"2024-02-16T10:31:06.930647+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:31:06.930647+0000","last_undegraded":"2024-02-16T10:31:06.930647+0000","last_fullsized":"2024-02-16T10:31:06.930647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:56:50.568670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":293,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.862012+0000","last_change":"2024-02-16T10:30:34.143270+0000","last_active":"2024-02-16T10:32:08.862012+0000","last_peered":"2024-02-16T10:32:08.862012+0000","last_clean":"2024-02-16T10:32:08.862012+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:08.862012+0000","last_undegraded":"2024-02-16T10:32:08.862012+0000","last_fullsized":"2024-02-16T10:32:08.862012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:56:51.931876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913269+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913269+0000","last_peered":"2024-02-16T10:31:06.913269+0000","last_clean":"2024-02-16T10:31:06.913269+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913269+0000","last_undegraded":"2024-02-16T10:31:06.913269+0000","last_fullsized":"2024-02-16T10:31:06.913269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:47:45.661564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913938+0000","last_change":"2024-02-16T10:30:28.068653+0000","last_active":"2024-02-16T10:31:06.913938+0000","last_peered":"2024-02-16T10:31:06.913938+0000","last_clean":"2024-02-16T10:31:06.913938+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:31:06.913938+0000","last_undegraded":"2024-02-16T10:31:06.913938+0000","last_fullsized":"2024-02-16T10:31:06.913938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:43:19.170808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.971149+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.971149+0000","last_peered":"2024-02-16T10:31:11.971149+0000","last_clean":"2024-02-16T10:31:11.971149+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.971149+0000","last_undegraded":"2024-02-16T10:31:11.971149+0000","last_fullsized":"2024-02-16T10:31:11.971149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:03:19.159324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912004+0000","last_change":"2024-02-16T10:30:30.097916+0000","last_active":"2024-02-16T10:31:06.912004+0000","last_peered":"2024-02-16T10:31:06.912004+0000","last_clean":"2024-02-16T10:31:06.912004+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:31:06.912004+0000","last_undegraded":"2024-02-16T10:31:06.912004+0000","last_fullsized":"2024-02-16T10:31:06.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:12:31.161114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.985260+0000","last_change":"2024-02-16T10:30:32.097289+0000","last_active":"2024-02-16T10:32:08.985260+0000","last_peered":"2024-02-16T10:32:08.985260+0000","last_clean":"2024-02-16T10:32:08.985260+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:08.985260+0000","last_undegraded":"2024-02-16T10:32:08.985260+0000","last_fullsized":"2024-02-16T10:32:08.985260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:53:01.486352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923897+0000","last_change":"2024-02-16T10:30:34.135806+0000","last_active":"2024-02-16T10:31:06.923897+0000","last_peered":"2024-02-16T10:31:06.923897+0000","last_clean":"2024-02-16T10:31:06.923897+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:31:06.923897+0000","last_undegraded":"2024-02-16T10:31:06.923897+0000","last_fullsized":"2024-02-16T10:31:06.923897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:19:34.793892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.688719+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.688719+0000","last_peered":"2024-02-16T10:31:12.688719+0000","last_clean":"2024-02-16T10:31:12.688719+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.688719+0000","last_undegraded":"2024-02-16T10:31:12.688719+0000","last_fullsized":"2024-02-16T10:31:12.688719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:51:39.910250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'13","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003577+0000","last_change":"2024-02-16T10:30:28.068349+0000","last_active":"2024-02-16T10:32:01.003577+0000","last_peered":"2024-02-16T10:32:01.003577+0000","last_clean":"2024-02-16T10:32:01.003577+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:01.003577+0000","last_undegraded":"2024-02-16T10:32:01.003577+0000","last_fullsized":"2024-02-16T10:32:01.003577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926497+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926497+0000","last_peered":"2024-02-16T10:31:06.926497+0000","last_clean":"2024-02-16T10:31:06.926497+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926497+0000","last_undegraded":"2024-02-16T10:31:06.926497+0000","last_fullsized":"2024-02-16T10:31:06.926497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:35.881032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914335+0000","last_change":"2024-02-16T10:30:30.074767+0000","last_active":"2024-02-16T10:31:06.914335+0000","last_peered":"2024-02-16T10:31:06.914335+0000","last_clean":"2024-02-16T10:31:06.914335+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:31:06.914335+0000","last_undegraded":"2024-02-16T10:31:06.914335+0000","last_fullsized":"2024-02-16T10:31:06.914335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:17.473427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.993115+0000","last_change":"2024-02-16T10:30:32.089195+0000","last_active":"2024-02-16T10:32:08.993115+0000","last_peered":"2024-02-16T10:32:08.993115+0000","last_clean":"2024-02-16T10:32:08.993115+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:08.993115+0000","last_undegraded":"2024-02-16T10:32:08.993115+0000","last_fullsized":"2024-02-16T10:32:08.993115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:43.979549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914695+0000","last_change":"2024-02-16T10:30:34.138612+0000","last_active":"2024-02-16T10:31:06.914695+0000","last_peered":"2024-02-16T10:31:06.914695+0000","last_clean":"2024-02-16T10:31:06.914695+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:31:06.914695+0000","last_undegraded":"2024-02-16T10:31:06.914695+0000","last_fullsized":"2024-02-16T10:31:06.914695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:16.947910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931060+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931060+0000","last_peered":"2024-02-16T10:31:06.931060+0000","last_clean":"2024-02-16T10:31:06.931060+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931060+0000","last_undegraded":"2024-02-16T10:31:06.931060+0000","last_fullsized":"2024-02-16T10:31:06.931060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:38:04.374041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498061+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.498061+0000","last_peered":"2024-02-16T10:31:54.498061+0000","last_clean":"2024-02-16T10:31:54.498061+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.498061+0000","last_undegraded":"2024-02-16T10:31:54.498061+0000","last_fullsized":"2024-02-16T10:31:54.498061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:13:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.347024+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:31:55.347024+0000","last_peered":"2024-02-16T10:31:55.347024+0000","last_clean":"2024-02-16T10:31:55.347024+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:31:55.347024+0000","last_undegraded":"2024-02-16T10:31:55.347024+0000","last_fullsized":"2024-02-16T10:31:55.347024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:49:13.928686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.910958+0000","last_change":"2024-02-16T10:30:30.098954+0000","last_active":"2024-02-16T10:31:06.910958+0000","last_peered":"2024-02-16T10:31:06.910958+0000","last_clean":"2024-02-16T10:31:06.910958+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:31:06.910958+0000","last_undegraded":"2024-02-16T10:31:06.910958+0000","last_fullsized":"2024-02-16T10:31:06.910958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:06:09.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'28","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.940348+0000","last_change":"2024-02-16T10:30:32.120059+0000","last_active":"2024-02-16T10:32:08.940348+0000","last_peered":"2024-02-16T10:32:08.940348+0000","last_clean":"2024-02-16T10:32:08.940348+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:08.940348+0000","last_undegraded":"2024-02-16T10:32:08.940348+0000","last_fullsized":"2024-02-16T10:32:08.940348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:54.720052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915718+0000","last_change":"2024-02-16T10:30:34.139182+0000","last_active":"2024-02-16T10:31:06.915718+0000","last_peered":"2024-02-16T10:31:06.915718+0000","last_clean":"2024-02-16T10:31:06.915718+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:31:06.915718+0000","last_undegraded":"2024-02-16T10:31:06.915718+0000","last_fullsized":"2024-02-16T10:31:06.915718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:33.233363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.660952+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.660952+0000","last_peered":"2024-02-16T10:31:11.660952+0000","last_clean":"2024-02-16T10:31:11.660952+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.660952+0000","last_undegraded":"2024-02-16T10:31:11.660952+0000","last_fullsized":"2024-02-16T10:31:11.660952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:08.234713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.002993+0000","last_change":"2024-02-16T10:30:28.068221+0000","last_active":"2024-02-16T10:32:01.002993+0000","last_peered":"2024-02-16T10:32:01.002993+0000","last_clean":"2024-02-16T10:32:01.002993+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:01.002993+0000","last_undegraded":"2024-02-16T10:32:01.002993+0000","last_fullsized":"2024-02-16T10:32:01.002993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:22:33.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928894+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:31:06.928894+0000","last_peered":"2024-02-16T10:31:06.928894+0000","last_clean":"2024-02-16T10:31:06.928894+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:31:06.928894+0000","last_undegraded":"2024-02-16T10:31:06.928894+0000","last_fullsized":"2024-02-16T10:31:06.928894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'7","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.828287+0000","last_change":"2024-02-16T10:30:30.090010+0000","last_active":"2024-02-16T10:32:08.828287+0000","last_peered":"2024-02-16T10:32:08.828287+0000","last_clean":"2024-02-16T10:32:08.828287+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:08.828287+0000","last_undegraded":"2024-02-16T10:32:08.828287+0000","last_fullsized":"2024-02-16T10:32:08.828287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:01:04.245545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.954066+0000","last_change":"2024-02-16T10:30:32.120625+0000","last_active":"2024-02-16T10:32:08.954066+0000","last_peered":"2024-02-16T10:32:08.954066+0000","last_clean":"2024-02-16T10:32:08.954066+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:08.954066+0000","last_undegraded":"2024-02-16T10:32:08.954066+0000","last_fullsized":"2024-02-16T10:32:08.954066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:00:10.689555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926215+0000","last_change":"2024-02-16T10:30:34.104811+0000","last_active":"2024-02-16T10:31:06.926215+0000","last_peered":"2024-02-16T10:31:06.926215+0000","last_clean":"2024-02-16T10:31:06.926215+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:31:06.926215+0000","last_undegraded":"2024-02-16T10:31:06.926215+0000","last_fullsized":"2024-02-16T10:31:06.926215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:05.490555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923461+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923461+0000","last_peered":"2024-02-16T10:31:06.923461+0000","last_clean":"2024-02-16T10:31:06.923461+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923461+0000","last_undegraded":"2024-02-16T10:31:06.923461+0000","last_fullsized":"2024-02-16T10:31:06.923461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:37:05.711450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930585+0000","last_change":"2024-02-16T10:30:28.085439+0000","last_active":"2024-02-16T10:31:06.930585+0000","last_peered":"2024-02-16T10:31:06.930585+0000","last_clean":"2024-02-16T10:31:06.930585+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:31:06.930585+0000","last_undegraded":"2024-02-16T10:31:06.930585+0000","last_fullsized":"2024-02-16T10:31:06.930585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:24.178735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.906798+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:31:06.906798+0000","last_peered":"2024-02-16T10:31:06.906798+0000","last_clean":"2024-02-16T10:31:06.906798+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:31:06.906798+0000","last_undegraded":"2024-02-16T10:31:06.906798+0000","last_fullsized":"2024-02-16T10:31:06.906798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:32:42.315810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.354785+0000","last_change":"2024-02-16T10:30:28.066897+0000","last_active":"2024-02-16T10:31:55.354785+0000","last_peered":"2024-02-16T10:31:55.354785+0000","last_clean":"2024-02-16T10:31:55.354785+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:31:55.354785+0000","last_undegraded":"2024-02-16T10:31:55.354785+0000","last_fullsized":"2024-02-16T10:31:55.354785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924256+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:31:06.924256+0000","last_peered":"2024-02-16T10:31:06.924256+0000","last_clean":"2024-02-16T10:31:06.924256+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:31:06.924256+0000","last_undegraded":"2024-02-16T10:31:06.924256+0000","last_fullsized":"2024-02-16T10:31:06.924256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.497934+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:31:54.497934+0000","last_peered":"2024-02-16T10:31:54.497934+0000","last_clean":"2024-02-16T10:31:54.497934+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:31:54.497934+0000","last_undegraded":"2024-02-16T10:31:54.497934+0000","last_fullsized":"2024-02-16T10:31:54.497934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:39.952356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918764+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:31:06.918764+0000","last_peered":"2024-02-16T10:31:06.918764+0000","last_clean":"2024-02-16T10:31:06.918764+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:31:06.918764+0000","last_undegraded":"2024-02-16T10:31:06.918764+0000","last_fullsized":"2024-02-16T10:31:06.918764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:44:00.902889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.367527+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:31:55.367527+0000","last_peered":"2024-02-16T10:31:55.367527+0000","last_clean":"2024-02-16T10:31:55.367527+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:31:55.367527+0000","last_undegraded":"2024-02-16T10:31:55.367527+0000","last_fullsized":"2024-02-16T10:31:55.367527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927369+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:31:06.927369+0000","last_peered":"2024-02-16T10:31:06.927369+0000","last_clean":"2024-02-16T10:31:06.927369+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:31:06.927369+0000","last_undegraded":"2024-02-16T10:31:06.927369+0000","last_fullsized":"2024-02-16T10:31:06.927369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:17:32.408936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003265+0000","last_change":"2024-02-16T10:30:28.070344+0000","last_active":"2024-02-16T10:32:01.003265+0000","last_peered":"2024-02-16T10:32:01.003265+0000","last_clean":"2024-02-16T10:32:01.003265+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:01.003265+0000","last_undegraded":"2024-02-16T10:32:01.003265+0000","last_fullsized":"2024-02-16T10:32:01.003265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:33:45.246492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929450+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:31:06.929450+0000","last_peered":"2024-02-16T10:31:06.929450+0000","last_clean":"2024-02-16T10:31:06.929450+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:31:06.929450+0000","last_undegraded":"2024-02-16T10:31:06.929450+0000","last_fullsized":"2024-02-16T10:31:06.929450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:42:38.732821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922892+0000","last_change":"2024-02-16T10:30:28.084698+0000","last_active":"2024-02-16T10:31:06.922892+0000","last_peered":"2024-02-16T10:31:06.922892+0000","last_clean":"2024-02-16T10:31:06.922892+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:31:06.922892+0000","last_undegraded":"2024-02-16T10:31:06.922892+0000","last_fullsized":"2024-02-16T10:31:06.922892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:15.266995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925916+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:31:06.925916+0000","last_peered":"2024-02-16T10:31:06.925916+0000","last_clean":"2024-02-16T10:31:06.925916+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:31:06.925916+0000","last_undegraded":"2024-02-16T10:31:06.925916+0000","last_fullsized":"2024-02-16T10:31:06.925916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197265+0000","last_change":"2024-02-16T10:30:28.088710+0000","last_active":"2024-02-16T10:31:11.197265+0000","last_peered":"2024-02-16T10:31:11.197265+0000","last_clean":"2024-02-16T10:31:11.197265+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:31:11.197265+0000","last_undegraded":"2024-02-16T10:31:11.197265+0000","last_fullsized":"2024-02-16T10:31:11.197265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:26:23.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922587+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:31:06.922587+0000","last_peered":"2024-02-16T10:31:06.922587+0000","last_clean":"2024-02-16T10:31:06.922587+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:31:06.922587+0000","last_undegraded":"2024-02-16T10:31:06.922587+0000","last_fullsized":"2024-02-16T10:31:06.922587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:17:39.478963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498941+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:31:54.498941+0000","last_peered":"2024-02-16T10:31:54.498941+0000","last_clean":"2024-02-16T10:31:54.498941+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:31:54.498941+0000","last_undegraded":"2024-02-16T10:31:54.498941+0000","last_fullsized":"2024-02-16T10:31:54.498941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:14:20.332951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930315+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:31:06.930315+0000","last_peered":"2024-02-16T10:31:06.930315+0000","last_clean":"2024-02-16T10:31:06.930315+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:31:06.930315+0000","last_undegraded":"2024-02-16T10:31:06.930315+0000","last_fullsized":"2024-02-16T10:31:06.930315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:36:57.326356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.996262+0000","last_change":"2024-02-16T10:30:28.082754+0000","last_active":"2024-02-16T10:31:11.996262+0000","last_peered":"2024-02-16T10:31:11.996262+0000","last_clean":"2024-02-16T10:31:11.996262+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:31:11.996262+0000","last_undegraded":"2024-02-16T10:31:11.996262+0000","last_fullsized":"2024-02-16T10:31:11.996262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:05:11.823357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913459+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:31:06.913459+0000","last_peered":"2024-02-16T10:31:06.913459+0000","last_clean":"2024-02-16T10:31:06.913459+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:31:06.913459+0000","last_undegraded":"2024-02-16T10:31:06.913459+0000","last_fullsized":"2024-02-16T10:31:06.913459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:00:10.245816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003021+0000","last_change":"2024-02-16T10:30:28.069630+0000","last_active":"2024-02-16T10:32:01.003021+0000","last_peered":"2024-02-16T10:32:01.003021+0000","last_clean":"2024-02-16T10:32:01.003021+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:01.003021+0000","last_undegraded":"2024-02-16T10:32:01.003021+0000","last_fullsized":"2024-02-16T10:32:01.003021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:21:11.835947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924942+0000","last_change":"2024-02-16T10:30:26.099907+0000","last_active":"2024-02-16T10:31:06.924942+0000","last_peered":"2024-02-16T10:31:06.924942+0000","last_clean":"2024-02-16T10:31:06.924942+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:31:06.924942+0000","last_undegraded":"2024-02-16T10:31:06.924942+0000","last_fullsized":"2024-02-16T10:31:06.924942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.687640+0000","last_change":"2024-02-16T10:30:28.065907+0000","last_active":"2024-02-16T10:31:12.687640+0000","last_peered":"2024-02-16T10:31:12.687640+0000","last_clean":"2024-02-16T10:31:12.687640+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:31:12.687640+0000","last_undegraded":"2024-02-16T10:31:12.687640+0000","last_fullsized":"2024-02-16T10:31:12.687640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:07.573951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922132+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:31:06.922132+0000","last_peered":"2024-02-16T10:31:06.922132+0000","last_clean":"2024-02-16T10:31:06.922132+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:31:06.922132+0000","last_undegraded":"2024-02-16T10:31:06.922132+0000","last_fullsized":"2024-02-16T10:31:06.922132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927080+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:31:06.927080+0000","last_peered":"2024-02-16T10:31:06.927080+0000","last_clean":"2024-02-16T10:31:06.927080+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:31:06.927080+0000","last_undegraded":"2024-02-16T10:31:06.927080+0000","last_fullsized":"2024-02-16T10:31:06.927080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:34:15.461099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919178+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:31:06.919178+0000","last_peered":"2024-02-16T10:31:06.919178+0000","last_clean":"2024-02-16T10:31:06.919178+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:31:06.919178+0000","last_undegraded":"2024-02-16T10:31:06.919178+0000","last_fullsized":"2024-02-16T10:31:06.919178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:58:42.577622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.686094+0000","last_change":"2024-02-16T10:30:28.065620+0000","last_active":"2024-02-16T10:31:12.686094+0000","last_peered":"2024-02-16T10:31:12.686094+0000","last_clean":"2024-02-16T10:31:12.686094+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:31:12.686094+0000","last_undegraded":"2024-02-16T10:31:12.686094+0000","last_fullsized":"2024-02-16T10:31:12.686094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925237+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:31:06.925237+0000","last_peered":"2024-02-16T10:31:06.925237+0000","last_clean":"2024-02-16T10:31:06.925237+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:31:06.925237+0000","last_undegraded":"2024-02-16T10:31:06.925237+0000","last_fullsized":"2024-02-16T10:31:06.925237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:28:35.916782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.197558+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:31:11.197558+0000","last_peered":"2024-02-16T10:31:11.197558+0000","last_clean":"2024-02-16T10:31:11.197558+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:31:11.197558+0000","last_undegraded":"2024-02-16T10:31:11.197558+0000","last_fullsized":"2024-02-16T10:31:11.197558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:04.716087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930984+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:31:06.930984+0000","last_peered":"2024-02-16T10:31:06.930984+0000","last_clean":"2024-02-16T10:31:06.930984+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:31:06.930984+0000","last_undegraded":"2024-02-16T10:31:06.930984+0000","last_fullsized":"2024-02-16T10:31:06.930984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:45.770711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.003087+0000","last_change":"2024-02-16T10:30:28.087215+0000","last_active":"2024-02-16T10:32:01.003087+0000","last_peered":"2024-02-16T10:32:01.003087+0000","last_clean":"2024-02-16T10:32:01.003087+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:01.003087+0000","last_undegraded":"2024-02-16T10:32:01.003087+0000","last_fullsized":"2024-02-16T10:32:01.003087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:57:06.402688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923234+0000","last_change":"2024-02-16T10:30:26.083864+0000","last_active":"2024-02-16T10:31:06.923234+0000","last_peered":"2024-02-16T10:31:06.923234+0000","last_clean":"2024-02-16T10:31:06.923234+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:31:06.923234+0000","last_undegraded":"2024-02-16T10:31:06.923234+0000","last_fullsized":"2024-02-16T10:31:06.923234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:33.409408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917305+0000","last_change":"2024-02-16T10:30:28.072935+0000","last_active":"2024-02-16T10:31:06.917305+0000","last_peered":"2024-02-16T10:31:06.917305+0000","last_clean":"2024-02-16T10:31:06.917305+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:31:06.917305+0000","last_undegraded":"2024-02-16T10:31:06.917305+0000","last_fullsized":"2024-02-16T10:31:06.917305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:06:39.390844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934783+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:31:06.934783+0000","last_peered":"2024-02-16T10:31:06.934783+0000","last_clean":"2024-02-16T10:31:06.934783+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:31:06.934783+0000","last_undegraded":"2024-02-16T10:31:06.934783+0000","last_fullsized":"2024-02-16T10:31:06.934783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:02.701519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.982355+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:31:11.982355+0000","last_peered":"2024-02-16T10:31:11.982355+0000","last_clean":"2024-02-16T10:31:11.982355+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:31:11.982355+0000","last_undegraded":"2024-02-16T10:31:11.982355+0000","last_fullsized":"2024-02-16T10:31:11.982355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:15:33.732608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932493+0000","last_change":"2024-02-16T10:30:28.088605+0000","last_active":"2024-02-16T10:31:06.932493+0000","last_peered":"2024-02-16T10:31:06.932493+0000","last_clean":"2024-02-16T10:31:06.932493+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:31:06.932493+0000","last_undegraded":"2024-02-16T10:31:06.932493+0000","last_fullsized":"2024-02-16T10:31:06.932493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:15:29.431886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925231+0000","last_change":"2024-02-16T10:30:26.100409+0000","last_active":"2024-02-16T10:31:06.925231+0000","last_peered":"2024-02-16T10:31:06.925231+0000","last_clean":"2024-02-16T10:31:06.925231+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:31:06.925231+0000","last_undegraded":"2024-02-16T10:31:06.925231+0000","last_fullsized":"2024-02-16T10:31:06.925231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:45:09.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.498959+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.498959+0000","last_peered":"2024-02-16T10:31:54.498959+0000","last_clean":"2024-02-16T10:31:54.498959+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.498959+0000","last_undegraded":"2024-02-16T10:31:54.498959+0000","last_fullsized":"2024-02-16T10:31:54.498959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:13:02.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705691,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:31:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":8.2560000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":24.481999999999999,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Feb 16 10:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":7.8230000000000004,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":18.614999999999998,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.66900000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:31:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.49399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.58299999999999996,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88900000000000001,"5min":1.115,"15min":1.115},"last":0.439},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:13.994 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.994 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.995 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.996 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.997 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.998 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:13.999 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.000 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.000 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.000 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.000 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.001 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.001 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.001 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.001 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.001 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.002 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.003 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.004 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.004 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.004 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.004 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.004 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.005 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.006 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.007 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.008 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.008 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.008 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.008 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.008 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.009 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.010 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.010 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.010 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.011 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.011 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.011 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.012 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.012 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.013 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.013 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.013 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.014 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.014 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.014 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:30:11.961442+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.015 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.015 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.015 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.016 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.016 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.016 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.017 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.017 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.017 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.018 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.018 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.019 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.019 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.019 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.020 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.020 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.020 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.020 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.021 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.021 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.021 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.022 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.022 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.022 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.023 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.023 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.023 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.024 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.024 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.024 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.025 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.025 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.026 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.026 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.026 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.027 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.027 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.027 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.028 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.028 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.028 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.029 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.029 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.029 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.030 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.030 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.030 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.031 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.031 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.032 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.032 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.032 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.033 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.033 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.033 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.033 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.034 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.034 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.034 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.035 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.035 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.035 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.035 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.036 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.036 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.036 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.036 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.037 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.037 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.037 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.038 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.038 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.038 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.038 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.038 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.039 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.040 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.041 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.042 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.042 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.042 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.043 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.044 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.045 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.046 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.047 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.048 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.048 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.048 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.048 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.048 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.049 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.050 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.051 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.052 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.052 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.052 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.053 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.053 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.053 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.053 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.053 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.054 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:14.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:32:34.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:34.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.182+0000 7f7025dbb640 1 Processor -- start 2024-02-16T10:32:34.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.182+0000 7f7025dbb640 1 -- start start 2024-02-16T10:32:34.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f702006f8b0 0x7f702012c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:34.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7020072450 con 0x7f702012c750 2024-02-16T10:32:34.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702012cb60 con 0x7f702006f8b0 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f702006f8b0 0x7f702012c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701effd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f702012c750 0x7f7020128690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:47386/0 (socket says 172.21.15.107:47386) 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701effd640 1 -- 172.21.15.107:0/2602521222 learned_addr learned my addr 172.21.15.107:0/2602521222 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701e7fc640 1 -- 172.21.15.107:0/2602521222 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912149269 0 0) 0x7f7020072450 con 0x7f702012c750 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701e7fc640 1 -- 172.21.15.107:0/2602521222 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7008003530 con 0x7f702012c750 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701f7fe640 1 -- 172.21.15.107:0/2602521222 >> v1:172.21.15.107:6789/0 conn(0x7f702012c750 legacy=0x7f7020128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:34.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701f7fe640 1 -- 172.21.15.107:0/2602521222 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702012bed0 con 0x7f702006f8b0 2024-02-16T10:32:34.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701f7fe640 1 --2- 172.21.15.107:0/2602521222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f702012c210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7014009740 tx=0x7f701401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94b8781363041c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:34.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701e7fc640 1 -- 172.21.15.107:0/2602521222 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70140ab530 con 0x7f702006f8b0 2024-02-16T10:32:34.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701e7fc640 1 -- 172.21.15.107:0/2602521222 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70140a7050 con 0x7f702006f8b0 2024-02-16T10:32:34.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f701e7fc640 1 -- 172.21.15.107:0/2602521222 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70140ab7e0 con 0x7f702006f8b0 2024-02-16T10:32:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- 172.21.15.107:0/2602521222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 msgr2=0x7f702012c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 --2- 172.21.15.107:0/2602521222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f702012c210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7014009740 tx=0x7f701401c370 comp rx=0 tx=0).stop 2024-02-16T10:32:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- 172.21.15.107:0/2602521222 shutdown_connections 2024-02-16T10:32:34.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 --2- 172.21.15.107:0/2602521222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f702012c210 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- 172.21.15.107:0/2602521222 >> 172.21.15.107:0/2602521222 conn(0x7f702009a1c0 msgr2=0x7f702009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.186+0000 7f7025dbb640 1 -- 172.21.15.107:0/2602521222 shutdown_connections 2024-02-16T10:32:34.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- 172.21.15.107:0/2602521222 wait complete. 2024-02-16T10:32:34.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 Processor -- start 2024-02-16T10:32:34.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- start start 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702012b650 con 0x7f702006f8b0 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701f7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33024/0 (socket says 172.21.15.107:33024) 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701f7fe640 1 -- 172.21.15.107:0/385439702 learned_addr learned my addr 172.21.15.107:0/385439702 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701f7fe640 1 -- 172.21.15.107:0/385439702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014009420 con 0x7f702006f8b0 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701f7fe640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7014019fa0 tx=0x7f7014019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:34.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70140abdf0 con 0x7f702006f8b0 2024-02-16T10:32:34.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70201134c0 con 0x7f702006f8b0 2024-02-16T10:32:34.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7020114e70 con 0x7f702006f8b0 2024-02-16T10:32:34.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70140b4540 con 0x7f702006f8b0 2024-02-16T10:32:34.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70201145a0 con 0x7f702006f8b0 2024-02-16T10:32:34.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020131580 con 0x7f702006f8b0 2024-02-16T10:32:34.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f70140b2040 con 0x7f702006f8b0 2024-02-16T10:32:34.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 0x7f700c037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:34.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f70140e26e0 con 0x7f702006f8b0 2024-02-16T10:32:34.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.190+0000 7f701effd640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 0x7f700c037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:34.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.194+0000 7f701effd640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 0x7f700c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70100020b0 tx=0x7f70100016e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:34.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.194+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70140bc3b0 con 0x7f702006f8b0 2024-02-16T10:32:34.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.350+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7020115000 con 0x7f700c035a10 2024-02-16T10:32:34.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.394+0000 7f7007fff640 1 -- 172.21.15.107:0/385439702 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666776 (secure 0 0 0) 0x7f701000cbf0 con 0x7f700c035a10 2024-02-16T10:32:34.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:34.420 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:34.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 msgr2=0x7f700c037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:34.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 0x7f700c037ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70100020b0 tx=0x7f70100016e0 comp rx=0 tx=0).stop 2024-02-16T10:32:34.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 msgr2=0x7f70201214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:34.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7014019fa0 tx=0x7f7014019110 comp rx=0 tx=0).stop 2024-02-16T10:32:34.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 shutdown_connections 2024-02-16T10:32:34.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f700c035a10 0x7f700c037ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:34.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 --2- 172.21.15.107:0/385439702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f702006f8b0 0x7f70201214a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:34.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 >> 172.21.15.107:0/385439702 conn(0x7f702009a1c0 msgr2=0x7f70201267e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:34.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 shutdown_connections 2024-02-16T10:32:34.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:34.406+0000 7f7025dbb640 1 -- 172.21.15.107:0/385439702 wait complete. 2024-02-16T10:32:34.432 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-02-16T10:32:33.874646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1282,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3914,"ondisk_log_size":3914,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1282,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006880"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141767+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:32:13.141767+0000","last_peered":"2024-02-16T10:32:13.141767+0000","last_clean":"2024-02-16T10:32:13.141767+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:32:13.141767+0000","last_undegraded":"2024-02-16T10:32:13.141767+0000","last_fullsized":"2024-02-16T10:32:13.141767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366496+0000","last_change":"2024-02-16T10:30:28.072642+0000","last_active":"2024-02-16T10:31:55.366496+0000","last_peered":"2024-02-16T10:31:55.366496+0000","last_clean":"2024-02-16T10:31:55.366496+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:31:55.366496+0000","last_undegraded":"2024-02-16T10:31:55.366496+0000","last_fullsized":"2024-02-16T10:31:55.366496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233525+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:32:12.233525+0000","last_peered":"2024-02-16T10:32:12.233525+0000","last_clean":"2024-02-16T10:32:12.233525+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:32:12.233525+0000","last_undegraded":"2024-02-16T10:32:12.233525+0000","last_fullsized":"2024-02-16T10:32:12.233525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918267+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918267+0000","last_peered":"2024-02-16T10:31:06.918267+0000","last_clean":"2024-02-16T10:31:06.918267+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918267+0000","last_undegraded":"2024-02-16T10:31:06.918267+0000","last_fullsized":"2024-02-16T10:31:06.918267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608910+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:32:13.608910+0000","last_peered":"2024-02-16T10:32:13.608910+0000","last_clean":"2024-02-16T10:32:13.608910+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:32:13.608910+0000","last_undegraded":"2024-02-16T10:32:13.608910+0000","last_fullsized":"2024-02-16T10:32:13.608910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920905+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920905+0000","last_peered":"2024-02-16T10:31:06.920905+0000","last_clean":"2024-02-16T10:31:06.920905+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920905+0000","last_undegraded":"2024-02-16T10:31:06.920905+0000","last_fullsized":"2024-02-16T10:31:06.920905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141713+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:32:13.141713+0000","last_peered":"2024-02-16T10:32:13.141713+0000","last_clean":"2024-02-16T10:32:13.141713+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:32:13.141713+0000","last_undegraded":"2024-02-16T10:32:13.141713+0000","last_fullsized":"2024-02-16T10:32:13.141713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921021+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.921021+0000","last_peered":"2024-02-16T10:31:06.921021+0000","last_clean":"2024-02-16T10:31:06.921021+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.921021+0000","last_undegraded":"2024-02-16T10:31:06.921021+0000","last_fullsized":"2024-02-16T10:31:06.921021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.855371+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.855371+0000","last_peered":"2024-02-16T10:31:54.855371+0000","last_clean":"2024-02-16T10:31:54.855371+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.855371+0000","last_undegraded":"2024-02-16T10:31:54.855371+0000","last_fullsized":"2024-02-16T10:31:54.855371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.671038+0000","last_change":"2024-02-16T10:30:28.081973+0000","last_active":"2024-02-16T10:32:12.671038+0000","last_peered":"2024-02-16T10:32:12.671038+0000","last_clean":"2024-02-16T10:32:12.671038+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:12.671038+0000","last_undegraded":"2024-02-16T10:32:12.671038+0000","last_fullsized":"2024-02-16T10:32:12.671038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908653+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908653+0000","last_peered":"2024-02-16T10:31:06.908653+0000","last_clean":"2024-02-16T10:31:06.908653+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908653+0000","last_undegraded":"2024-02-16T10:31:06.908653+0000","last_fullsized":"2024-02-16T10:31:06.908653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925909+0000","last_change":"2024-02-16T10:30:28.083981+0000","last_active":"2024-02-16T10:31:06.925909+0000","last_peered":"2024-02-16T10:31:06.925909+0000","last_clean":"2024-02-16T10:31:06.925909+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:31:06.925909+0000","last_undegraded":"2024-02-16T10:31:06.925909+0000","last_fullsized":"2024-02-16T10:31:06.925909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918484+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.918484+0000","last_peered":"2024-02-16T10:31:06.918484+0000","last_clean":"2024-02-16T10:31:06.918484+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.918484+0000","last_undegraded":"2024-02-16T10:31:06.918484+0000","last_fullsized":"2024-02-16T10:31:06.918484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366667+0000","last_change":"2024-02-16T10:30:28.078739+0000","last_active":"2024-02-16T10:31:55.366667+0000","last_peered":"2024-02-16T10:31:55.366667+0000","last_clean":"2024-02-16T10:31:55.366667+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:31:55.366667+0000","last_undegraded":"2024-02-16T10:31:55.366667+0000","last_fullsized":"2024-02-16T10:31:55.366667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925166+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925166+0000","last_peered":"2024-02-16T10:31:06.925166+0000","last_clean":"2024-02-16T10:31:06.925166+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925166+0000","last_undegraded":"2024-02-16T10:31:06.925166+0000","last_fullsized":"2024-02-16T10:31:06.925166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.694352+0000","last_change":"2024-02-16T10:30:28.063141+0000","last_active":"2024-02-16T10:31:12.694352+0000","last_peered":"2024-02-16T10:31:12.694352+0000","last_clean":"2024-02-16T10:31:12.694352+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:31:12.694352+0000","last_undegraded":"2024-02-16T10:31:12.694352+0000","last_fullsized":"2024-02-16T10:31:12.694352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915112+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:31:06.915112+0000","last_peered":"2024-02-16T10:31:06.915112+0000","last_clean":"2024-02-16T10:31:06.915112+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:31:06.915112+0000","last_undegraded":"2024-02-16T10:31:06.915112+0000","last_fullsized":"2024-02-16T10:31:06.915112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.929274+0000","last_change":"2024-02-16T10:30:26.098135+0000","last_active":"2024-02-16T10:31:06.929274+0000","last_peered":"2024-02-16T10:31:06.929274+0000","last_clean":"2024-02-16T10:31:06.929274+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:31:06.929274+0000","last_undegraded":"2024-02-16T10:31:06.929274+0000","last_fullsized":"2024-02-16T10:31:06.929274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915269+0000","last_change":"2024-02-16T10:30:28.080080+0000","last_active":"2024-02-16T10:31:06.915269+0000","last_peered":"2024-02-16T10:31:06.915269+0000","last_clean":"2024-02-16T10:31:06.915269+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:31:06.915269+0000","last_undegraded":"2024-02-16T10:31:06.915269+0000","last_fullsized":"2024-02-16T10:31:06.915269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:00.999469+0000","last_change":"2024-02-16T10:30:26.086548+0000","last_active":"2024-02-16T10:32:00.999469+0000","last_peered":"2024-02-16T10:32:00.999469+0000","last_clean":"2024-02-16T10:32:00.999469+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:00.999469+0000","last_undegraded":"2024-02-16T10:32:00.999469+0000","last_fullsized":"2024-02-16T10:32:00.999469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366918+0000","last_change":"2024-02-16T10:30:28.082308+0000","last_active":"2024-02-16T10:31:55.366918+0000","last_peered":"2024-02-16T10:31:55.366918+0000","last_clean":"2024-02-16T10:31:55.366918+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:31:55.366918+0000","last_undegraded":"2024-02-16T10:31:55.366918+0000","last_fullsized":"2024-02-16T10:31:55.366918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926754+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:31:06.926754+0000","last_peered":"2024-02-16T10:31:06.926754+0000","last_clean":"2024-02-16T10:31:06.926754+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:31:06.926754+0000","last_undegraded":"2024-02-16T10:31:06.926754+0000","last_fullsized":"2024-02-16T10:31:06.926754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928067+0000","last_change":"2024-02-16T10:30:28.066522+0000","last_active":"2024-02-16T10:31:06.928067+0000","last_peered":"2024-02-16T10:31:06.928067+0000","last_clean":"2024-02-16T10:31:06.928067+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:31:06.928067+0000","last_undegraded":"2024-02-16T10:31:06.928067+0000","last_fullsized":"2024-02-16T10:31:06.928067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925764+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:31:06.925764+0000","last_peered":"2024-02-16T10:31:06.925764+0000","last_clean":"2024-02-16T10:31:06.925764+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:31:06.925764+0000","last_undegraded":"2024-02-16T10:31:06.925764+0000","last_fullsized":"2024-02-16T10:31:06.925764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.666644+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.666644+0000","last_peered":"2024-02-16T10:31:11.666644+0000","last_clean":"2024-02-16T10:31:11.666644+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.666644+0000","last_undegraded":"2024-02-16T10:31:11.666644+0000","last_fullsized":"2024-02-16T10:31:11.666644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927799+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:31:06.927799+0000","last_peered":"2024-02-16T10:31:06.927799+0000","last_clean":"2024-02-16T10:31:06.927799+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:31:06.927799+0000","last_undegraded":"2024-02-16T10:31:06.927799+0000","last_fullsized":"2024-02-16T10:31:06.927799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.668143+0000","last_change":"2024-02-16T10:30:28.084327+0000","last_active":"2024-02-16T10:31:11.668143+0000","last_peered":"2024-02-16T10:31:11.668143+0000","last_clean":"2024-02-16T10:31:11.668143+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:31:11.668143+0000","last_undegraded":"2024-02-16T10:31:11.668143+0000","last_fullsized":"2024-02-16T10:31:11.668143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919595+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:31:06.919595+0000","last_peered":"2024-02-16T10:31:06.919595+0000","last_clean":"2024-02-16T10:31:06.919595+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:31:06.919595+0000","last_undegraded":"2024-02-16T10:31:06.919595+0000","last_fullsized":"2024-02-16T10:31:06.919595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.041365+0000","last_change":"2024-02-16T10:30:36.142641+0000","last_active":"2024-02-16T10:32:01.041365+0000","last_peered":"2024-02-16T10:32:01.041365+0000","last_clean":"2024-02-16T10:32:01.041365+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:01.041365+0000","last_undegraded":"2024-02-16T10:32:01.041365+0000","last_fullsized":"2024-02-16T10:32:01.041365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.695330+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:31:12.695330+0000","last_peered":"2024-02-16T10:31:12.695330+0000","last_clean":"2024-02-16T10:31:12.695330+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:31:12.695330+0000","last_undegraded":"2024-02-16T10:31:12.695330+0000","last_fullsized":"2024-02-16T10:31:12.695330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.421115+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:31:10.421115+0000","last_peered":"2024-02-16T10:31:10.421115+0000","last_clean":"2024-02-16T10:31:10.421115+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:31:10.421115+0000","last_undegraded":"2024-02-16T10:31:10.421115+0000","last_fullsized":"2024-02-16T10:31:10.421115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.941363+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.941363+0000","last_peered":"2024-02-16T10:31:06.941363+0000","last_clean":"2024-02-16T10:31:06.941363+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.941363+0000","last_undegraded":"2024-02-16T10:31:06.941363+0000","last_fullsized":"2024-02-16T10:31:06.941363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.097501+0000","last_change":"2024-02-16T10:30:32.121571+0000","last_active":"2024-02-16T10:32:09.097501+0000","last_peered":"2024-02-16T10:32:09.097501+0000","last_clean":"2024-02-16T10:32:09.097501+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:09.097501+0000","last_undegraded":"2024-02-16T10:32:09.097501+0000","last_fullsized":"2024-02-16T10:32:09.097501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.263564+0000","last_change":"2024-02-16T10:32:26.263617+0000","last_active":"2024-02-16T10:32:26.263564+0000","last_peered":"2024-02-16T10:32:26.263564+0000","last_clean":"2024-02-16T10:32:26.263564+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:32:26.263564+0000","last_undegraded":"2024-02-16T10:32:26.263564+0000","last_fullsized":"2024-02-16T10:32:26.263564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.263353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:40.727544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.096723+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:55.096723+0000","last_peered":"2024-02-16T10:31:55.096723+0000","last_clean":"2024-02-16T10:31:55.096723+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:55.096723+0000","last_undegraded":"2024-02-16T10:31:55.096723+0000","last_fullsized":"2024-02-16T10:31:55.096723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.008549+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:12.008549+0000","last_peered":"2024-02-16T10:31:12.008549+0000","last_clean":"2024-02-16T10:31:12.008549+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:12.008549+0000","last_undegraded":"2024-02-16T10:31:12.008549+0000","last_fullsized":"2024-02-16T10:31:12.008549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.907705+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:31:06.907705+0000","last_peered":"2024-02-16T10:31:06.907705+0000","last_clean":"2024-02-16T10:31:06.907705+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:31:06.907705+0000","last_undegraded":"2024-02-16T10:31:06.907705+0000","last_fullsized":"2024-02-16T10:31:06.907705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.924569+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:10.924569+0000","last_peered":"2024-02-16T10:31:10.924569+0000","last_clean":"2024-02-16T10:31:10.924569+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:10.924569+0000","last_undegraded":"2024-02-16T10:31:10.924569+0000","last_fullsized":"2024-02-16T10:31:10.924569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.304857+0000","last_change":"2024-02-16T10:32:16.304935+0000","last_active":"2024-02-16T10:32:16.304857+0000","last_peered":"2024-02-16T10:32:16.304857+0000","last_clean":"2024-02-16T10:32:16.304857+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:32:16.304857+0000","last_undegraded":"2024-02-16T10:32:16.304857+0000","last_fullsized":"2024-02-16T10:32:16.304857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.304645+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:45.895015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.217170+0000","last_change":"2024-02-16T10:32:30.217226+0000","last_active":"2024-02-16T10:32:30.217170+0000","last_peered":"2024-02-16T10:32:30.217170+0000","last_clean":"2024-02-16T10:32:30.217170+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:32:30.217170+0000","last_undegraded":"2024-02-16T10:32:30.217170+0000","last_fullsized":"2024-02-16T10:32:30.217170+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.216971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:22.338282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924336+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924336+0000","last_peered":"2024-02-16T10:31:06.924336+0000","last_clean":"2024-02-16T10:31:06.924336+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924336+0000","last_undegraded":"2024-02-16T10:31:06.924336+0000","last_fullsized":"2024-02-16T10:31:06.924336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019132+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.019132+0000","last_peered":"2024-02-16T10:32:01.019132+0000","last_clean":"2024-02-16T10:32:01.019132+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.019132+0000","last_undegraded":"2024-02-16T10:32:01.019132+0000","last_fullsized":"2024-02-16T10:32:01.019132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916091+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:31:06.916091+0000","last_peered":"2024-02-16T10:31:06.916091+0000","last_clean":"2024-02-16T10:31:06.916091+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:31:06.916091+0000","last_undegraded":"2024-02-16T10:31:06.916091+0000","last_fullsized":"2024-02-16T10:31:06.916091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932529+0000","last_change":"2024-02-16T10:30:30.080558+0000","last_active":"2024-02-16T10:31:06.932529+0000","last_peered":"2024-02-16T10:31:06.932529+0000","last_clean":"2024-02-16T10:31:06.932529+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:31:06.932529+0000","last_undegraded":"2024-02-16T10:31:06.932529+0000","last_fullsized":"2024-02-16T10:31:06.932529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.284822+0000","last_change":"2024-02-16T10:32:19.284906+0000","last_active":"2024-02-16T10:32:19.284822+0000","last_peered":"2024-02-16T10:32:19.284822+0000","last_clean":"2024-02-16T10:32:19.284822+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:32:19.284822+0000","last_undegraded":"2024-02-16T10:32:19.284822+0000","last_fullsized":"2024-02-16T10:32:19.284822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.284625+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:24.273342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":306,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.144356+0000","last_change":"2024-02-16T10:30:34.141896+0000","last_active":"2024-02-16T10:32:09.144356+0000","last_peered":"2024-02-16T10:32:09.144356+0000","last_clean":"2024-02-16T10:32:09.144356+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:09.144356+0000","last_undegraded":"2024-02-16T10:32:09.144356+0000","last_fullsized":"2024-02-16T10:32:09.144356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911610+0000","last_change":"2024-02-16T10:30:36.135895+0000","last_active":"2024-02-16T10:31:06.911610+0000","last_peered":"2024-02-16T10:31:06.911610+0000","last_clean":"2024-02-16T10:31:06.911610+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:31:06.911610+0000","last_undegraded":"2024-02-16T10:31:06.911610+0000","last_fullsized":"2024-02-16T10:31:06.911610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019552+0000","last_change":"2024-02-16T10:30:28.088671+0000","last_active":"2024-02-16T10:32:01.019552+0000","last_peered":"2024-02-16T10:32:01.019552+0000","last_clean":"2024-02-16T10:32:01.019552+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:01.019552+0000","last_undegraded":"2024-02-16T10:32:01.019552+0000","last_fullsized":"2024-02-16T10:32:01.019552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915836+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:31:06.915836+0000","last_peered":"2024-02-16T10:31:06.915836+0000","last_clean":"2024-02-16T10:31:06.915836+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:31:06.915836+0000","last_undegraded":"2024-02-16T10:31:06.915836+0000","last_fullsized":"2024-02-16T10:31:06.915836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.781497+0000","last_change":"2024-02-16T10:32:15.781557+0000","last_active":"2024-02-16T10:32:15.781497+0000","last_peered":"2024-02-16T10:32:15.781497+0000","last_clean":"2024-02-16T10:32:15.781497+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:32:15.781497+0000","last_undegraded":"2024-02-16T10:32:15.781497+0000","last_fullsized":"2024-02-16T10:32:15.781497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.781303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:34.208301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.237969+0000","last_change":"2024-02-16T10:32:17.238141+0000","last_active":"2024-02-16T10:32:17.237969+0000","last_peered":"2024-02-16T10:32:17.237969+0000","last_clean":"2024-02-16T10:32:17.237969+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:17.237969+0000","last_undegraded":"2024-02-16T10:32:17.237969+0000","last_fullsized":"2024-02-16T10:32:17.237969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.237729+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:01.114959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":342,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.449240+0000","last_change":"2024-02-16T10:32:14.449321+0000","last_active":"2024-02-16T10:32:14.449240+0000","last_peered":"2024-02-16T10:32:14.449240+0000","last_clean":"2024-02-16T10:32:14.449240+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:14.449240+0000","last_undegraded":"2024-02-16T10:32:14.449240+0000","last_fullsized":"2024-02-16T10:32:14.449240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.449055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:44.039424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914663+0000","last_change":"2024-02-16T10:30:28.076250+0000","last_active":"2024-02-16T10:31:06.914663+0000","last_peered":"2024-02-16T10:31:06.914663+0000","last_clean":"2024-02-16T10:31:06.914663+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:31:06.914663+0000","last_undegraded":"2024-02-16T10:31:06.914663+0000","last_fullsized":"2024-02-16T10:31:06.914663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.916196+0000","last_change":"2024-02-16T10:30:26.085100+0000","last_active":"2024-02-16T10:31:06.916196+0000","last_peered":"2024-02-16T10:31:06.916196+0000","last_clean":"2024-02-16T10:31:06.916196+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:31:06.916196+0000","last_undegraded":"2024-02-16T10:31:06.916196+0000","last_fullsized":"2024-02-16T10:31:06.916196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914446+0000","last_change":"2024-02-16T10:30:30.090540+0000","last_active":"2024-02-16T10:31:06.914446+0000","last_peered":"2024-02-16T10:31:06.914446+0000","last_clean":"2024-02-16T10:31:06.914446+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:31:06.914446+0000","last_undegraded":"2024-02-16T10:31:06.914446+0000","last_fullsized":"2024-02-16T10:31:06.914446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.399834+0000","last_change":"2024-02-16T10:32:23.399916+0000","last_active":"2024-02-16T10:32:23.399834+0000","last_peered":"2024-02-16T10:32:23.399834+0000","last_clean":"2024-02-16T10:32:23.399834+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:23.399834+0000","last_undegraded":"2024-02-16T10:32:23.399834+0000","last_fullsized":"2024-02-16T10:32:23.399834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.399643+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:12.773508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.465560+0000","last_change":"2024-02-16T10:32:16.465612+0000","last_active":"2024-02-16T10:32:16.465560+0000","last_peered":"2024-02-16T10:32:16.465560+0000","last_clean":"2024-02-16T10:32:16.465560+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:32:16.465560+0000","last_undegraded":"2024-02-16T10:32:16.465560+0000","last_fullsized":"2024-02-16T10:32:16.465560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.465378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:49.655775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.100329+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:31:55.100329+0000","last_peered":"2024-02-16T10:31:55.100329+0000","last_clean":"2024-02-16T10:31:55.100329+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:31:55.100329+0000","last_undegraded":"2024-02-16T10:31:55.100329+0000","last_fullsized":"2024-02-16T10:31:55.100329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.368374+0000","last_change":"2024-02-16T10:30:28.072768+0000","last_active":"2024-02-16T10:31:55.368374+0000","last_peered":"2024-02-16T10:31:55.368374+0000","last_clean":"2024-02-16T10:31:55.368374+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:31:55.368374+0000","last_undegraded":"2024-02-16T10:31:55.368374+0000","last_fullsized":"2024-02-16T10:31:55.368374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922039+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:31:06.922039+0000","last_peered":"2024-02-16T10:31:06.922039+0000","last_clean":"2024-02-16T10:31:06.922039+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:31:06.922039+0000","last_undegraded":"2024-02-16T10:31:06.922039+0000","last_fullsized":"2024-02-16T10:31:06.922039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.647718+0000","last_change":"2024-02-16T10:32:27.647776+0000","last_active":"2024-02-16T10:32:27.647718+0000","last_peered":"2024-02-16T10:32:27.647718+0000","last_clean":"2024-02-16T10:32:27.647718+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:32:27.647718+0000","last_undegraded":"2024-02-16T10:32:27.647718+0000","last_fullsized":"2024-02-16T10:32:27.647718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.647521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:04.955314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.933885+0000","last_change":"2024-02-16T10:32:28.933959+0000","last_active":"2024-02-16T10:32:28.933885+0000","last_peered":"2024-02-16T10:32:28.933885+0000","last_clean":"2024-02-16T10:32:28.933885+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:28.933885+0000","last_undegraded":"2024-02-16T10:32:28.933885+0000","last_fullsized":"2024-02-16T10:32:28.933885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.933703+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:04.743780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925357+0000","last_change":"2024-02-16T10:30:34.135930+0000","last_active":"2024-02-16T10:31:06.925357+0000","last_peered":"2024-02-16T10:31:06.925357+0000","last_clean":"2024-02-16T10:31:06.925357+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:31:06.925357+0000","last_undegraded":"2024-02-16T10:31:06.925357+0000","last_fullsized":"2024-02-16T10:31:06.925357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:49.435651+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:31:49.435651+0000","last_peered":"2024-02-16T10:31:49.435651+0000","last_clean":"2024-02-16T10:31:49.435651+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:31:49.435651+0000","last_undegraded":"2024-02-16T10:31:49.435651+0000","last_fullsized":"2024-02-16T10:31:49.435651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.217259+0000","last_change":"2024-02-16T10:30:28.064067+0000","last_active":"2024-02-16T10:31:11.217259+0000","last_peered":"2024-02-16T10:31:11.217259+0000","last_clean":"2024-02-16T10:31:11.217259+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:31:11.217259+0000","last_undegraded":"2024-02-16T10:31:11.217259+0000","last_fullsized":"2024-02-16T10:31:11.217259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928059+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:31:06.928059+0000","last_peered":"2024-02-16T10:31:06.928059+0000","last_clean":"2024-02-16T10:31:06.928059+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:31:06.928059+0000","last_undegraded":"2024-02-16T10:31:06.928059+0000","last_fullsized":"2024-02-16T10:31:06.928059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926762+0000","last_change":"2024-02-16T10:30:30.080329+0000","last_active":"2024-02-16T10:31:06.926762+0000","last_peered":"2024-02-16T10:31:06.926762+0000","last_clean":"2024-02-16T10:31:06.926762+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:31:06.926762+0000","last_undegraded":"2024-02-16T10:31:06.926762+0000","last_fullsized":"2024-02-16T10:31:06.926762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.803417+0000","last_change":"2024-02-16T10:32:16.803505+0000","last_active":"2024-02-16T10:32:16.803417+0000","last_peered":"2024-02-16T10:32:16.803417+0000","last_clean":"2024-02-16T10:32:16.803417+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:16.803417+0000","last_undegraded":"2024-02-16T10:32:16.803417+0000","last_fullsized":"2024-02-16T10:32:16.803417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.803212+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:32.256266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":313,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.644109+0000","last_change":"2024-02-16T10:32:28.644180+0000","last_active":"2024-02-16T10:32:28.644109+0000","last_peered":"2024-02-16T10:32:28.644109+0000","last_clean":"2024-02-16T10:32:28.644109+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:28.644109+0000","last_undegraded":"2024-02-16T10:32:28.644109+0000","last_fullsized":"2024-02-16T10:32:28.644109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.643929+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:10.346900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927271+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:31:06.927271+0000","last_peered":"2024-02-16T10:31:06.927271+0000","last_clean":"2024-02-16T10:31:06.927271+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:31:06.927271+0000","last_undegraded":"2024-02-16T10:31:06.927271+0000","last_fullsized":"2024-02-16T10:31:06.927271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.667493+0000","last_change":"2024-02-16T10:30:28.068604+0000","last_active":"2024-02-16T10:31:11.667493+0000","last_peered":"2024-02-16T10:31:11.667493+0000","last_clean":"2024-02-16T10:31:11.667493+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:31:11.667493+0000","last_undegraded":"2024-02-16T10:31:11.667493+0000","last_fullsized":"2024-02-16T10:31:11.667493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924446+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:31:06.924446+0000","last_peered":"2024-02-16T10:31:06.924446+0000","last_clean":"2024-02-16T10:31:06.924446+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:31:06.924446+0000","last_undegraded":"2024-02-16T10:31:06.924446+0000","last_fullsized":"2024-02-16T10:31:06.924446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.695501+0000","last_change":"2024-02-16T10:32:30.695562+0000","last_active":"2024-02-16T10:32:30.695501+0000","last_peered":"2024-02-16T10:32:30.695501+0000","last_clean":"2024-02-16T10:32:30.695501+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:32:30.695501+0000","last_undegraded":"2024-02-16T10:32:30.695501+0000","last_fullsized":"2024-02-16T10:32:30.695501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.695316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:35.672730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.013639+0000","last_change":"2024-02-16T10:30:32.122915+0000","last_active":"2024-02-16T10:32:09.013639+0000","last_peered":"2024-02-16T10:32:09.013639+0000","last_clean":"2024-02-16T10:32:09.013639+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:09.013639+0000","last_undegraded":"2024-02-16T10:32:09.013639+0000","last_fullsized":"2024-02-16T10:32:09.013639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.497156+0000","last_change":"2024-02-16T10:32:17.497295+0000","last_active":"2024-02-16T10:32:17.497156+0000","last_peered":"2024-02-16T10:32:17.497156+0000","last_clean":"2024-02-16T10:32:17.497156+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:32:17.497156+0000","last_undegraded":"2024-02-16T10:32:17.497156+0000","last_fullsized":"2024-02-16T10:32:17.497156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.496921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:48.124154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.029363+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:32:01.029363+0000","last_peered":"2024-02-16T10:32:01.029363+0000","last_clean":"2024-02-16T10:32:01.029363+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:32:01.029363+0000","last_undegraded":"2024-02-16T10:32:01.029363+0000","last_fullsized":"2024-02-16T10:32:01.029363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.694423+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:31:12.694423+0000","last_peered":"2024-02-16T10:31:12.694423+0000","last_clean":"2024-02-16T10:31:12.694423+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:31:12.694423+0000","last_undegraded":"2024-02-16T10:31:12.694423+0000","last_fullsized":"2024-02-16T10:31:12.694423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927041+0000","last_change":"2024-02-16T10:30:26.098753+0000","last_active":"2024-02-16T10:31:06.927041+0000","last_peered":"2024-02-16T10:31:06.927041+0000","last_clean":"2024-02-16T10:31:06.927041+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:31:06.927041+0000","last_undegraded":"2024-02-16T10:31:06.927041+0000","last_fullsized":"2024-02-16T10:31:06.927041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":203,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.451258+0000","last_change":"2024-02-16T10:32:27.451331+0000","last_active":"2024-02-16T10:32:27.451258+0000","last_peered":"2024-02-16T10:32:27.451258+0000","last_clean":"2024-02-16T10:32:27.451258+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:27.451258+0000","last_undegraded":"2024-02-16T10:32:27.451258+0000","last_fullsized":"2024-02-16T10:32:27.451258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.451069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:58.078302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.240771+0000","last_change":"2024-02-16T10:32:20.240843+0000","last_active":"2024-02-16T10:32:20.240771+0000","last_peered":"2024-02-16T10:32:20.240771+0000","last_clean":"2024-02-16T10:32:20.240771+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:20.240771+0000","last_undegraded":"2024-02-16T10:32:20.240771+0000","last_fullsized":"2024-02-16T10:32:20.240771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.240570+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:31.716842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934006+0000","last_change":"2024-02-16T10:30:34.141827+0000","last_active":"2024-02-16T10:31:06.934006+0000","last_peered":"2024-02-16T10:31:06.934006+0000","last_clean":"2024-02-16T10:31:06.934006+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:31:06.934006+0000","last_undegraded":"2024-02-16T10:31:06.934006+0000","last_fullsized":"2024-02-16T10:31:06.934006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.911366+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:31:06.911366+0000","last_peered":"2024-02-16T10:31:06.911366+0000","last_clean":"2024-02-16T10:31:06.911366+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:31:06.911366+0000","last_undegraded":"2024-02-16T10:31:06.911366+0000","last_fullsized":"2024-02-16T10:31:06.911366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.929236+0000","last_change":"2024-02-16T10:32:29.929301+0000","last_active":"2024-02-16T10:32:29.929236+0000","last_peered":"2024-02-16T10:32:29.929236+0000","last_clean":"2024-02-16T10:32:29.929236+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:32:29.929236+0000","last_undegraded":"2024-02-16T10:32:29.929236+0000","last_fullsized":"2024-02-16T10:32:29.929236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.929048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:38.130834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921180+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:31:06.921180+0000","last_peered":"2024-02-16T10:31:06.921180+0000","last_clean":"2024-02-16T10:31:06.921180+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:31:06.921180+0000","last_undegraded":"2024-02-16T10:31:06.921180+0000","last_fullsized":"2024-02-16T10:31:06.921180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.645979+0000","last_change":"2024-02-16T10:32:29.646038+0000","last_active":"2024-02-16T10:32:29.645979+0000","last_peered":"2024-02-16T10:32:29.645979+0000","last_clean":"2024-02-16T10:32:29.645979+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:32:29.645979+0000","last_undegraded":"2024-02-16T10:32:29.645979+0000","last_fullsized":"2024-02-16T10:32:29.645979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.645785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:23.146927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.309237+0000","last_change":"2024-02-16T10:32:21.309318+0000","last_active":"2024-02-16T10:32:21.309237+0000","last_peered":"2024-02-16T10:32:21.309237+0000","last_clean":"2024-02-16T10:32:21.309237+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:21.309237+0000","last_undegraded":"2024-02-16T10:32:21.309237+0000","last_fullsized":"2024-02-16T10:32:21.309237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.309051+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:16:57.682746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":344,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.163424+0000","last_change":"2024-02-16T10:32:14.163489+0000","last_active":"2024-02-16T10:32:14.163424+0000","last_peered":"2024-02-16T10:32:14.163424+0000","last_clean":"2024-02-16T10:32:14.163424+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:14.163424+0000","last_undegraded":"2024-02-16T10:32:14.163424+0000","last_fullsized":"2024-02-16T10:32:14.163424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.163228+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:11.600065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.381436+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:31:55.381436+0000","last_peered":"2024-02-16T10:31:55.381436+0000","last_clean":"2024-02-16T10:31:55.381436+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:31:55.381436+0000","last_undegraded":"2024-02-16T10:31:55.381436+0000","last_fullsized":"2024-02-16T10:31:55.381436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923073+0000","last_change":"2024-02-16T10:30:28.063099+0000","last_active":"2024-02-16T10:31:06.923073+0000","last_peered":"2024-02-16T10:31:06.923073+0000","last_clean":"2024-02-16T10:31:06.923073+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:31:06.923073+0000","last_undegraded":"2024-02-16T10:31:06.923073+0000","last_fullsized":"2024-02-16T10:31:06.923073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.992891+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:31:11.992891+0000","last_peered":"2024-02-16T10:31:11.992891+0000","last_clean":"2024-02-16T10:31:11.992891+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:31:11.992891+0000","last_undegraded":"2024-02-16T10:31:11.992891+0000","last_fullsized":"2024-02-16T10:31:11.992891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.227358+0000","last_change":"2024-02-16T10:32:29.227428+0000","last_active":"2024-02-16T10:32:29.227358+0000","last_peered":"2024-02-16T10:32:29.227358+0000","last_clean":"2024-02-16T10:32:29.227358+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:29.227358+0000","last_undegraded":"2024-02-16T10:32:29.227358+0000","last_fullsized":"2024-02-16T10:32:29.227358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.227174+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:41.462774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.371929+0000","last_change":"2024-02-16T10:30:32.123949+0000","last_active":"2024-02-16T10:31:55.371929+0000","last_peered":"2024-02-16T10:31:55.371929+0000","last_clean":"2024-02-16T10:31:55.371929+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:31:55.371929+0000","last_undegraded":"2024-02-16T10:31:55.371929+0000","last_fullsized":"2024-02-16T10:31:55.371929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":387,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.304345+0000","last_change":"2024-02-16T10:32:18.304415+0000","last_active":"2024-02-16T10:32:18.304345+0000","last_peered":"2024-02-16T10:32:18.304345+0000","last_clean":"2024-02-16T10:32:18.304345+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:18.304345+0000","last_undegraded":"2024-02-16T10:32:18.304345+0000","last_fullsized":"2024-02-16T10:32:18.304345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.304138+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:51.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908684+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:31:06.908684+0000","last_peered":"2024-02-16T10:31:06.908684+0000","last_clean":"2024-02-16T10:31:06.908684+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:31:06.908684+0000","last_undegraded":"2024-02-16T10:31:06.908684+0000","last_fullsized":"2024-02-16T10:31:06.908684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852104+0000","last_change":"2024-02-16T10:30:28.085134+0000","last_active":"2024-02-16T10:31:54.852104+0000","last_peered":"2024-02-16T10:31:54.852104+0000","last_clean":"2024-02-16T10:31:54.852104+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:31:54.852104+0000","last_undegraded":"2024-02-16T10:31:54.852104+0000","last_fullsized":"2024-02-16T10:31:54.852104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913834+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:31:06.913834+0000","last_peered":"2024-02-16T10:31:06.913834+0000","last_clean":"2024-02-16T10:31:06.913834+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:31:06.913834+0000","last_undegraded":"2024-02-16T10:31:06.913834+0000","last_fullsized":"2024-02-16T10:31:06.913834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.781597+0000","last_change":"2024-02-16T10:32:13.781651+0000","last_active":"2024-02-16T10:32:13.781597+0000","last_peered":"2024-02-16T10:32:13.781597+0000","last_clean":"2024-02-16T10:32:13.781597+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:32:13.781597+0000","last_undegraded":"2024-02-16T10:32:13.781597+0000","last_fullsized":"2024-02-16T10:32:13.781597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.781400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:02:49.070840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.202923+0000","last_change":"2024-02-16T10:32:21.203087+0000","last_active":"2024-02-16T10:32:21.202923+0000","last_peered":"2024-02-16T10:32:21.202923+0000","last_clean":"2024-02-16T10:32:21.202923+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:21.202923+0000","last_undegraded":"2024-02-16T10:32:21.202923+0000","last_fullsized":"2024-02-16T10:32:21.202923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.202707+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:08.574336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.238327+0000","last_change":"2024-02-16T10:32:18.238385+0000","last_active":"2024-02-16T10:32:18.238327+0000","last_peered":"2024-02-16T10:32:18.238327+0000","last_clean":"2024-02-16T10:32:18.238327+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:32:18.238327+0000","last_undegraded":"2024-02-16T10:32:18.238327+0000","last_fullsized":"2024-02-16T10:32:18.238327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.238111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:31.457700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.033067+0000","last_change":"2024-02-16T10:30:36.124467+0000","last_active":"2024-02-16T10:32:01.033067+0000","last_peered":"2024-02-16T10:32:01.033067+0000","last_clean":"2024-02-16T10:32:01.033067+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:32:01.033067+0000","last_undegraded":"2024-02-16T10:32:01.033067+0000","last_fullsized":"2024-02-16T10:32:01.033067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.010385+0000","last_change":"2024-02-16T10:30:28.084181+0000","last_active":"2024-02-16T10:31:12.010385+0000","last_peered":"2024-02-16T10:31:12.010385+0000","last_clean":"2024-02-16T10:31:12.010385+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:31:12.010385+0000","last_undegraded":"2024-02-16T10:31:12.010385+0000","last_fullsized":"2024-02-16T10:31:12.010385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.669942+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:32:12.669942+0000","last_peered":"2024-02-16T10:32:12.669942+0000","last_clean":"2024-02-16T10:32:12.669942+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:32:12.669942+0000","last_undegraded":"2024-02-16T10:32:12.669942+0000","last_fullsized":"2024-02-16T10:32:12.669942+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607902+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:32:13.607902+0000","last_peered":"2024-02-16T10:32:13.607902+0000","last_clean":"2024-02-16T10:32:13.607902+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:32:13.607902+0000","last_undegraded":"2024-02-16T10:32:13.607902+0000","last_fullsized":"2024-02-16T10:32:13.607902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608068+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:32:13.608068+0000","last_peered":"2024-02-16T10:32:13.608068+0000","last_clean":"2024-02-16T10:32:13.608068+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:32:13.608068+0000","last_undegraded":"2024-02-16T10:32:13.608068+0000","last_fullsized":"2024-02-16T10:32:13.608068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.279882+0000","last_change":"2024-02-16T10:32:27.279935+0000","last_active":"2024-02-16T10:32:27.279882+0000","last_peered":"2024-02-16T10:32:27.279882+0000","last_clean":"2024-02-16T10:32:27.279882+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:32:27.279882+0000","last_undegraded":"2024-02-16T10:32:27.279882+0000","last_fullsized":"2024-02-16T10:32:27.279882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.279691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:39:24.188579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.117438+0000","last_change":"2024-02-16T10:30:32.125750+0000","last_active":"2024-02-16T10:32:09.117438+0000","last_peered":"2024-02-16T10:32:09.117438+0000","last_clean":"2024-02-16T10:32:09.117438+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:09.117438+0000","last_undegraded":"2024-02-16T10:32:09.117438+0000","last_fullsized":"2024-02-16T10:32:09.117438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.512532+0000","last_change":"2024-02-16T10:32:20.512594+0000","last_active":"2024-02-16T10:32:20.512532+0000","last_peered":"2024-02-16T10:32:20.512532+0000","last_clean":"2024-02-16T10:32:20.512532+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:32:20.512532+0000","last_undegraded":"2024-02-16T10:32:20.512532+0000","last_fullsized":"2024-02-16T10:32:20.512532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.512313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:57.090214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.037300+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:01.037300+0000","last_peered":"2024-02-16T10:32:01.037300+0000","last_clean":"2024-02-16T10:32:01.037300+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:01.037300+0000","last_undegraded":"2024-02-16T10:32:01.037300+0000","last_fullsized":"2024-02-16T10:32:01.037300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.695050+0000","last_change":"2024-02-16T10:30:28.069523+0000","last_active":"2024-02-16T10:31:12.695050+0000","last_peered":"2024-02-16T10:31:12.695050+0000","last_clean":"2024-02-16T10:31:12.695050+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:31:12.695050+0000","last_undegraded":"2024-02-16T10:31:12.695050+0000","last_fullsized":"2024-02-16T10:31:12.695050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607879+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:32:13.607879+0000","last_peered":"2024-02-16T10:32:13.607879+0000","last_clean":"2024-02-16T10:32:13.607879+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:32:13.607879+0000","last_undegraded":"2024-02-16T10:32:13.607879+0000","last_fullsized":"2024-02-16T10:32:13.607879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233259+0000","last_change":"2024-02-16T10:30:26.098916+0000","last_active":"2024-02-16T10:32:12.233259+0000","last_peered":"2024-02-16T10:32:12.233259+0000","last_clean":"2024-02-16T10:32:12.233259+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:32:12.233259+0000","last_undegraded":"2024-02-16T10:32:12.233259+0000","last_fullsized":"2024-02-16T10:32:12.233259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.736078+0000","last_change":"2024-02-16T10:32:14.736135+0000","last_active":"2024-02-16T10:32:14.736078+0000","last_peered":"2024-02-16T10:32:14.736078+0000","last_clean":"2024-02-16T10:32:14.736078+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:32:14.736078+0000","last_undegraded":"2024-02-16T10:32:14.736078+0000","last_fullsized":"2024-02-16T10:32:14.736078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.735884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:40.928168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":447,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.273582+0000","last_change":"2024-02-16T10:32:19.273669+0000","last_active":"2024-02-16T10:32:19.273582+0000","last_peered":"2024-02-16T10:32:19.273582+0000","last_clean":"2024-02-16T10:32:19.273582+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:19.273582+0000","last_undegraded":"2024-02-16T10:32:19.273582+0000","last_fullsized":"2024-02-16T10:32:19.273582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.273406+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:49.900639+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923789+0000","last_change":"2024-02-16T10:30:34.141970+0000","last_active":"2024-02-16T10:31:06.923789+0000","last_peered":"2024-02-16T10:31:06.923789+0000","last_clean":"2024-02-16T10:31:06.923789+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:31:06.923789+0000","last_undegraded":"2024-02-16T10:31:06.923789+0000","last_fullsized":"2024-02-16T10:31:06.923789+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.093717+0000","last_change":"2024-02-16T10:30:36.139509+0000","last_active":"2024-02-16T10:31:55.093717+0000","last_peered":"2024-02-16T10:31:55.093717+0000","last_clean":"2024-02-16T10:31:55.093717+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:31:55.093717+0000","last_undegraded":"2024-02-16T10:31:55.093717+0000","last_fullsized":"2024-02-16T10:31:55.093717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'9","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.017085+0000","last_change":"2024-02-16T10:30:28.079105+0000","last_active":"2024-02-16T10:32:01.017085+0000","last_peered":"2024-02-16T10:32:01.017085+0000","last_clean":"2024-02-16T10:32:01.017085+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:01.017085+0000","last_undegraded":"2024-02-16T10:32:01.017085+0000","last_fullsized":"2024-02-16T10:32:01.017085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141210+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:32:13.141210+0000","last_peered":"2024-02-16T10:32:13.141210+0000","last_clean":"2024-02-16T10:32:13.141210+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:32:13.141210+0000","last_undegraded":"2024-02-16T10:32:13.141210+0000","last_fullsized":"2024-02-16T10:32:13.141210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233308+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:32:12.233308+0000","last_peered":"2024-02-16T10:32:12.233308+0000","last_clean":"2024-02-16T10:32:12.233308+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:32:12.233308+0000","last_undegraded":"2024-02-16T10:32:12.233308+0000","last_fullsized":"2024-02-16T10:32:12.233308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.455658+0000","last_change":"2024-02-16T10:32:29.455727+0000","last_active":"2024-02-16T10:32:29.455658+0000","last_peered":"2024-02-16T10:32:29.455658+0000","last_clean":"2024-02-16T10:32:29.455658+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:32:29.455658+0000","last_undegraded":"2024-02-16T10:32:29.455658+0000","last_fullsized":"2024-02-16T10:32:29.455658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.455432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:16.827061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.278009+0000","last_change":"2024-02-16T10:32:20.278098+0000","last_active":"2024-02-16T10:32:20.278009+0000","last_peered":"2024-02-16T10:32:20.278009+0000","last_clean":"2024-02-16T10:32:20.278009+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:20.278009+0000","last_undegraded":"2024-02-16T10:32:20.278009+0000","last_fullsized":"2024-02-16T10:32:20.278009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.277804+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:57:46.102924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927931+0000","last_change":"2024-02-16T10:30:34.138200+0000","last_active":"2024-02-16T10:31:06.927931+0000","last_peered":"2024-02-16T10:31:06.927931+0000","last_clean":"2024-02-16T10:31:06.927931+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:31:06.927931+0000","last_undegraded":"2024-02-16T10:31:06.927931+0000","last_fullsized":"2024-02-16T10:31:06.927931+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918000+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:31:06.918000+0000","last_peered":"2024-02-16T10:31:06.918000+0000","last_clean":"2024-02-16T10:31:06.918000+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:31:06.918000+0000","last_undegraded":"2024-02-16T10:31:06.918000+0000","last_fullsized":"2024-02-16T10:31:06.918000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.217416+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:31:11.217416+0000","last_peered":"2024-02-16T10:31:11.217416+0000","last_clean":"2024-02-16T10:31:11.217416+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:31:11.217416+0000","last_undegraded":"2024-02-16T10:31:11.217416+0000","last_fullsized":"2024-02-16T10:31:11.217416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607881+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:32:13.607881+0000","last_peered":"2024-02-16T10:32:13.607881+0000","last_clean":"2024-02-16T10:32:13.607881+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:32:13.607881+0000","last_undegraded":"2024-02-16T10:32:13.607881+0000","last_fullsized":"2024-02-16T10:32:13.607881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141151+0000","last_change":"2024-02-16T10:30:26.084253+0000","last_active":"2024-02-16T10:32:13.141151+0000","last_peered":"2024-02-16T10:32:13.141151+0000","last_clean":"2024-02-16T10:32:13.141151+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:32:13.141151+0000","last_undegraded":"2024-02-16T10:32:13.141151+0000","last_fullsized":"2024-02-16T10:32:13.141151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927515+0000","last_change":"2024-02-16T10:30:30.080063+0000","last_active":"2024-02-16T10:31:06.927515+0000","last_peered":"2024-02-16T10:31:06.927515+0000","last_clean":"2024-02-16T10:31:06.927515+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:31:06.927515+0000","last_undegraded":"2024-02-16T10:31:06.927515+0000","last_fullsized":"2024-02-16T10:31:06.927515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:02.565589+0000","last_change":"2024-02-16T10:30:32.125409+0000","last_active":"2024-02-16T10:32:02.565589+0000","last_peered":"2024-02-16T10:32:02.565589+0000","last_clean":"2024-02-16T10:32:02.565589+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:32:02.565589+0000","last_undegraded":"2024-02-16T10:32:02.565589+0000","last_fullsized":"2024-02-16T10:32:02.565589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934744+0000","last_change":"2024-02-16T10:30:34.141949+0000","last_active":"2024-02-16T10:31:06.934744+0000","last_peered":"2024-02-16T10:31:06.934744+0000","last_clean":"2024-02-16T10:31:06.934744+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:31:06.934744+0000","last_undegraded":"2024-02-16T10:31:06.934744+0000","last_fullsized":"2024-02-16T10:31:06.934744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.364486+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:31:55.364486+0000","last_peered":"2024-02-16T10:31:55.364486+0000","last_clean":"2024-02-16T10:31:55.364486+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:31:55.364486+0000","last_undegraded":"2024-02-16T10:31:55.364486+0000","last_fullsized":"2024-02-16T10:31:55.364486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.366662+0000","last_change":"2024-02-16T10:30:28.065872+0000","last_active":"2024-02-16T10:31:55.366662+0000","last_peered":"2024-02-16T10:31:55.366662+0000","last_clean":"2024-02-16T10:31:55.366662+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:31:55.366662+0000","last_undegraded":"2024-02-16T10:31:55.366662+0000","last_fullsized":"2024-02-16T10:31:55.366662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141152+0000","last_change":"2024-02-16T10:30:26.087305+0000","last_active":"2024-02-16T10:32:13.141152+0000","last_peered":"2024-02-16T10:32:13.141152+0000","last_clean":"2024-02-16T10:32:13.141152+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:32:13.141152+0000","last_undegraded":"2024-02-16T10:32:13.141152+0000","last_fullsized":"2024-02-16T10:32:13.141152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233235+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:32:12.233235+0000","last_peered":"2024-02-16T10:32:12.233235+0000","last_clean":"2024-02-16T10:32:12.233235+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:32:12.233235+0000","last_undegraded":"2024-02-16T10:32:12.233235+0000","last_fullsized":"2024-02-16T10:32:12.233235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926901+0000","last_change":"2024-02-16T10:30:30.079568+0000","last_active":"2024-02-16T10:31:06.926901+0000","last_peered":"2024-02-16T10:31:06.926901+0000","last_clean":"2024-02-16T10:31:06.926901+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:31:06.926901+0000","last_undegraded":"2024-02-16T10:31:06.926901+0000","last_fullsized":"2024-02-16T10:31:06.926901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'70","reported_seq":145,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.637793+0000","last_change":"2024-02-16T10:32:26.637878+0000","last_active":"2024-02-16T10:32:26.637793+0000","last_peered":"2024-02-16T10:32:26.637793+0000","last_clean":"2024-02-16T10:32:26.637793+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:26.637793+0000","last_undegraded":"2024-02-16T10:32:26.637793+0000","last_fullsized":"2024-02-16T10:32:26.637793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.637563+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:38.873163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.185071+0000","last_change":"2024-02-16T10:32:16.185179+0000","last_active":"2024-02-16T10:32:16.185071+0000","last_peered":"2024-02-16T10:32:16.185071+0000","last_clean":"2024-02-16T10:32:16.185071+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:32:16.185071+0000","last_undegraded":"2024-02-16T10:32:16.185071+0000","last_fullsized":"2024-02-16T10:32:16.185071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.184842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:49:06.247286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.385057+0000","last_change":"2024-02-16T10:30:36.121926+0000","last_active":"2024-02-16T10:31:55.385057+0000","last_peered":"2024-02-16T10:31:55.385057+0000","last_clean":"2024-02-16T10:31:55.385057+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:31:55.385057+0000","last_undegraded":"2024-02-16T10:31:55.385057+0000","last_fullsized":"2024-02-16T10:31:55.385057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919539+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:31:06.919539+0000","last_peered":"2024-02-16T10:31:06.919539+0000","last_clean":"2024-02-16T10:31:06.919539+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:31:06.919539+0000","last_undegraded":"2024-02-16T10:31:06.919539+0000","last_fullsized":"2024-02-16T10:31:06.919539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233340+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:32:12.233340+0000","last_peered":"2024-02-16T10:32:12.233340+0000","last_clean":"2024-02-16T10:32:12.233340+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:32:12.233340+0000","last_undegraded":"2024-02-16T10:32:12.233340+0000","last_fullsized":"2024-02-16T10:32:12.233340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608025+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:32:13.608025+0000","last_peered":"2024-02-16T10:32:13.608025+0000","last_clean":"2024-02-16T10:32:13.608025+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:32:13.608025+0000","last_undegraded":"2024-02-16T10:32:13.608025+0000","last_fullsized":"2024-02-16T10:32:13.608025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.858589+0000","last_change":"2024-02-16T10:32:19.858645+0000","last_active":"2024-02-16T10:32:19.858589+0000","last_peered":"2024-02-16T10:32:19.858589+0000","last_clean":"2024-02-16T10:32:19.858589+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:32:19.858589+0000","last_undegraded":"2024-02-16T10:32:19.858589+0000","last_fullsized":"2024-02-16T10:32:19.858589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.858393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:55.403466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.357164+0000","last_change":"2024-02-16T10:32:15.357240+0000","last_active":"2024-02-16T10:32:15.357164+0000","last_peered":"2024-02-16T10:32:15.357164+0000","last_clean":"2024-02-16T10:32:15.357164+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:32:15.357164+0000","last_undegraded":"2024-02-16T10:32:15.357164+0000","last_fullsized":"2024-02-16T10:32:15.357164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.356955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:04:12.700846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":290,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.354264+0000","last_change":"2024-02-16T10:32:14.354389+0000","last_active":"2024-02-16T10:32:14.354264+0000","last_peered":"2024-02-16T10:32:14.354264+0000","last_clean":"2024-02-16T10:32:14.354264+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:14.354264+0000","last_undegraded":"2024-02-16T10:32:14.354264+0000","last_fullsized":"2024-02-16T10:32:14.354264+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.353994+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:24.095058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932538+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:31:06.932538+0000","last_peered":"2024-02-16T10:31:06.932538+0000","last_clean":"2024-02-16T10:31:06.932538+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:31:06.932538+0000","last_undegraded":"2024-02-16T10:31:06.932538+0000","last_fullsized":"2024-02-16T10:31:06.932538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.901200+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:10.901200+0000","last_peered":"2024-02-16T10:31:10.901200+0000","last_clean":"2024-02-16T10:31:10.901200+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:10.901200+0000","last_undegraded":"2024-02-16T10:31:10.901200+0000","last_fullsized":"2024-02-16T10:31:10.901200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.936278+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:31:06.936278+0000","last_peered":"2024-02-16T10:31:06.936278+0000","last_clean":"2024-02-16T10:31:06.936278+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:31:06.936278+0000","last_undegraded":"2024-02-16T10:31:06.936278+0000","last_fullsized":"2024-02-16T10:31:06.936278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233154+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:32:12.233154+0000","last_peered":"2024-02-16T10:32:12.233154+0000","last_clean":"2024-02-16T10:32:12.233154+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:32:12.233154+0000","last_undegraded":"2024-02-16T10:32:12.233154+0000","last_fullsized":"2024-02-16T10:32:12.233154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.913588+0000","last_change":"2024-02-16T10:32:21.913654+0000","last_active":"2024-02-16T10:32:21.913588+0000","last_peered":"2024-02-16T10:32:21.913588+0000","last_clean":"2024-02-16T10:32:21.913588+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:32:21.913588+0000","last_undegraded":"2024-02-16T10:32:21.913588+0000","last_fullsized":"2024-02-16T10:32:21.913588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.913396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:04.153154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.866498+0000","last_change":"2024-02-16T10:32:26.866581+0000","last_active":"2024-02-16T10:32:26.866498+0000","last_peered":"2024-02-16T10:32:26.866498+0000","last_clean":"2024-02-16T10:32:26.866498+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:32:26.866498+0000","last_undegraded":"2024-02-16T10:32:26.866498+0000","last_fullsized":"2024-02-16T10:32:26.866498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.866309+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:28.219357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.413050+0000","last_change":"2024-02-16T10:32:13.413073+0000","last_active":"2024-02-16T10:32:13.413050+0000","last_peered":"2024-02-16T10:32:13.413050+0000","last_clean":"2024-02-16T10:32:13.413050+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:13.413050+0000","last_undegraded":"2024-02-16T10:32:13.413050+0000","last_fullsized":"2024-02-16T10:32:13.413050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.412978+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:02.786844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925140+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:31:06.925140+0000","last_peered":"2024-02-16T10:31:06.925140+0000","last_clean":"2024-02-16T10:31:06.925140+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:31:06.925140+0000","last_undegraded":"2024-02-16T10:31:06.925140+0000","last_fullsized":"2024-02-16T10:31:06.925140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908060+0000","last_change":"2024-02-16T10:30:28.059745+0000","last_active":"2024-02-16T10:31:06.908060+0000","last_peered":"2024-02-16T10:31:06.908060+0000","last_clean":"2024-02-16T10:31:06.908060+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:31:06.908060+0000","last_undegraded":"2024-02-16T10:31:06.908060+0000","last_fullsized":"2024-02-16T10:31:06.908060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926693+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:31:06.926693+0000","last_peered":"2024-02-16T10:31:06.926693+0000","last_clean":"2024-02-16T10:31:06.926693+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:31:06.926693+0000","last_undegraded":"2024-02-16T10:31:06.926693+0000","last_fullsized":"2024-02-16T10:31:06.926693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607996+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:32:13.607996+0000","last_peered":"2024-02-16T10:32:13.607996+0000","last_clean":"2024-02-16T10:32:13.607996+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:32:13.607996+0000","last_undegraded":"2024-02-16T10:32:13.607996+0000","last_fullsized":"2024-02-16T10:32:13.607996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.894998+0000","last_change":"2024-02-16T10:32:23.894998+0000","last_active":"2024-02-16T10:32:23.894998+0000","last_peered":"2024-02-16T10:32:23.894998+0000","last_clean":"2024-02-16T10:32:23.894998+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:32:23.894998+0000","last_undegraded":"2024-02-16T10:32:23.894998+0000","last_fullsized":"2024-02-16T10:32:23.894998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.894738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:24.572023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.394450+0000","last_change":"2024-02-16T10:32:25.394537+0000","last_active":"2024-02-16T10:32:25.394450+0000","last_peered":"2024-02-16T10:32:25.394450+0000","last_clean":"2024-02-16T10:32:25.394450+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:25.394450+0000","last_undegraded":"2024-02-16T10:32:25.394450+0000","last_fullsized":"2024-02-16T10:32:25.394450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.394250+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:35.971596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.461855+0000","last_change":"2024-02-16T10:32:15.461912+0000","last_active":"2024-02-16T10:32:15.461855+0000","last_peered":"2024-02-16T10:32:15.461855+0000","last_clean":"2024-02-16T10:32:15.461855+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:32:15.461855+0000","last_undegraded":"2024-02-16T10:32:15.461855+0000","last_fullsized":"2024-02-16T10:32:15.461855+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.461664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:26.039010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.422721+0000","last_change":"2024-02-16T10:32:30.422778+0000","last_active":"2024-02-16T10:32:30.422721+0000","last_peered":"2024-02-16T10:32:30.422721+0000","last_clean":"2024-02-16T10:32:30.422721+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:32:30.422721+0000","last_undegraded":"2024-02-16T10:32:30.422721+0000","last_fullsized":"2024-02-16T10:32:30.422721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.422534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:07.000435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915913+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:31:06.915913+0000","last_peered":"2024-02-16T10:31:06.915913+0000","last_clean":"2024-02-16T10:31:06.915913+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:31:06.915913+0000","last_undegraded":"2024-02-16T10:31:06.915913+0000","last_fullsized":"2024-02-16T10:31:06.915913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019298+0000","last_change":"2024-02-16T10:30:28.065560+0000","last_active":"2024-02-16T10:32:01.019298+0000","last_peered":"2024-02-16T10:32:01.019298+0000","last_clean":"2024-02-16T10:32:01.019298+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:01.019298+0000","last_undegraded":"2024-02-16T10:32:01.019298+0000","last_fullsized":"2024-02-16T10:32:01.019298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924815+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:31:06.924815+0000","last_peered":"2024-02-16T10:31:06.924815+0000","last_clean":"2024-02-16T10:31:06.924815+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:31:06.924815+0000","last_undegraded":"2024-02-16T10:31:06.924815+0000","last_fullsized":"2024-02-16T10:31:06.924815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.233046+0000","last_change":"2024-02-16T10:32:23.233102+0000","last_active":"2024-02-16T10:32:23.233046+0000","last_peered":"2024-02-16T10:32:23.233046+0000","last_clean":"2024-02-16T10:32:23.233046+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:32:23.233046+0000","last_undegraded":"2024-02-16T10:32:23.233046+0000","last_fullsized":"2024-02-16T10:32:23.233046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.232854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:06.883209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.871486+0000","last_change":"2024-02-16T10:32:18.871641+0000","last_active":"2024-02-16T10:32:18.871486+0000","last_peered":"2024-02-16T10:32:18.871486+0000","last_clean":"2024-02-16T10:32:18.871486+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:18.871486+0000","last_undegraded":"2024-02-16T10:32:18.871486+0000","last_fullsized":"2024-02-16T10:32:18.871486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.871268+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:47.245756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914891+0000","last_change":"2024-02-16T10:30:34.138222+0000","last_active":"2024-02-16T10:31:06.914891+0000","last_peered":"2024-02-16T10:31:06.914891+0000","last_clean":"2024-02-16T10:31:06.914891+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:31:06.914891+0000","last_undegraded":"2024-02-16T10:31:06.914891+0000","last_fullsized":"2024-02-16T10:31:06.914891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927187+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:31:06.927187+0000","last_peered":"2024-02-16T10:31:06.927187+0000","last_clean":"2024-02-16T10:31:06.927187+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:31:06.927187+0000","last_undegraded":"2024-02-16T10:31:06.927187+0000","last_fullsized":"2024-02-16T10:31:06.927187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.694342+0000","last_change":"2024-02-16T10:30:28.065164+0000","last_active":"2024-02-16T10:31:12.694342+0000","last_peered":"2024-02-16T10:31:12.694342+0000","last_clean":"2024-02-16T10:31:12.694342+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:31:12.694342+0000","last_undegraded":"2024-02-16T10:31:12.694342+0000","last_fullsized":"2024-02-16T10:31:12.694342+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915390+0000","last_change":"2024-02-16T10:30:26.089582+0000","last_active":"2024-02-16T10:31:06.915390+0000","last_peered":"2024-02-16T10:31:06.915390+0000","last_clean":"2024-02-16T10:31:06.915390+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:31:06.915390+0000","last_undegraded":"2024-02-16T10:31:06.915390+0000","last_fullsized":"2024-02-16T10:31:06.915390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.839175+0000","last_change":"2024-02-16T10:32:17.839228+0000","last_active":"2024-02-16T10:32:17.839175+0000","last_peered":"2024-02-16T10:32:17.839175+0000","last_clean":"2024-02-16T10:32:17.839175+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:32:17.839175+0000","last_undegraded":"2024-02-16T10:32:17.839175+0000","last_fullsized":"2024-02-16T10:32:17.839175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.838982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:56.153751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.552418+0000","last_change":"2024-02-16T10:32:21.552580+0000","last_active":"2024-02-16T10:32:21.552418+0000","last_peered":"2024-02-16T10:32:21.552418+0000","last_clean":"2024-02-16T10:32:21.552418+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:32:21.552418+0000","last_undegraded":"2024-02-16T10:32:21.552418+0000","last_fullsized":"2024-02-16T10:32:21.552418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.552195+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.202550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.348133+0000","last_change":"2024-02-16T10:32:22.348211+0000","last_active":"2024-02-16T10:32:22.348133+0000","last_peered":"2024-02-16T10:32:22.348133+0000","last_clean":"2024-02-16T10:32:22.348133+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:32:22.348133+0000","last_undegraded":"2024-02-16T10:32:22.348133+0000","last_fullsized":"2024-02-16T10:32:22.348133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.347938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:32.089002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926885+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926885+0000","last_peered":"2024-02-16T10:31:06.926885+0000","last_clean":"2024-02-16T10:31:06.926885+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926885+0000","last_undegraded":"2024-02-16T10:31:06.926885+0000","last_fullsized":"2024-02-16T10:31:06.926885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.011942+0000","last_change":"2024-02-16T10:30:28.063758+0000","last_active":"2024-02-16T10:31:12.011942+0000","last_peered":"2024-02-16T10:31:12.011942+0000","last_clean":"2024-02-16T10:31:12.011942+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:31:12.011942+0000","last_undegraded":"2024-02-16T10:31:12.011942+0000","last_fullsized":"2024-02-16T10:31:12.011942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922447+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:31:06.922447+0000","last_peered":"2024-02-16T10:31:06.922447+0000","last_clean":"2024-02-16T10:31:06.922447+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:31:06.922447+0000","last_undegraded":"2024-02-16T10:31:06.922447+0000","last_fullsized":"2024-02-16T10:31:06.922447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.431147+0000","last_change":"2024-02-16T10:32:28.431239+0000","last_active":"2024-02-16T10:32:28.431147+0000","last_peered":"2024-02-16T10:32:28.431147+0000","last_clean":"2024-02-16T10:32:28.431147+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:32:28.431147+0000","last_undegraded":"2024-02-16T10:32:28.431147+0000","last_fullsized":"2024-02-16T10:32:28.431147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.430925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:39.907197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.547085+0000","last_change":"2024-02-16T10:32:23.547169+0000","last_active":"2024-02-16T10:32:23.547085+0000","last_peered":"2024-02-16T10:32:23.547085+0000","last_clean":"2024-02-16T10:32:23.547085+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:23.547085+0000","last_undegraded":"2024-02-16T10:32:23.547085+0000","last_fullsized":"2024-02-16T10:32:23.547085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.546894+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:50.589838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.353126+0000","last_change":"2024-02-16T10:32:13.353181+0000","last_active":"2024-02-16T10:32:13.353126+0000","last_peered":"2024-02-16T10:32:13.353126+0000","last_clean":"2024-02-16T10:32:13.353126+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:32:13.353126+0000","last_undegraded":"2024-02-16T10:32:13.353126+0000","last_fullsized":"2024-02-16T10:32:13.353126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.352927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:59.430673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922790+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922790+0000","last_peered":"2024-02-16T10:31:06.922790+0000","last_clean":"2024-02-16T10:31:06.922790+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922790+0000","last_undegraded":"2024-02-16T10:31:06.922790+0000","last_fullsized":"2024-02-16T10:31:06.922790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'5","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019146+0000","last_change":"2024-02-16T10:30:28.083725+0000","last_active":"2024-02-16T10:32:01.019146+0000","last_peered":"2024-02-16T10:32:01.019146+0000","last_clean":"2024-02-16T10:32:01.019146+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:01.019146+0000","last_undegraded":"2024-02-16T10:32:01.019146+0000","last_fullsized":"2024-02-16T10:32:01.019146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.928336+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:31:06.928336+0000","last_peered":"2024-02-16T10:31:06.928336+0000","last_clean":"2024-02-16T10:31:06.928336+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:31:06.928336+0000","last_undegraded":"2024-02-16T10:31:06.928336+0000","last_fullsized":"2024-02-16T10:31:06.928336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.892303+0000","last_change":"2024-02-16T10:32:22.892358+0000","last_active":"2024-02-16T10:32:22.892303+0000","last_peered":"2024-02-16T10:32:22.892303+0000","last_clean":"2024-02-16T10:32:22.892303+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:32:22.892303+0000","last_undegraded":"2024-02-16T10:32:22.892303+0000","last_fullsized":"2024-02-16T10:32:22.892303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.892090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:42.373803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.352097+0000","last_change":"2024-02-16T10:32:24.352194+0000","last_active":"2024-02-16T10:32:24.352097+0000","last_peered":"2024-02-16T10:32:24.352097+0000","last_clean":"2024-02-16T10:32:24.352097+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:24.352097+0000","last_undegraded":"2024-02-16T10:32:24.352097+0000","last_fullsized":"2024-02-16T10:32:24.352097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.351933+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:53.942303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.181536+0000","last_change":"2024-02-16T10:32:15.181591+0000","last_active":"2024-02-16T10:32:15.181536+0000","last_peered":"2024-02-16T10:32:15.181536+0000","last_clean":"2024-02-16T10:32:15.181536+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:32:15.181536+0000","last_undegraded":"2024-02-16T10:32:15.181536+0000","last_fullsized":"2024-02-16T10:32:15.181536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.181356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:14.859456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852428+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:31:54.852428+0000","last_peered":"2024-02-16T10:31:54.852428+0000","last_clean":"2024-02-16T10:31:54.852428+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:31:54.852428+0000","last_undegraded":"2024-02-16T10:31:54.852428+0000","last_fullsized":"2024-02-16T10:31:54.852428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912894+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:31:06.912894+0000","last_peered":"2024-02-16T10:31:06.912894+0000","last_clean":"2024-02-16T10:31:06.912894+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:31:06.912894+0000","last_undegraded":"2024-02-16T10:31:06.912894+0000","last_fullsized":"2024-02-16T10:31:06.912894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.901383+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:10.901383+0000","last_peered":"2024-02-16T10:31:10.901383+0000","last_clean":"2024-02-16T10:31:10.901383+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:10.901383+0000","last_undegraded":"2024-02-16T10:31:10.901383+0000","last_fullsized":"2024-02-16T10:31:10.901383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.580265+0000","last_change":"2024-02-16T10:32:22.580433+0000","last_active":"2024-02-16T10:32:22.580265+0000","last_peered":"2024-02-16T10:32:22.580265+0000","last_clean":"2024-02-16T10:32:22.580265+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:22.580265+0000","last_undegraded":"2024-02-16T10:32:22.580265+0000","last_fullsized":"2024-02-16T10:32:22.580265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.580047+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:28.539775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.183132+0000","last_change":"2024-02-16T10:32:13.183196+0000","last_active":"2024-02-16T10:32:13.183132+0000","last_peered":"2024-02-16T10:32:13.183132+0000","last_clean":"2024-02-16T10:32:13.183132+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:32:13.183132+0000","last_undegraded":"2024-02-16T10:32:13.183132+0000","last_fullsized":"2024-02-16T10:32:13.183132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.182934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:58:32.694869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.014102+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:01.014102+0000","last_peered":"2024-02-16T10:32:01.014102+0000","last_clean":"2024-02-16T10:32:01.014102+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:01.014102+0000","last_undegraded":"2024-02-16T10:32:01.014102+0000","last_fullsized":"2024-02-16T10:32:01.014102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233637+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:32:12.233637+0000","last_peered":"2024-02-16T10:32:12.233637+0000","last_clean":"2024-02-16T10:32:12.233637+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:32:12.233637+0000","last_undegraded":"2024-02-16T10:32:12.233637+0000","last_fullsized":"2024-02-16T10:32:12.233637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.420531+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:31:10.420531+0000","last_peered":"2024-02-16T10:31:10.420531+0000","last_clean":"2024-02-16T10:31:10.420531+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:31:10.420531+0000","last_undegraded":"2024-02-16T10:31:10.420531+0000","last_fullsized":"2024-02-16T10:31:10.420531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917169+0000","last_change":"2024-02-16T10:30:30.075709+0000","last_active":"2024-02-16T10:31:06.917169+0000","last_peered":"2024-02-16T10:31:06.917169+0000","last_clean":"2024-02-16T10:31:06.917169+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:31:06.917169+0000","last_undegraded":"2024-02-16T10:31:06.917169+0000","last_fullsized":"2024-02-16T10:31:06.917169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:09.042493+0000","last_change":"2024-02-16T10:30:32.122498+0000","last_active":"2024-02-16T10:32:09.042493+0000","last_peered":"2024-02-16T10:32:09.042493+0000","last_clean":"2024-02-16T10:32:09.042493+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:09.042493+0000","last_undegraded":"2024-02-16T10:32:09.042493+0000","last_fullsized":"2024-02-16T10:32:09.042493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.184132+0000","last_change":"2024-02-16T10:32:22.184210+0000","last_active":"2024-02-16T10:32:22.184132+0000","last_peered":"2024-02-16T10:32:22.184132+0000","last_clean":"2024-02-16T10:32:22.184132+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:32:22.184132+0000","last_undegraded":"2024-02-16T10:32:22.184132+0000","last_fullsized":"2024-02-16T10:32:22.184132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.183927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:58.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914877+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914877+0000","last_peered":"2024-02-16T10:31:06.914877+0000","last_clean":"2024-02-16T10:31:06.914877+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914877+0000","last_undegraded":"2024-02-16T10:31:06.914877+0000","last_fullsized":"2024-02-16T10:31:06.914877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.887511+0000","last_change":"2024-02-16T10:32:27.887571+0000","last_active":"2024-02-16T10:32:27.887511+0000","last_peered":"2024-02-16T10:32:27.887511+0000","last_clean":"2024-02-16T10:32:27.887511+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:32:27.887511+0000","last_undegraded":"2024-02-16T10:32:27.887511+0000","last_fullsized":"2024-02-16T10:32:27.887511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.887325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:24.904620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912397+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912397+0000","last_peered":"2024-02-16T10:31:06.912397+0000","last_clean":"2024-02-16T10:31:06.912397+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912397+0000","last_undegraded":"2024-02-16T10:31:06.912397+0000","last_fullsized":"2024-02-16T10:31:06.912397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915420+0000","last_change":"2024-02-16T10:30:30.076018+0000","last_active":"2024-02-16T10:31:06.915420+0000","last_peered":"2024-02-16T10:31:06.915420+0000","last_clean":"2024-02-16T10:31:06.915420+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:31:06.915420+0000","last_undegraded":"2024-02-16T10:31:06.915420+0000","last_fullsized":"2024-02-16T10:31:06.915420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.510004+0000","last_change":"2024-02-16T10:32:19.510077+0000","last_active":"2024-02-16T10:32:19.510004+0000","last_peered":"2024-02-16T10:32:19.510004+0000","last_clean":"2024-02-16T10:32:19.510004+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:19.510004+0000","last_undegraded":"2024-02-16T10:32:19.510004+0000","last_fullsized":"2024-02-16T10:32:19.510004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.509815+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:06.881445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.449842+0000","last_change":"2024-02-16T10:32:12.449861+0000","last_active":"2024-02-16T10:32:12.449842+0000","last_peered":"2024-02-16T10:32:12.449842+0000","last_clean":"2024-02-16T10:32:12.449842+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:32:12.449842+0000","last_undegraded":"2024-02-16T10:32:12.449842+0000","last_fullsized":"2024-02-16T10:32:12.449842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_clean_scrub_stamp":"2024-02-16T10:32:12.449759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:28.024682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917347+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917347+0000","last_peered":"2024-02-16T10:31:06.917347+0000","last_clean":"2024-02-16T10:31:06.917347+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917347+0000","last_undegraded":"2024-02-16T10:31:06.917347+0000","last_fullsized":"2024-02-16T10:31:06.917347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930283+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930283+0000","last_peered":"2024-02-16T10:31:06.930283+0000","last_clean":"2024-02-16T10:31:06.930283+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930283+0000","last_undegraded":"2024-02-16T10:31:06.930283+0000","last_fullsized":"2024-02-16T10:31:06.930283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.167225+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.167225+0000","last_peered":"2024-02-16T10:31:11.167225+0000","last_clean":"2024-02-16T10:31:11.167225+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.167225+0000","last_undegraded":"2024-02-16T10:31:11.167225+0000","last_fullsized":"2024-02-16T10:31:11.167225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.250790+0000","last_change":"2024-02-16T10:32:28.250844+0000","last_active":"2024-02-16T10:32:28.250790+0000","last_peered":"2024-02-16T10:32:28.250790+0000","last_clean":"2024-02-16T10:32:28.250790+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:32:28.250790+0000","last_undegraded":"2024-02-16T10:32:28.250790+0000","last_fullsized":"2024-02-16T10:32:28.250790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.250601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:40.734413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930775+0000","last_change":"2024-02-16T10:30:32.123357+0000","last_active":"2024-02-16T10:31:06.930775+0000","last_peered":"2024-02-16T10:31:06.930775+0000","last_clean":"2024-02-16T10:31:06.930775+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:31:06.930775+0000","last_undegraded":"2024-02-16T10:31:06.930775+0000","last_fullsized":"2024-02-16T10:31:06.930775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:31.056734+0000","last_clean_scrub_stamp":"2024-02-16T10:30:31.056734+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.416677+0000","last_change":"2024-02-16T10:32:26.416755+0000","last_active":"2024-02-16T10:32:26.416677+0000","last_peered":"2024-02-16T10:32:26.416677+0000","last_clean":"2024-02-16T10:32:26.416677+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:26.416677+0000","last_undegraded":"2024-02-16T10:32:26.416677+0000","last_fullsized":"2024-02-16T10:32:26.416677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.416475+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:59.606871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913385+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913385+0000","last_peered":"2024-02-16T10:31:06.913385+0000","last_clean":"2024-02-16T10:31:06.913385+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913385+0000","last_undegraded":"2024-02-16T10:31:06.913385+0000","last_fullsized":"2024-02-16T10:31:06.913385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914058+0000","last_change":"2024-02-16T10:30:28.068653+0000","last_active":"2024-02-16T10:31:06.914058+0000","last_peered":"2024-02-16T10:31:06.914058+0000","last_clean":"2024-02-16T10:31:06.914058+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:31:06.914058+0000","last_undegraded":"2024-02-16T10:31:06.914058+0000","last_fullsized":"2024-02-16T10:31:06.914058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976176+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.976176+0000","last_peered":"2024-02-16T10:31:11.976176+0000","last_clean":"2024-02-16T10:31:11.976176+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.976176+0000","last_undegraded":"2024-02-16T10:31:11.976176+0000","last_fullsized":"2024-02-16T10:31:11.976176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.296087+0000","last_change":"2024-02-16T10:32:25.296238+0000","last_active":"2024-02-16T10:32:25.296087+0000","last_peered":"2024-02-16T10:32:25.296087+0000","last_clean":"2024-02-16T10:32:25.296087+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:32:25.296087+0000","last_undegraded":"2024-02-16T10:32:25.296087+0000","last_fullsized":"2024-02-16T10:32:25.296087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.295850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:52.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.346302+0000","last_change":"2024-02-16T10:32:17.346391+0000","last_active":"2024-02-16T10:32:17.346302+0000","last_peered":"2024-02-16T10:32:17.346302+0000","last_clean":"2024-02-16T10:32:17.346302+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:17.346302+0000","last_undegraded":"2024-02-16T10:32:17.346302+0000","last_fullsized":"2024-02-16T10:32:17.346302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.346100+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:27.923447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.576597+0000","last_change":"2024-02-16T10:32:24.576651+0000","last_active":"2024-02-16T10:32:24.576597+0000","last_peered":"2024-02-16T10:32:24.576597+0000","last_clean":"2024-02-16T10:32:24.576597+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:32:24.576597+0000","last_undegraded":"2024-02-16T10:32:24.576597+0000","last_fullsized":"2024-02-16T10:32:24.576597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.576402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:39.040594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.697042+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.697042+0000","last_peered":"2024-02-16T10:31:12.697042+0000","last_clean":"2024-02-16T10:31:12.697042+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.697042+0000","last_undegraded":"2024-02-16T10:31:12.697042+0000","last_fullsized":"2024-02-16T10:31:12.697042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'13","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.018689+0000","last_change":"2024-02-16T10:30:28.068349+0000","last_active":"2024-02-16T10:32:01.018689+0000","last_peered":"2024-02-16T10:32:01.018689+0000","last_clean":"2024-02-16T10:32:01.018689+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:01.018689+0000","last_undegraded":"2024-02-16T10:32:01.018689+0000","last_fullsized":"2024-02-16T10:32:01.018689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926607+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926607+0000","last_peered":"2024-02-16T10:31:06.926607+0000","last_clean":"2024-02-16T10:31:06.926607+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926607+0000","last_undegraded":"2024-02-16T10:31:06.926607+0000","last_fullsized":"2024-02-16T10:31:06.926607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914442+0000","last_change":"2024-02-16T10:30:30.074767+0000","last_active":"2024-02-16T10:31:06.914442+0000","last_peered":"2024-02-16T10:31:06.914442+0000","last_clean":"2024-02-16T10:31:06.914442+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:31:06.914442+0000","last_undegraded":"2024-02-16T10:31:06.914442+0000","last_fullsized":"2024-02-16T10:31:06.914442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.600372+0000","last_change":"2024-02-16T10:32:25.600445+0000","last_active":"2024-02-16T10:32:25.600372+0000","last_peered":"2024-02-16T10:32:25.600372+0000","last_clean":"2024-02-16T10:32:25.600372+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:25.600372+0000","last_undegraded":"2024-02-16T10:32:25.600372+0000","last_fullsized":"2024-02-16T10:32:25.600372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.600171+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:50.787242+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914799+0000","last_change":"2024-02-16T10:30:34.138612+0000","last_active":"2024-02-16T10:31:06.914799+0000","last_peered":"2024-02-16T10:31:06.914799+0000","last_clean":"2024-02-16T10:31:06.914799+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:31:06.914799+0000","last_undegraded":"2024-02-16T10:31:06.914799+0000","last_fullsized":"2024-02-16T10:31:06.914799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931163+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931163+0000","last_peered":"2024-02-16T10:31:06.931163+0000","last_clean":"2024-02-16T10:31:06.931163+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931163+0000","last_undegraded":"2024-02-16T10:31:06.931163+0000","last_fullsized":"2024-02-16T10:31:06.931163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852229+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.852229+0000","last_peered":"2024-02-16T10:31:54.852229+0000","last_clean":"2024-02-16T10:31:54.852229+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.852229+0000","last_undegraded":"2024-02-16T10:31:54.852229+0000","last_fullsized":"2024-02-16T10:31:54.852229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233371+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:32:12.233371+0000","last_peered":"2024-02-16T10:32:12.233371+0000","last_clean":"2024-02-16T10:32:12.233371+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:32:12.233371+0000","last_undegraded":"2024-02-16T10:32:12.233371+0000","last_fullsized":"2024-02-16T10:32:12.233371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.282488+0000","last_change":"2024-02-16T10:32:24.282549+0000","last_active":"2024-02-16T10:32:24.282488+0000","last_peered":"2024-02-16T10:32:24.282488+0000","last_clean":"2024-02-16T10:32:24.282488+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:32:24.282488+0000","last_undegraded":"2024-02-16T10:32:24.282488+0000","last_fullsized":"2024-02-16T10:32:24.282488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.282291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:30.242018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.877004+0000","last_change":"2024-02-16T10:32:20.877073+0000","last_active":"2024-02-16T10:32:20.877004+0000","last_peered":"2024-02-16T10:32:20.877004+0000","last_clean":"2024-02-16T10:32:20.877004+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:20.877004+0000","last_undegraded":"2024-02-16T10:32:20.877004+0000","last_fullsized":"2024-02-16T10:32:20.877004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.876820+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:18:48.734961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.915831+0000","last_change":"2024-02-16T10:30:34.139182+0000","last_active":"2024-02-16T10:31:06.915831+0000","last_peered":"2024-02-16T10:31:06.915831+0000","last_clean":"2024-02-16T10:31:06.915831+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:31:06.915831+0000","last_undegraded":"2024-02-16T10:31:06.915831+0000","last_fullsized":"2024-02-16T10:31:06.915831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:33.070679+0000","last_clean_scrub_stamp":"2024-02-16T10:30:33.070679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.670244+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.670244+0000","last_peered":"2024-02-16T10:31:11.670244+0000","last_clean":"2024-02-16T10:31:11.670244+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.670244+0000","last_undegraded":"2024-02-16T10:31:11.670244+0000","last_fullsized":"2024-02-16T10:31:11.670244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.016587+0000","last_change":"2024-02-16T10:30:28.068221+0000","last_active":"2024-02-16T10:32:01.016587+0000","last_peered":"2024-02-16T10:32:01.016587+0000","last_clean":"2024-02-16T10:32:01.016587+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:01.016587+0000","last_undegraded":"2024-02-16T10:32:01.016587+0000","last_fullsized":"2024-02-16T10:32:01.016587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670190+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:32:12.670190+0000","last_peered":"2024-02-16T10:32:12.670190+0000","last_clean":"2024-02-16T10:32:12.670190+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:32:12.670190+0000","last_undegraded":"2024-02-16T10:32:12.670190+0000","last_fullsized":"2024-02-16T10:32:12.670190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'7","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:08.842113+0000","last_change":"2024-02-16T10:30:30.090010+0000","last_active":"2024-02-16T10:32:08.842113+0000","last_peered":"2024-02-16T10:32:08.842113+0000","last_clean":"2024-02-16T10:32:08.842113+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:08.842113+0000","last_undegraded":"2024-02-16T10:32:08.842113+0000","last_fullsized":"2024-02-16T10:32:08.842113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.857213+0000","last_change":"2024-02-16T10:32:24.857295+0000","last_active":"2024-02-16T10:32:24.857213+0000","last_peered":"2024-02-16T10:32:24.857213+0000","last_clean":"2024-02-16T10:32:24.857213+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:24.857213+0000","last_undegraded":"2024-02-16T10:32:24.857213+0000","last_fullsized":"2024-02-16T10:32:24.857213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.857001+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:32.050416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.493910+0000","last_change":"2024-02-16T10:32:18.493966+0000","last_active":"2024-02-16T10:32:18.493910+0000","last_peered":"2024-02-16T10:32:18.493910+0000","last_clean":"2024-02-16T10:32:18.493910+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:32:18.493910+0000","last_undegraded":"2024-02-16T10:32:18.493910+0000","last_fullsized":"2024-02-16T10:32:18.493910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.493720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:29.969992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923584+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923584+0000","last_peered":"2024-02-16T10:31:06.923584+0000","last_clean":"2024-02-16T10:31:06.923584+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923584+0000","last_undegraded":"2024-02-16T10:31:06.923584+0000","last_fullsized":"2024-02-16T10:31:06.923584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930709+0000","last_change":"2024-02-16T10:30:28.085439+0000","last_active":"2024-02-16T10:31:06.930709+0000","last_peered":"2024-02-16T10:31:06.930709+0000","last_clean":"2024-02-16T10:31:06.930709+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:31:06.930709+0000","last_undegraded":"2024-02-16T10:31:06.930709+0000","last_fullsized":"2024-02-16T10:31:06.930709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141330+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:32:13.141330+0000","last_peered":"2024-02-16T10:32:13.141330+0000","last_clean":"2024-02-16T10:32:13.141330+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:32:13.141330+0000","last_undegraded":"2024-02-16T10:32:13.141330+0000","last_fullsized":"2024-02-16T10:32:13.141330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.367391+0000","last_change":"2024-02-16T10:30:28.066897+0000","last_active":"2024-02-16T10:31:55.367391+0000","last_peered":"2024-02-16T10:31:55.367391+0000","last_clean":"2024-02-16T10:31:55.367391+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:31:55.367391+0000","last_undegraded":"2024-02-16T10:31:55.367391+0000","last_fullsized":"2024-02-16T10:31:55.367391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233460+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:32:12.233460+0000","last_peered":"2024-02-16T10:32:12.233460+0000","last_clean":"2024-02-16T10:32:12.233460+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:32:12.233460+0000","last_undegraded":"2024-02-16T10:32:12.233460+0000","last_fullsized":"2024-02-16T10:32:12.233460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852440+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:31:54.852440+0000","last_peered":"2024-02-16T10:31:54.852440+0000","last_clean":"2024-02-16T10:31:54.852440+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:31:54.852440+0000","last_undegraded":"2024-02-16T10:31:54.852440+0000","last_fullsized":"2024-02-16T10:31:54.852440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608468+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:32:13.608468+0000","last_peered":"2024-02-16T10:32:13.608468+0000","last_clean":"2024-02-16T10:32:13.608468+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:32:13.608468+0000","last_undegraded":"2024-02-16T10:32:13.608468+0000","last_fullsized":"2024-02-16T10:32:13.608468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.369731+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:31:55.369731+0000","last_peered":"2024-02-16T10:31:55.369731+0000","last_clean":"2024-02-16T10:31:55.369731+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:31:55.369731+0000","last_undegraded":"2024-02-16T10:31:55.369731+0000","last_fullsized":"2024-02-16T10:31:55.369731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233313+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:32:12.233313+0000","last_peered":"2024-02-16T10:32:12.233313+0000","last_clean":"2024-02-16T10:32:12.233313+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:32:12.233313+0000","last_undegraded":"2024-02-16T10:32:12.233313+0000","last_fullsized":"2024-02-16T10:32:12.233313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019636+0000","last_change":"2024-02-16T10:30:28.070344+0000","last_active":"2024-02-16T10:32:01.019636+0000","last_peered":"2024-02-16T10:32:01.019636+0000","last_clean":"2024-02-16T10:32:01.019636+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:01.019636+0000","last_undegraded":"2024-02-16T10:32:01.019636+0000","last_fullsized":"2024-02-16T10:32:01.019636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.421726+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:31:10.421726+0000","last_peered":"2024-02-16T10:31:10.421726+0000","last_clean":"2024-02-16T10:31:10.421726+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:31:10.421726+0000","last_undegraded":"2024-02-16T10:31:10.421726+0000","last_fullsized":"2024-02-16T10:31:10.421726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922995+0000","last_change":"2024-02-16T10:30:28.084698+0000","last_active":"2024-02-16T10:31:06.922995+0000","last_peered":"2024-02-16T10:31:06.922995+0000","last_clean":"2024-02-16T10:31:06.922995+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:31:06.922995+0000","last_undegraded":"2024-02-16T10:31:06.922995+0000","last_fullsized":"2024-02-16T10:31:06.922995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926041+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:31:06.926041+0000","last_peered":"2024-02-16T10:31:06.926041+0000","last_clean":"2024-02-16T10:31:06.926041+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:31:06.926041+0000","last_undegraded":"2024-02-16T10:31:06.926041+0000","last_fullsized":"2024-02-16T10:31:06.926041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.218283+0000","last_change":"2024-02-16T10:30:28.088710+0000","last_active":"2024-02-16T10:31:11.218283+0000","last_peered":"2024-02-16T10:31:11.218283+0000","last_clean":"2024-02-16T10:31:11.218283+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:31:11.218283+0000","last_undegraded":"2024-02-16T10:31:11.218283+0000","last_fullsized":"2024-02-16T10:31:11.218283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922699+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:31:06.922699+0000","last_peered":"2024-02-16T10:31:06.922699+0000","last_clean":"2024-02-16T10:31:06.922699+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:31:06.922699+0000","last_undegraded":"2024-02-16T10:31:06.922699+0000","last_fullsized":"2024-02-16T10:31:06.922699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852226+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:31:54.852226+0000","last_peered":"2024-02-16T10:31:54.852226+0000","last_clean":"2024-02-16T10:31:54.852226+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:31:54.852226+0000","last_undegraded":"2024-02-16T10:31:54.852226+0000","last_fullsized":"2024-02-16T10:31:54.852226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930446+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:31:06.930446+0000","last_peered":"2024-02-16T10:31:06.930446+0000","last_clean":"2024-02-16T10:31:06.930446+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:31:06.930446+0000","last_undegraded":"2024-02-16T10:31:06.930446+0000","last_fullsized":"2024-02-16T10:31:06.930446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.007624+0000","last_change":"2024-02-16T10:30:28.082754+0000","last_active":"2024-02-16T10:31:12.007624+0000","last_peered":"2024-02-16T10:31:12.007624+0000","last_clean":"2024-02-16T10:31:12.007624+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:31:12.007624+0000","last_undegraded":"2024-02-16T10:31:12.007624+0000","last_fullsized":"2024-02-16T10:31:12.007624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913567+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:31:06.913567+0000","last_peered":"2024-02-16T10:31:06.913567+0000","last_clean":"2024-02-16T10:31:06.913567+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:31:06.913567+0000","last_undegraded":"2024-02-16T10:31:06.913567+0000","last_fullsized":"2024-02-16T10:31:06.913567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.017192+0000","last_change":"2024-02-16T10:30:28.069630+0000","last_active":"2024-02-16T10:32:01.017192+0000","last_peered":"2024-02-16T10:32:01.017192+0000","last_clean":"2024-02-16T10:32:01.017192+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:01.017192+0000","last_undegraded":"2024-02-16T10:32:01.017192+0000","last_fullsized":"2024-02-16T10:32:01.017192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925061+0000","last_change":"2024-02-16T10:30:26.099907+0000","last_active":"2024-02-16T10:31:06.925061+0000","last_peered":"2024-02-16T10:31:06.925061+0000","last_clean":"2024-02-16T10:31:06.925061+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:31:06.925061+0000","last_undegraded":"2024-02-16T10:31:06.925061+0000","last_fullsized":"2024-02-16T10:31:06.925061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.695958+0000","last_change":"2024-02-16T10:30:28.065907+0000","last_active":"2024-02-16T10:31:12.695958+0000","last_peered":"2024-02-16T10:31:12.695958+0000","last_clean":"2024-02-16T10:31:12.695958+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:31:12.695958+0000","last_undegraded":"2024-02-16T10:31:12.695958+0000","last_fullsized":"2024-02-16T10:31:12.695958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922248+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:31:06.922248+0000","last_peered":"2024-02-16T10:31:06.922248+0000","last_clean":"2024-02-16T10:31:06.922248+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:31:06.922248+0000","last_undegraded":"2024-02-16T10:31:06.922248+0000","last_fullsized":"2024-02-16T10:31:06.922248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.927217+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:31:06.927217+0000","last_peered":"2024-02-16T10:31:06.927217+0000","last_clean":"2024-02-16T10:31:06.927217+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:31:06.927217+0000","last_undegraded":"2024-02-16T10:31:06.927217+0000","last_fullsized":"2024-02-16T10:31:06.927217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.919291+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:31:06.919291+0000","last_peered":"2024-02-16T10:31:06.919291+0000","last_clean":"2024-02-16T10:31:06.919291+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:31:06.919291+0000","last_undegraded":"2024-02-16T10:31:06.919291+0000","last_fullsized":"2024-02-16T10:31:06.919291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.694409+0000","last_change":"2024-02-16T10:30:28.065620+0000","last_active":"2024-02-16T10:31:12.694409+0000","last_peered":"2024-02-16T10:31:12.694409+0000","last_clean":"2024-02-16T10:31:12.694409+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:31:12.694409+0000","last_undegraded":"2024-02-16T10:31:12.694409+0000","last_fullsized":"2024-02-16T10:31:12.694409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925357+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:31:06.925357+0000","last_peered":"2024-02-16T10:31:06.925357+0000","last_clean":"2024-02-16T10:31:06.925357+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:31:06.925357+0000","last_undegraded":"2024-02-16T10:31:06.925357+0000","last_fullsized":"2024-02-16T10:31:06.925357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.216267+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:31:11.216267+0000","last_peered":"2024-02-16T10:31:11.216267+0000","last_clean":"2024-02-16T10:31:11.216267+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:31:11.216267+0000","last_undegraded":"2024-02-16T10:31:11.216267+0000","last_fullsized":"2024-02-16T10:31:11.216267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931119+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:31:06.931119+0000","last_peered":"2024-02-16T10:31:06.931119+0000","last_clean":"2024-02-16T10:31:06.931119+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:31:06.931119+0000","last_undegraded":"2024-02-16T10:31:06.931119+0000","last_fullsized":"2024-02-16T10:31:06.931119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.834436+0000","last_change":"2024-02-16T10:32:25.834500+0000","last_active":"2024-02-16T10:32:25.834436+0000","last_peered":"2024-02-16T10:32:25.834436+0000","last_clean":"2024-02-16T10:32:25.834436+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:25.834436+0000","last_undegraded":"2024-02-16T10:32:25.834436+0000","last_fullsized":"2024-02-16T10:32:25.834436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.834247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:24.022521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923342+0000","last_change":"2024-02-16T10:30:26.083864+0000","last_active":"2024-02-16T10:31:06.923342+0000","last_peered":"2024-02-16T10:31:06.923342+0000","last_clean":"2024-02-16T10:31:06.923342+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:31:06.923342+0000","last_undegraded":"2024-02-16T10:31:06.923342+0000","last_fullsized":"2024-02-16T10:31:06.923342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917422+0000","last_change":"2024-02-16T10:30:28.072935+0000","last_active":"2024-02-16T10:31:06.917422+0000","last_peered":"2024-02-16T10:31:06.917422+0000","last_clean":"2024-02-16T10:31:06.917422+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:31:06.917422+0000","last_undegraded":"2024-02-16T10:31:06.917422+0000","last_fullsized":"2024-02-16T10:31:06.917422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.934891+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:31:06.934891+0000","last_peered":"2024-02-16T10:31:06.934891+0000","last_clean":"2024-02-16T10:31:06.934891+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:31:06.934891+0000","last_undegraded":"2024-02-16T10:31:06.934891+0000","last_fullsized":"2024-02-16T10:31:06.934891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.987289+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:31:11.987289+0000","last_peered":"2024-02-16T10:31:11.987289+0000","last_clean":"2024-02-16T10:31:11.987289+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:31:11.987289+0000","last_undegraded":"2024-02-16T10:31:11.987289+0000","last_fullsized":"2024-02-16T10:31:11.987289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.932545+0000","last_change":"2024-02-16T10:30:28.088605+0000","last_active":"2024-02-16T10:31:06.932545+0000","last_peered":"2024-02-16T10:31:06.932545+0000","last_clean":"2024-02-16T10:31:06.932545+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:31:06.932545+0000","last_undegraded":"2024-02-16T10:31:06.932545+0000","last_fullsized":"2024-02-16T10:31:06.932545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925371+0000","last_change":"2024-02-16T10:30:26.100409+0000","last_active":"2024-02-16T10:31:06.925371+0000","last_peered":"2024-02-16T10:31:06.925371+0000","last_clean":"2024-02-16T10:31:06.925371+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:31:06.925371+0000","last_undegraded":"2024-02-16T10:31:06.925371+0000","last_fullsized":"2024-02-16T10:31:06.925371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852162+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.852162+0000","last_peered":"2024-02-16T10:31:54.852162+0000","last_clean":"2024-02-16T10:31:54.852162+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.852162+0000","last_undegraded":"2024-02-16T10:31:54.852162+0000","last_fullsized":"2024-02-16T10:31:54.852162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1282,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1384,"ondisk_log_size":1384,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":1.268,"15min":1.268},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.77800000000000002,"5min":1.139,"15min":1.139},"last":0.627},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.79200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66900000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705697,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.92900000000000005,"15min":0.97499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77000000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.4239999999999999,"15min":1.5660000000000001},"min":{"1min":0.29999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.78900000000000003,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.71299999999999997,"5min":0.873,"15min":0.873},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.751,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.625},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.2470000000000001,"15min":1.343},"min":{"1min":0.35199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.83899999999999997,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.65800000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705697,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78000000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.754}]},{"osd":2,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.81699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.72999999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55400000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.58299999999999996,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88900000000000001,"5min":1.115,"15min":1.115},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.627},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:34.446 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.446 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.446 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.446 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.446 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.447 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.447 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.447 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.447 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.447 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.448 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.448 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.448 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.448 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.448 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.449 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.450 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.450 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.450 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.450 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.450 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.451 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.451 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.451 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.451 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.451 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.452 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.452 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.452 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.452 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.452 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.453 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.454 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.455 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.455 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.455 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.455 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.456 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.456 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.456 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.456 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.456 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.457 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.458 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.458 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.458 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.458 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.458 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.459 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.459 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.459 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.459 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.459 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:30:11.961442+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.460 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.461 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.462 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.463 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.464 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.464 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.464 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.464 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.464 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.465 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.466 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.466 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.466 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.466 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.466 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.467 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.468 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.468 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.468 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.468 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.469 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.469 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.469 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.469 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.469 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.470 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.471 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.471 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.471 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.471 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.471 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.472 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-02-16T10:30:31.056734+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.472 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.472 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.472 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.472 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.473 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-02-16T10:30:33.070679+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.474 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.475 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.476 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.477 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.478 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.479 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.480 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:34.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:32:54.482 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:32:54.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.602+0000 7f0998f88640 1 Processor -- start 2024-02-16T10:32:54.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.602+0000 7f0998f88640 1 -- start start 2024-02-16T10:32:54.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f0998f88640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f099406f8b0 0x7f099412c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f0998f88640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994072450 con 0x7f099412c750 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f0998f88640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099412cb60 con 0x7f099406f8b0 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f099406f8b0 0x7f099412c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f0991d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f099412c750 0x7f0994128690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37110/0 (socket says 172.21.15.107:37110) 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f0991d9b640 1 -- 172.21.15.107:0/3695796467 learned_addr learned my addr 172.21.15.107:0/3695796467 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099259c640 1 -- 172.21.15.107:0/3695796467 >> v1:172.21.15.107:6789/0 conn(0x7f099412c750 legacy=0x7f0994128690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099259c640 1 -- 172.21.15.107:0/3695796467 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099412bed0 con 0x7f099406f8b0 2024-02-16T10:32:54.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099159a640 1 -- 172.21.15.107:0/3695796467 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052629454 0 0) 0x7f0994072450 con 0x7f099412c750 2024-02-16T10:32:54.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099259c640 1 --2- 172.21.15.107:0/3695796467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f099412c210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0988009740 tx=0x7f098801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16856c3cc9275e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:54.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099159a640 1 -- 172.21.15.107:0/3695796467 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09880ab530 con 0x7f099406f8b0 2024-02-16T10:32:54.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099159a640 1 -- 172.21.15.107:0/3695796467 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880a7050 con 0x7f099406f8b0 2024-02-16T10:32:54.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.606+0000 7f099159a640 1 -- 172.21.15.107:0/3695796467 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09880ab7e0 con 0x7f099406f8b0 2024-02-16T10:32:54.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/3695796467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 msgr2=0x7f099412c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 --2- 172.21.15.107:0/3695796467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f099412c210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0988009740 tx=0x7f098801c370 comp rx=0 tx=0).stop 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/3695796467 shutdown_connections 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 --2- 172.21.15.107:0/3695796467 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f099412c210 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/3695796467 >> 172.21.15.107:0/3695796467 conn(0x7f099409a1c0 msgr2=0x7f099409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/3695796467 shutdown_connections 2024-02-16T10:32:54.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/3695796467 wait complete. 2024-02-16T10:32:54.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 Processor -- start 2024-02-16T10:32:54.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- start start 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994113c30 con 0x7f099406f8b0 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f099259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f099259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36788/0 (socket says 172.21.15.107:36788) 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f099259c640 1 -- 172.21.15.107:0/413131194 learned_addr learned my addr 172.21.15.107:0/413131194 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f099259c640 1 -- 172.21.15.107:0/413131194 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009420 con 0x7f099406f8b0 2024-02-16T10:32:54.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f099259c640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0988019fa0 tx=0x7f098801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09880abea0 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09941134c0 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09941317b0 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09880b7580 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994114f50 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f09880b76e0 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994062980 con 0x7f099406f8b0 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 0x7f0974037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:32:54.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.610+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f09880e3230 con 0x7f099406f8b0 2024-02-16T10:32:54.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.614+0000 7f0991d9b640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 0x7f0974037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:32:54.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.614+0000 7f0991d9b640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 0x7f0974037ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f098c000f90 tx=0x7f098c007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:32:54.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.618+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09880c76c0 con 0x7f099406f8b0 2024-02-16T10:32:54.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.778+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0994114de0 con 0x7f0974035a10 2024-02-16T10:32:54.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.822+0000 7f0982ffd640 1 -- 172.21.15.107:0/413131194 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669863 (secure 0 0 0) 0x7f0994114de0 con 0x7f0974035a10 2024-02-16T10:32:54.836 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:32:54.842 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 msgr2=0x7f0974037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 0x7f0974037ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f098c000f90 tx=0x7f098c007ca0 comp rx=0 tx=0).stop 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 msgr2=0x7f0994121610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0988019fa0 tx=0x7f098801abb0 comp rx=0 tx=0).stop 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 shutdown_connections 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f0974035a10 0x7f0974037ed0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:54.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 --2- 172.21.15.107:0/413131194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f099406f8b0 0x7f0994121610 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:32:54.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 >> 172.21.15.107:0/413131194 conn(0x7f099409a1c0 msgr2=0x7f09941267b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:32:54.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 shutdown_connections 2024-02-16T10:32:54.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:32:54.830+0000 7f0998f88640 1 -- 172.21.15.107:0/413131194 wait complete. 2024-02-16T10:32:54.854 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-02-16T10:32:53.885056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3958,"ondisk_log_size":3958,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006880"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141767+0000","last_change":"2024-02-16T10:30:26.083783+0000","last_active":"2024-02-16T10:32:13.141767+0000","last_peered":"2024-02-16T10:32:13.141767+0000","last_clean":"2024-02-16T10:32:13.141767+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:32:13.141767+0000","last_undegraded":"2024-02-16T10:32:13.141767+0000","last_fullsized":"2024-02-16T10:32:13.141767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.252875+0000","last_change":"2024-02-16T10:32:46.252936+0000","last_active":"2024-02-16T10:32:46.252875+0000","last_peered":"2024-02-16T10:32:46.252875+0000","last_clean":"2024-02-16T10:32:46.252875+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:32:46.252875+0000","last_undegraded":"2024-02-16T10:32:46.252875+0000","last_fullsized":"2024-02-16T10:32:46.252875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.252657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:46.929942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233525+0000","last_change":"2024-02-16T10:30:26.087086+0000","last_active":"2024-02-16T10:32:12.233525+0000","last_peered":"2024-02-16T10:32:12.233525+0000","last_clean":"2024-02-16T10:32:12.233525+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:32:12.233525+0000","last_undegraded":"2024-02-16T10:32:12.233525+0000","last_fullsized":"2024-02-16T10:32:12.233525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918267+0000","last_change":"2024-02-16T10:30:28.060330+0000","last_active":"2024-02-16T10:31:06.918267+0000","last_peered":"2024-02-16T10:31:06.918267+0000","last_clean":"2024-02-16T10:31:06.918267+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:31:06.918267+0000","last_undegraded":"2024-02-16T10:31:06.918267+0000","last_fullsized":"2024-02-16T10:31:06.918267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608910+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:32:13.608910+0000","last_peered":"2024-02-16T10:32:13.608910+0000","last_clean":"2024-02-16T10:32:13.608910+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:32:13.608910+0000","last_undegraded":"2024-02-16T10:32:13.608910+0000","last_fullsized":"2024-02-16T10:32:13.608910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.920905+0000","last_change":"2024-02-16T10:30:28.061889+0000","last_active":"2024-02-16T10:31:06.920905+0000","last_peered":"2024-02-16T10:31:06.920905+0000","last_clean":"2024-02-16T10:31:06.920905+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:31:06.920905+0000","last_undegraded":"2024-02-16T10:31:06.920905+0000","last_fullsized":"2024-02-16T10:31:06.920905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141713+0000","last_change":"2024-02-16T10:30:26.078280+0000","last_active":"2024-02-16T10:32:13.141713+0000","last_peered":"2024-02-16T10:32:13.141713+0000","last_clean":"2024-02-16T10:32:13.141713+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:32:13.141713+0000","last_undegraded":"2024-02-16T10:32:13.141713+0000","last_fullsized":"2024-02-16T10:32:13.141713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.921021+0000","last_change":"2024-02-16T10:30:28.066911+0000","last_active":"2024-02-16T10:31:06.921021+0000","last_peered":"2024-02-16T10:31:06.921021+0000","last_clean":"2024-02-16T10:31:06.921021+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:31:06.921021+0000","last_undegraded":"2024-02-16T10:31:06.921021+0000","last_fullsized":"2024-02-16T10:31:06.921021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.855371+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:31:54.855371+0000","last_peered":"2024-02-16T10:31:54.855371+0000","last_clean":"2024-02-16T10:31:54.855371+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:31:54.855371+0000","last_undegraded":"2024-02-16T10:31:54.855371+0000","last_fullsized":"2024-02-16T10:31:54.855371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.266000+0000","last_change":"2024-02-16T10:32:43.266072+0000","last_active":"2024-02-16T10:32:43.266000+0000","last_peered":"2024-02-16T10:32:43.266000+0000","last_clean":"2024-02-16T10:32:43.266000+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:43.266000+0000","last_undegraded":"2024-02-16T10:32:43.266000+0000","last_fullsized":"2024-02-16T10:32:43.266000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.265822+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:11.123964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.908653+0000","last_change":"2024-02-16T10:30:26.078392+0000","last_active":"2024-02-16T10:31:06.908653+0000","last_peered":"2024-02-16T10:31:06.908653+0000","last_clean":"2024-02-16T10:31:06.908653+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:31:06.908653+0000","last_undegraded":"2024-02-16T10:31:06.908653+0000","last_fullsized":"2024-02-16T10:31:06.908653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.953068+0000","last_change":"2024-02-16T10:32:31.953068+0000","last_active":"2024-02-16T10:32:31.953068+0000","last_peered":"2024-02-16T10:32:31.953068+0000","last_clean":"2024-02-16T10:32:31.953068+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:32:31.953068+0000","last_undegraded":"2024-02-16T10:32:31.953068+0000","last_fullsized":"2024-02-16T10:32:31.953068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.952772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:14.372551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.918484+0000","last_change":"2024-02-16T10:30:26.092706+0000","last_active":"2024-02-16T10:31:06.918484+0000","last_peered":"2024-02-16T10:31:06.918484+0000","last_clean":"2024-02-16T10:31:06.918484+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:31:06.918484+0000","last_undegraded":"2024-02-16T10:31:06.918484+0000","last_fullsized":"2024-02-16T10:31:06.918484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.337640+0000","last_change":"2024-02-16T10:32:35.337640+0000","last_active":"2024-02-16T10:32:35.337640+0000","last_peered":"2024-02-16T10:32:35.337640+0000","last_clean":"2024-02-16T10:32:35.337640+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:32:35.337640+0000","last_undegraded":"2024-02-16T10:32:35.337640+0000","last_fullsized":"2024-02-16T10:32:35.337640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.337391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:00.524461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.925166+0000","last_change":"2024-02-16T10:30:26.087796+0000","last_active":"2024-02-16T10:31:06.925166+0000","last_peered":"2024-02-16T10:31:06.925166+0000","last_clean":"2024-02-16T10:31:06.925166+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:31:06.925166+0000","last_undegraded":"2024-02-16T10:31:06.925166+0000","last_fullsized":"2024-02-16T10:31:06.925166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.340659+0000","last_change":"2024-02-16T10:32:38.340723+0000","last_active":"2024-02-16T10:32:38.340659+0000","last_peered":"2024-02-16T10:32:38.340659+0000","last_clean":"2024-02-16T10:32:38.340659+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:32:38.340659+0000","last_undegraded":"2024-02-16T10:32:38.340659+0000","last_fullsized":"2024-02-16T10:32:38.340659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.340456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:20.043427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609679+0000","last_change":"2024-02-16T10:30:28.060567+0000","last_active":"2024-02-16T10:32:13.609679+0000","last_peered":"2024-02-16T10:32:13.609679+0000","last_clean":"2024-02-16T10:32:13.609679+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:32:13.609679+0000","last_undegraded":"2024-02-16T10:32:13.609679+0000","last_fullsized":"2024-02-16T10:32:13.609679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.250297+0000","last_change":"2024-02-16T10:32:49.250297+0000","last_active":"2024-02-16T10:32:49.250297+0000","last_peered":"2024-02-16T10:32:49.250297+0000","last_clean":"2024-02-16T10:32:49.250297+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:32:49.250297+0000","last_undegraded":"2024-02-16T10:32:49.250297+0000","last_fullsized":"2024-02-16T10:32:49.250297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:50.603059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.176433+0000","last_change":"2024-02-16T10:32:37.176433+0000","last_active":"2024-02-16T10:32:37.176433+0000","last_peered":"2024-02-16T10:32:37.176433+0000","last_clean":"2024-02-16T10:32:37.176433+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:32:37.176433+0000","last_undegraded":"2024-02-16T10:32:37.176433+0000","last_fullsized":"2024-02-16T10:32:37.176433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.176164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:03.368447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.273865+0000","last_change":"2024-02-16T10:32:43.273865+0000","last_active":"2024-02-16T10:32:43.273865+0000","last_peered":"2024-02-16T10:32:43.273865+0000","last_clean":"2024-02-16T10:32:43.273865+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:43.273865+0000","last_undegraded":"2024-02-16T10:32:43.273865+0000","last_fullsized":"2024-02-16T10:32:43.273865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.273587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:18.563027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.240319+0000","last_change":"2024-02-16T10:32:40.240319+0000","last_active":"2024-02-16T10:32:40.240319+0000","last_peered":"2024-02-16T10:32:40.240319+0000","last_clean":"2024-02-16T10:32:40.240319+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:32:40.240319+0000","last_undegraded":"2024-02-16T10:32:40.240319+0000","last_fullsized":"2024-02-16T10:32:40.240319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.239977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:18.554745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670288+0000","last_change":"2024-02-16T10:30:26.091712+0000","last_active":"2024-02-16T10:32:12.670288+0000","last_peered":"2024-02-16T10:32:12.670288+0000","last_clean":"2024-02-16T10:32:12.670288+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:32:12.670288+0000","last_undegraded":"2024-02-16T10:32:12.670288+0000","last_fullsized":"2024-02-16T10:32:12.670288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.593226+0000","last_change":"2024-02-16T10:32:46.593305+0000","last_active":"2024-02-16T10:32:46.593226+0000","last_peered":"2024-02-16T10:32:46.593226+0000","last_clean":"2024-02-16T10:32:46.593226+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:32:46.593226+0000","last_undegraded":"2024-02-16T10:32:46.593226+0000","last_fullsized":"2024-02-16T10:32:46.593226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.593037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:59:45.718528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670167+0000","last_change":"2024-02-16T10:30:26.097876+0000","last_active":"2024-02-16T10:32:12.670167+0000","last_peered":"2024-02-16T10:32:12.670167+0000","last_clean":"2024-02-16T10:32:12.670167+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:32:12.670167+0000","last_undegraded":"2024-02-16T10:32:12.670167+0000","last_fullsized":"2024-02-16T10:32:12.670167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.666644+0000","last_change":"2024-02-16T10:30:28.069451+0000","last_active":"2024-02-16T10:31:11.666644+0000","last_peered":"2024-02-16T10:31:11.666644+0000","last_clean":"2024-02-16T10:31:11.666644+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:31:11.666644+0000","last_undegraded":"2024-02-16T10:31:11.666644+0000","last_fullsized":"2024-02-16T10:31:11.666644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233610+0000","last_change":"2024-02-16T10:30:26.097723+0000","last_active":"2024-02-16T10:32:12.233610+0000","last_peered":"2024-02-16T10:32:12.233610+0000","last_clean":"2024-02-16T10:32:12.233610+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:32:12.233610+0000","last_undegraded":"2024-02-16T10:32:12.233610+0000","last_fullsized":"2024-02-16T10:32:12.233610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.224562+0000","last_change":"2024-02-16T10:32:39.224650+0000","last_active":"2024-02-16T10:32:39.224562+0000","last_peered":"2024-02-16T10:32:39.224562+0000","last_clean":"2024-02-16T10:32:39.224562+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:32:39.224562+0000","last_undegraded":"2024-02-16T10:32:39.224562+0000","last_fullsized":"2024-02-16T10:32:39.224562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.224377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:54.677431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608818+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:32:13.608818+0000","last_peered":"2024-02-16T10:32:13.608818+0000","last_clean":"2024-02-16T10:32:13.608818+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:32:13.608818+0000","last_undegraded":"2024-02-16T10:32:13.608818+0000","last_fullsized":"2024-02-16T10:32:13.608818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.249381+0000","last_change":"2024-02-16T10:32:42.249451+0000","last_active":"2024-02-16T10:32:42.249381+0000","last_peered":"2024-02-16T10:32:42.249381+0000","last_clean":"2024-02-16T10:32:42.249381+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:42.249381+0000","last_undegraded":"2024-02-16T10:32:42.249381+0000","last_fullsized":"2024-02-16T10:32:42.249381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.249133+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:17.794206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609102+0000","last_change":"2024-02-16T10:30:28.068195+0000","last_active":"2024-02-16T10:32:13.609102+0000","last_peered":"2024-02-16T10:32:13.609102+0000","last_clean":"2024-02-16T10:32:13.609102+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:32:13.609102+0000","last_undegraded":"2024-02-16T10:32:13.609102+0000","last_fullsized":"2024-02-16T10:32:13.609102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608466+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:32:13.608466+0000","last_peered":"2024-02-16T10:32:13.608466+0000","last_clean":"2024-02-16T10:32:13.608466+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:32:13.608466+0000","last_undegraded":"2024-02-16T10:32:13.608466+0000","last_fullsized":"2024-02-16T10:32:13.608466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.941363+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:31:06.941363+0000","last_peered":"2024-02-16T10:31:06.941363+0000","last_clean":"2024-02-16T10:31:06.941363+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:31:06.941363+0000","last_undegraded":"2024-02-16T10:31:06.941363+0000","last_fullsized":"2024-02-16T10:31:06.941363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.978645+0000","last_change":"2024-02-16T10:32:32.978713+0000","last_active":"2024-02-16T10:32:32.978645+0000","last_peered":"2024-02-16T10:32:32.978645+0000","last_clean":"2024-02-16T10:32:32.978645+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:32.978645+0000","last_undegraded":"2024-02-16T10:32:32.978645+0000","last_fullsized":"2024-02-16T10:32:32.978645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.978443+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:07.123372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.263564+0000","last_change":"2024-02-16T10:32:26.263617+0000","last_active":"2024-02-16T10:32:26.263564+0000","last_peered":"2024-02-16T10:32:26.263564+0000","last_clean":"2024-02-16T10:32:26.263564+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:32:26.263564+0000","last_undegraded":"2024-02-16T10:32:26.263564+0000","last_fullsized":"2024-02-16T10:32:26.263564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.263353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:40.727544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:55.096723+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:31:55.096723+0000","last_peered":"2024-02-16T10:31:55.096723+0000","last_clean":"2024-02-16T10:31:55.096723+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:31:55.096723+0000","last_undegraded":"2024-02-16T10:31:55.096723+0000","last_fullsized":"2024-02-16T10:31:55.096723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.008549+0000","last_change":"2024-02-16T10:31:06.938277+0000","last_active":"2024-02-16T10:31:12.008549+0000","last_peered":"2024-02-16T10:31:12.008549+0000","last_clean":"2024-02-16T10:31:12.008549+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:31:12.008549+0000","last_undegraded":"2024-02-16T10:31:12.008549+0000","last_fullsized":"2024-02-16T10:31:12.008549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141223+0000","last_change":"2024-02-16T10:30:26.078661+0000","last_active":"2024-02-16T10:32:13.141223+0000","last_peered":"2024-02-16T10:32:13.141223+0000","last_clean":"2024-02-16T10:32:13.141223+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:32:13.141223+0000","last_undegraded":"2024-02-16T10:32:13.141223+0000","last_fullsized":"2024-02-16T10:32:13.141223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.924569+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:10.924569+0000","last_peered":"2024-02-16T10:31:10.924569+0000","last_clean":"2024-02-16T10:31:10.924569+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:10.924569+0000","last_undegraded":"2024-02-16T10:31:10.924569+0000","last_fullsized":"2024-02-16T10:31:10.924569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.304857+0000","last_change":"2024-02-16T10:32:16.304935+0000","last_active":"2024-02-16T10:32:16.304857+0000","last_peered":"2024-02-16T10:32:16.304857+0000","last_clean":"2024-02-16T10:32:16.304857+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:32:16.304857+0000","last_undegraded":"2024-02-16T10:32:16.304857+0000","last_fullsized":"2024-02-16T10:32:16.304857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.304645+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:45.895015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.217170+0000","last_change":"2024-02-16T10:32:30.217226+0000","last_active":"2024-02-16T10:32:30.217170+0000","last_peered":"2024-02-16T10:32:30.217170+0000","last_clean":"2024-02-16T10:32:30.217170+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:32:30.217170+0000","last_undegraded":"2024-02-16T10:32:30.217170+0000","last_fullsized":"2024-02-16T10:32:30.217170+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.216971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:22.338282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.924336+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:31:06.924336+0000","last_peered":"2024-02-16T10:31:06.924336+0000","last_clean":"2024-02-16T10:31:06.924336+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:31:06.924336+0000","last_undegraded":"2024-02-16T10:31:06.924336+0000","last_fullsized":"2024-02-16T10:31:06.924336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.019132+0000","last_change":"2024-02-16T10:30:28.068257+0000","last_active":"2024-02-16T10:32:01.019132+0000","last_peered":"2024-02-16T10:32:01.019132+0000","last_clean":"2024-02-16T10:32:01.019132+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:01.019132+0000","last_undegraded":"2024-02-16T10:32:01.019132+0000","last_fullsized":"2024-02-16T10:32:01.019132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608323+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:32:13.608323+0000","last_peered":"2024-02-16T10:32:13.608323+0000","last_clean":"2024-02-16T10:32:13.608323+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:32:13.608323+0000","last_undegraded":"2024-02-16T10:32:13.608323+0000","last_fullsized":"2024-02-16T10:32:13.608323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.731305+0000","last_change":"2024-02-16T10:32:31.731408+0000","last_active":"2024-02-16T10:32:31.731305+0000","last_peered":"2024-02-16T10:32:31.731305+0000","last_clean":"2024-02-16T10:32:31.731305+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:32:31.731305+0000","last_undegraded":"2024-02-16T10:32:31.731305+0000","last_fullsized":"2024-02-16T10:32:31.731305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.731089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:38.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.284822+0000","last_change":"2024-02-16T10:32:19.284906+0000","last_active":"2024-02-16T10:32:19.284822+0000","last_peered":"2024-02-16T10:32:19.284822+0000","last_clean":"2024-02-16T10:32:19.284822+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:32:19.284822+0000","last_undegraded":"2024-02-16T10:32:19.284822+0000","last_fullsized":"2024-02-16T10:32:19.284822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.284625+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:24.273342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.940188+0000","last_change":"2024-02-16T10:32:40.940256+0000","last_active":"2024-02-16T10:32:40.940188+0000","last_peered":"2024-02-16T10:32:40.940188+0000","last_clean":"2024-02-16T10:32:40.940188+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:40.940188+0000","last_undegraded":"2024-02-16T10:32:40.940188+0000","last_fullsized":"2024-02-16T10:32:40.940188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.939974+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:39.316923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.378947+0000","last_change":"2024-02-16T10:32:34.379056+0000","last_active":"2024-02-16T10:32:34.378947+0000","last_peered":"2024-02-16T10:32:34.378947+0000","last_clean":"2024-02-16T10:32:34.378947+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:32:34.378947+0000","last_undegraded":"2024-02-16T10:32:34.378947+0000","last_fullsized":"2024-02-16T10:32:34.378947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.378676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:48.842868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.644398+0000","last_change":"2024-02-16T10:32:38.644457+0000","last_active":"2024-02-16T10:32:38.644398+0000","last_peered":"2024-02-16T10:32:38.644398+0000","last_clean":"2024-02-16T10:32:38.644398+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:38.644398+0000","last_undegraded":"2024-02-16T10:32:38.644398+0000","last_fullsized":"2024-02-16T10:32:38.644398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.644187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:07.018674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.669860+0000","last_change":"2024-02-16T10:30:26.084959+0000","last_active":"2024-02-16T10:32:12.669860+0000","last_peered":"2024-02-16T10:32:12.669860+0000","last_clean":"2024-02-16T10:32:12.669860+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:32:12.669860+0000","last_undegraded":"2024-02-16T10:32:12.669860+0000","last_fullsized":"2024-02-16T10:32:12.669860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.781497+0000","last_change":"2024-02-16T10:32:15.781557+0000","last_active":"2024-02-16T10:32:15.781497+0000","last_peered":"2024-02-16T10:32:15.781497+0000","last_clean":"2024-02-16T10:32:15.781497+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:32:15.781497+0000","last_undegraded":"2024-02-16T10:32:15.781497+0000","last_fullsized":"2024-02-16T10:32:15.781497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.781303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:34.208301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.237969+0000","last_change":"2024-02-16T10:32:17.238141+0000","last_active":"2024-02-16T10:32:17.237969+0000","last_peered":"2024-02-16T10:32:17.237969+0000","last_clean":"2024-02-16T10:32:17.237969+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:17.237969+0000","last_undegraded":"2024-02-16T10:32:17.237969+0000","last_fullsized":"2024-02-16T10:32:17.237969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.237729+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:01.114959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":342,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.449240+0000","last_change":"2024-02-16T10:32:14.449321+0000","last_active":"2024-02-16T10:32:14.449240+0000","last_peered":"2024-02-16T10:32:14.449240+0000","last_clean":"2024-02-16T10:32:14.449240+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:14.449240+0000","last_undegraded":"2024-02-16T10:32:14.449240+0000","last_fullsized":"2024-02-16T10:32:14.449240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.449055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:44.039424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.921754+0000","last_change":"2024-02-16T10:32:46.921910+0000","last_active":"2024-02-16T10:32:46.921754+0000","last_peered":"2024-02-16T10:32:46.921754+0000","last_clean":"2024-02-16T10:32:46.921754+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:32:46.921754+0000","last_undegraded":"2024-02-16T10:32:46.921754+0000","last_fullsized":"2024-02-16T10:32:46.921754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.921537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:02.923520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.268360+0000","last_change":"2024-02-16T10:32:45.268426+0000","last_active":"2024-02-16T10:32:45.268360+0000","last_peered":"2024-02-16T10:32:45.268360+0000","last_clean":"2024-02-16T10:32:45.268360+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:32:45.268360+0000","last_undegraded":"2024-02-16T10:32:45.268360+0000","last_fullsized":"2024-02-16T10:32:45.268360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.268134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:03.695131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.167563+0000","last_change":"2024-02-16T10:32:31.167563+0000","last_active":"2024-02-16T10:32:31.167563+0000","last_peered":"2024-02-16T10:32:31.167563+0000","last_clean":"2024-02-16T10:32:31.167563+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:32:31.167563+0000","last_undegraded":"2024-02-16T10:32:31.167563+0000","last_fullsized":"2024-02-16T10:32:31.167563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.167309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:12.870280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.399916+0000","last_change":"2024-02-16T10:32:23.399916+0000","last_active":"2024-02-16T10:32:23.399916+0000","last_peered":"2024-02-16T10:32:23.399916+0000","last_clean":"2024-02-16T10:32:23.399916+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:23.399916+0000","last_undegraded":"2024-02-16T10:32:23.399916+0000","last_fullsized":"2024-02-16T10:32:23.399916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.399643+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:12.773508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.465612+0000","last_change":"2024-02-16T10:32:16.465612+0000","last_active":"2024-02-16T10:32:16.465612+0000","last_peered":"2024-02-16T10:32:16.465612+0000","last_clean":"2024-02-16T10:32:16.465612+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:32:16.465612+0000","last_undegraded":"2024-02-16T10:32:16.465612+0000","last_fullsized":"2024-02-16T10:32:16.465612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.465378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:49.655775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.142978+0000","last_change":"2024-02-16T10:30:36.157649+0000","last_active":"2024-02-16T10:32:13.142978+0000","last_peered":"2024-02-16T10:32:13.142978+0000","last_clean":"2024-02-16T10:32:13.142978+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:32:13.142978+0000","last_undegraded":"2024-02-16T10:32:13.142978+0000","last_fullsized":"2024-02-16T10:32:13.142978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.232956+0000","last_change":"2024-02-16T10:32:48.233019+0000","last_active":"2024-02-16T10:32:48.232956+0000","last_peered":"2024-02-16T10:32:48.232956+0000","last_clean":"2024-02-16T10:32:48.232956+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:32:48.232956+0000","last_undegraded":"2024-02-16T10:32:48.232956+0000","last_fullsized":"2024-02-16T10:32:48.232956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.232778+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141215+0000","last_change":"2024-02-16T10:30:26.081456+0000","last_active":"2024-02-16T10:32:13.141215+0000","last_peered":"2024-02-16T10:32:13.141215+0000","last_clean":"2024-02-16T10:32:13.141215+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:32:13.141215+0000","last_undegraded":"2024-02-16T10:32:13.141215+0000","last_fullsized":"2024-02-16T10:32:13.141215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.647776+0000","last_change":"2024-02-16T10:32:27.647776+0000","last_active":"2024-02-16T10:32:27.647776+0000","last_peered":"2024-02-16T10:32:27.647776+0000","last_clean":"2024-02-16T10:32:27.647776+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:32:27.647776+0000","last_undegraded":"2024-02-16T10:32:27.647776+0000","last_fullsized":"2024-02-16T10:32:27.647776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.647521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:04.955314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.933959+0000","last_change":"2024-02-16T10:32:28.933959+0000","last_active":"2024-02-16T10:32:28.933959+0000","last_peered":"2024-02-16T10:32:28.933959+0000","last_clean":"2024-02-16T10:32:28.933959+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:28.933959+0000","last_undegraded":"2024-02-16T10:32:28.933959+0000","last_fullsized":"2024-02-16T10:32:28.933959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.933703+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:04.743780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.755709+0000","last_change":"2024-02-16T10:32:32.755709+0000","last_active":"2024-02-16T10:32:32.755709+0000","last_peered":"2024-02-16T10:32:32.755709+0000","last_clean":"2024-02-16T10:32:32.755709+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:32:32.755709+0000","last_undegraded":"2024-02-16T10:32:32.755709+0000","last_fullsized":"2024-02-16T10:32:32.755709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.755469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:24.687565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.672129+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:32:12.672129+0000","last_peered":"2024-02-16T10:32:12.672129+0000","last_clean":"2024-02-16T10:32:12.672129+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:32:12.672129+0000","last_undegraded":"2024-02-16T10:32:12.672129+0000","last_fullsized":"2024-02-16T10:32:12.672129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.286011+0000","last_change":"2024-02-16T10:32:40.286011+0000","last_active":"2024-02-16T10:32:40.286011+0000","last_peered":"2024-02-16T10:32:40.286011+0000","last_clean":"2024-02-16T10:32:40.286011+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:32:40.286011+0000","last_undegraded":"2024-02-16T10:32:40.286011+0000","last_fullsized":"2024-02-16T10:32:40.286011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.285731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:45.263145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608282+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:32:13.608282+0000","last_peered":"2024-02-16T10:32:13.608282+0000","last_clean":"2024-02-16T10:32:13.608282+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:32:13.608282+0000","last_undegraded":"2024-02-16T10:32:13.608282+0000","last_fullsized":"2024-02-16T10:32:13.608282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.768452+0000","last_change":"2024-02-16T10:32:33.768452+0000","last_active":"2024-02-16T10:32:33.768452+0000","last_peered":"2024-02-16T10:32:33.768452+0000","last_clean":"2024-02-16T10:32:33.768452+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:32:33.768452+0000","last_undegraded":"2024-02-16T10:32:33.768452+0000","last_fullsized":"2024-02-16T10:32:33.768452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.768198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:09.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.803505+0000","last_change":"2024-02-16T10:32:16.803505+0000","last_active":"2024-02-16T10:32:16.803505+0000","last_peered":"2024-02-16T10:32:16.803505+0000","last_clean":"2024-02-16T10:32:16.803505+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:16.803505+0000","last_undegraded":"2024-02-16T10:32:16.803505+0000","last_fullsized":"2024-02-16T10:32:16.803505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.803212+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:32.256266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.644180+0000","last_change":"2024-02-16T10:32:28.644180+0000","last_active":"2024-02-16T10:32:28.644180+0000","last_peered":"2024-02-16T10:32:28.644180+0000","last_clean":"2024-02-16T10:32:28.644180+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:28.644180+0000","last_undegraded":"2024-02-16T10:32:28.644180+0000","last_fullsized":"2024-02-16T10:32:28.644180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.643929+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:10.346900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234791+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:32:12.234791+0000","last_peered":"2024-02-16T10:32:12.234791+0000","last_clean":"2024-02-16T10:32:12.234791+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:32:12.234791+0000","last_undegraded":"2024-02-16T10:32:12.234791+0000","last_fullsized":"2024-02-16T10:32:12.234791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.286063+0000","last_change":"2024-02-16T10:32:46.286129+0000","last_active":"2024-02-16T10:32:46.286063+0000","last_peered":"2024-02-16T10:32:46.286063+0000","last_clean":"2024-02-16T10:32:46.286063+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:32:46.286063+0000","last_undegraded":"2024-02-16T10:32:46.286063+0000","last_fullsized":"2024-02-16T10:32:46.286063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.285887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:01.738941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608183+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:32:13.608183+0000","last_peered":"2024-02-16T10:32:13.608183+0000","last_clean":"2024-02-16T10:32:13.608183+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:32:13.608183+0000","last_undegraded":"2024-02-16T10:32:13.608183+0000","last_fullsized":"2024-02-16T10:32:13.608183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.695562+0000","last_change":"2024-02-16T10:32:30.695562+0000","last_active":"2024-02-16T10:32:30.695562+0000","last_peered":"2024-02-16T10:32:30.695562+0000","last_clean":"2024-02-16T10:32:30.695562+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:32:30.695562+0000","last_undegraded":"2024-02-16T10:32:30.695562+0000","last_fullsized":"2024-02-16T10:32:30.695562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.695316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:35.672730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.964066+0000","last_change":"2024-02-16T10:32:43.964066+0000","last_active":"2024-02-16T10:32:43.964066+0000","last_peered":"2024-02-16T10:32:43.964066+0000","last_clean":"2024-02-16T10:32:43.964066+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:43.964066+0000","last_undegraded":"2024-02-16T10:32:43.964066+0000","last_fullsized":"2024-02-16T10:32:43.964066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.963784+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:35.015936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.497295+0000","last_change":"2024-02-16T10:32:17.497295+0000","last_active":"2024-02-16T10:32:17.497295+0000","last_peered":"2024-02-16T10:32:17.497295+0000","last_clean":"2024-02-16T10:32:17.497295+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:32:17.497295+0000","last_undegraded":"2024-02-16T10:32:17.497295+0000","last_fullsized":"2024-02-16T10:32:17.497295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.496921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:48.124154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234801+0000","last_change":"2024-02-16T10:30:36.140468+0000","last_active":"2024-02-16T10:32:12.234801+0000","last_peered":"2024-02-16T10:32:12.234801+0000","last_clean":"2024-02-16T10:32:12.234801+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:32:12.234801+0000","last_undegraded":"2024-02-16T10:32:12.234801+0000","last_fullsized":"2024-02-16T10:32:12.234801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670482+0000","last_change":"2024-02-16T10:30:28.082084+0000","last_active":"2024-02-16T10:32:12.670482+0000","last_peered":"2024-02-16T10:32:12.670482+0000","last_clean":"2024-02-16T10:32:12.670482+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:32:12.670482+0000","last_undegraded":"2024-02-16T10:32:12.670482+0000","last_fullsized":"2024-02-16T10:32:12.670482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.532455+0000","last_change":"2024-02-16T10:32:49.532517+0000","last_active":"2024-02-16T10:32:49.532455+0000","last_peered":"2024-02-16T10:32:49.532455+0000","last_clean":"2024-02-16T10:32:49.532455+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:32:49.532455+0000","last_undegraded":"2024-02-16T10:32:49.532455+0000","last_fullsized":"2024-02-16T10:32:49.532455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.532266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:57.734052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.451331+0000","last_change":"2024-02-16T10:32:27.451331+0000","last_active":"2024-02-16T10:32:27.451331+0000","last_peered":"2024-02-16T10:32:27.451331+0000","last_clean":"2024-02-16T10:32:27.451331+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:27.451331+0000","last_undegraded":"2024-02-16T10:32:27.451331+0000","last_fullsized":"2024-02-16T10:32:27.451331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.451069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:58.078302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.240843+0000","last_change":"2024-02-16T10:32:20.240843+0000","last_active":"2024-02-16T10:32:20.240843+0000","last_peered":"2024-02-16T10:32:20.240843+0000","last_clean":"2024-02-16T10:32:20.240843+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:20.240843+0000","last_undegraded":"2024-02-16T10:32:20.240843+0000","last_fullsized":"2024-02-16T10:32:20.240843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.240570+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:31.716842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.017811+0000","last_change":"2024-02-16T10:32:37.017811+0000","last_active":"2024-02-16T10:32:37.017811+0000","last_peered":"2024-02-16T10:32:37.017811+0000","last_clean":"2024-02-16T10:32:37.017811+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:32:37.017811+0000","last_undegraded":"2024-02-16T10:32:37.017811+0000","last_fullsized":"2024-02-16T10:32:37.017811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.017556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:51.032253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610683+0000","last_change":"2024-02-16T10:30:36.145489+0000","last_active":"2024-02-16T10:32:13.610683+0000","last_peered":"2024-02-16T10:32:13.610683+0000","last_clean":"2024-02-16T10:32:13.610683+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:32:13.610683+0000","last_undegraded":"2024-02-16T10:32:13.610683+0000","last_fullsized":"2024-02-16T10:32:13.610683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.929301+0000","last_change":"2024-02-16T10:32:29.929301+0000","last_active":"2024-02-16T10:32:29.929301+0000","last_peered":"2024-02-16T10:32:29.929301+0000","last_clean":"2024-02-16T10:32:29.929301+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:32:29.929301+0000","last_undegraded":"2024-02-16T10:32:29.929301+0000","last_fullsized":"2024-02-16T10:32:29.929301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.929048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:38.130834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608287+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:32:13.608287+0000","last_peered":"2024-02-16T10:32:13.608287+0000","last_clean":"2024-02-16T10:32:13.608287+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:32:13.608287+0000","last_undegraded":"2024-02-16T10:32:13.608287+0000","last_fullsized":"2024-02-16T10:32:13.608287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.646038+0000","last_change":"2024-02-16T10:32:29.646038+0000","last_active":"2024-02-16T10:32:29.646038+0000","last_peered":"2024-02-16T10:32:29.646038+0000","last_clean":"2024-02-16T10:32:29.646038+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:32:29.646038+0000","last_undegraded":"2024-02-16T10:32:29.646038+0000","last_fullsized":"2024-02-16T10:32:29.646038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.645785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:23.146927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.309318+0000","last_change":"2024-02-16T10:32:21.309318+0000","last_active":"2024-02-16T10:32:21.309318+0000","last_peered":"2024-02-16T10:32:21.309318+0000","last_clean":"2024-02-16T10:32:21.309318+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:21.309318+0000","last_undegraded":"2024-02-16T10:32:21.309318+0000","last_fullsized":"2024-02-16T10:32:21.309318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.309051+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:16:57.682746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.163489+0000","last_change":"2024-02-16T10:32:14.163489+0000","last_active":"2024-02-16T10:32:14.163489+0000","last_peered":"2024-02-16T10:32:14.163489+0000","last_clean":"2024-02-16T10:32:14.163489+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:14.163489+0000","last_undegraded":"2024-02-16T10:32:14.163489+0000","last_fullsized":"2024-02-16T10:32:14.163489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.163228+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:11.600065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234883+0000","last_change":"2024-02-16T10:30:36.138809+0000","last_active":"2024-02-16T10:32:12.234883+0000","last_peered":"2024-02-16T10:32:12.234883+0000","last_clean":"2024-02-16T10:32:12.234883+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:32:12.234883+0000","last_undegraded":"2024-02-16T10:32:12.234883+0000","last_fullsized":"2024-02-16T10:32:12.234883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.368195+0000","last_change":"2024-02-16T10:32:36.368195+0000","last_active":"2024-02-16T10:32:36.368195+0000","last_peered":"2024-02-16T10:32:36.368195+0000","last_clean":"2024-02-16T10:32:36.368195+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:32:36.368195+0000","last_undegraded":"2024-02-16T10:32:36.368195+0000","last_fullsized":"2024-02-16T10:32:36.368195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.367915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:48.603515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608121+0000","last_change":"2024-02-16T10:30:26.088358+0000","last_active":"2024-02-16T10:32:13.608121+0000","last_peered":"2024-02-16T10:32:13.608121+0000","last_clean":"2024-02-16T10:32:13.608121+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:32:13.608121+0000","last_undegraded":"2024-02-16T10:32:13.608121+0000","last_fullsized":"2024-02-16T10:32:13.608121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.227428+0000","last_change":"2024-02-16T10:32:29.227428+0000","last_active":"2024-02-16T10:32:29.227428+0000","last_peered":"2024-02-16T10:32:29.227428+0000","last_clean":"2024-02-16T10:32:29.227428+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:29.227428+0000","last_undegraded":"2024-02-16T10:32:29.227428+0000","last_fullsized":"2024-02-16T10:32:29.227428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.227174+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:41.462774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.984249+0000","last_change":"2024-02-16T10:32:41.984249+0000","last_active":"2024-02-16T10:32:41.984249+0000","last_peered":"2024-02-16T10:32:41.984249+0000","last_clean":"2024-02-16T10:32:41.984249+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:32:41.984249+0000","last_undegraded":"2024-02-16T10:32:41.984249+0000","last_fullsized":"2024-02-16T10:32:41.984249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.983908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:16.170915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.304415+0000","last_change":"2024-02-16T10:32:18.304415+0000","last_active":"2024-02-16T10:32:18.304415+0000","last_peered":"2024-02-16T10:32:18.304415+0000","last_clean":"2024-02-16T10:32:18.304415+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:18.304415+0000","last_undegraded":"2024-02-16T10:32:18.304415+0000","last_fullsized":"2024-02-16T10:32:18.304415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.304138+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:51.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.142952+0000","last_change":"2024-02-16T10:30:36.138696+0000","last_active":"2024-02-16T10:32:13.142952+0000","last_peered":"2024-02-16T10:32:13.142952+0000","last_clean":"2024-02-16T10:32:13.142952+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:32:13.142952+0000","last_undegraded":"2024-02-16T10:32:13.142952+0000","last_fullsized":"2024-02-16T10:32:13.142952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.143875+0000","last_change":"2024-02-16T10:32:35.143875+0000","last_active":"2024-02-16T10:32:35.143875+0000","last_peered":"2024-02-16T10:32:35.143875+0000","last_clean":"2024-02-16T10:32:35.143875+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:32:35.143875+0000","last_undegraded":"2024-02-16T10:32:35.143875+0000","last_fullsized":"2024-02-16T10:32:35.143875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.143615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:27.075711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608098+0000","last_change":"2024-02-16T10:30:26.084944+0000","last_active":"2024-02-16T10:32:13.608098+0000","last_peered":"2024-02-16T10:32:13.608098+0000","last_clean":"2024-02-16T10:32:13.608098+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:32:13.608098+0000","last_undegraded":"2024-02-16T10:32:13.608098+0000","last_fullsized":"2024-02-16T10:32:13.608098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.781651+0000","last_change":"2024-02-16T10:32:13.781651+0000","last_active":"2024-02-16T10:32:13.781651+0000","last_peered":"2024-02-16T10:32:13.781651+0000","last_clean":"2024-02-16T10:32:13.781651+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:32:13.781651+0000","last_undegraded":"2024-02-16T10:32:13.781651+0000","last_fullsized":"2024-02-16T10:32:13.781651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.781400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:02:49.070840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.203087+0000","last_change":"2024-02-16T10:32:21.203087+0000","last_active":"2024-02-16T10:32:21.203087+0000","last_peered":"2024-02-16T10:32:21.203087+0000","last_clean":"2024-02-16T10:32:21.203087+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:21.203087+0000","last_undegraded":"2024-02-16T10:32:21.203087+0000","last_fullsized":"2024-02-16T10:32:21.203087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.202707+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:08.574336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.238385+0000","last_change":"2024-02-16T10:32:18.238385+0000","last_active":"2024-02-16T10:32:18.238385+0000","last_peered":"2024-02-16T10:32:18.238385+0000","last_clean":"2024-02-16T10:32:18.238385+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:32:18.238385+0000","last_undegraded":"2024-02-16T10:32:18.238385+0000","last_fullsized":"2024-02-16T10:32:18.238385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.238111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:31.457700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.136516+0000","last_change":"2024-02-16T10:32:34.136516+0000","last_active":"2024-02-16T10:32:34.136516+0000","last_peered":"2024-02-16T10:32:34.136516+0000","last_clean":"2024-02-16T10:32:34.136516+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:32:34.136516+0000","last_undegraded":"2024-02-16T10:32:34.136516+0000","last_fullsized":"2024-02-16T10:32:34.136516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.136238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:40.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.943470+0000","last_change":"2024-02-16T10:32:30.943470+0000","last_active":"2024-02-16T10:32:30.943470+0000","last_peered":"2024-02-16T10:32:30.943470+0000","last_clean":"2024-02-16T10:32:30.943470+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:32:30.943470+0000","last_undegraded":"2024-02-16T10:32:30.943470+0000","last_fullsized":"2024-02-16T10:32:30.943470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.943169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:44.988481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.669942+0000","last_change":"2024-02-16T10:30:13.039682+0000","last_active":"2024-02-16T10:32:12.669942+0000","last_peered":"2024-02-16T10:32:12.669942+0000","last_clean":"2024-02-16T10:32:12.669942+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:32:12.669942+0000","last_undegraded":"2024-02-16T10:32:12.669942+0000","last_fullsized":"2024-02-16T10:32:12.669942+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:11.961442+0000","last_clean_scrub_stamp":"2024-02-16T10:30:11.961442+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607902+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:32:13.607902+0000","last_peered":"2024-02-16T10:32:13.607902+0000","last_clean":"2024-02-16T10:32:13.607902+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:32:13.607902+0000","last_undegraded":"2024-02-16T10:32:13.607902+0000","last_fullsized":"2024-02-16T10:32:13.607902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608068+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:32:13.608068+0000","last_peered":"2024-02-16T10:32:13.608068+0000","last_clean":"2024-02-16T10:32:13.608068+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:32:13.608068+0000","last_undegraded":"2024-02-16T10:32:13.608068+0000","last_fullsized":"2024-02-16T10:32:13.608068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.279935+0000","last_change":"2024-02-16T10:32:27.279935+0000","last_active":"2024-02-16T10:32:27.279935+0000","last_peered":"2024-02-16T10:32:27.279935+0000","last_clean":"2024-02-16T10:32:27.279935+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:32:27.279935+0000","last_undegraded":"2024-02-16T10:32:27.279935+0000","last_fullsized":"2024-02-16T10:32:27.279935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.279691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:39:24.188579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.960833+0000","last_change":"2024-02-16T10:32:38.960833+0000","last_active":"2024-02-16T10:32:38.960833+0000","last_peered":"2024-02-16T10:32:38.960833+0000","last_clean":"2024-02-16T10:32:38.960833+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:38.960833+0000","last_undegraded":"2024-02-16T10:32:38.960833+0000","last_fullsized":"2024-02-16T10:32:38.960833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.960420+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:29:47.645317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.512594+0000","last_change":"2024-02-16T10:32:20.512594+0000","last_active":"2024-02-16T10:32:20.512594+0000","last_peered":"2024-02-16T10:32:20.512594+0000","last_clean":"2024-02-16T10:32:20.512594+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:32:20.512594+0000","last_undegraded":"2024-02-16T10:32:20.512594+0000","last_fullsized":"2024-02-16T10:32:20.512594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.512313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:57.090214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.143015+0000","last_change":"2024-02-16T10:30:36.136357+0000","last_active":"2024-02-16T10:32:13.143015+0000","last_peered":"2024-02-16T10:32:13.143015+0000","last_clean":"2024-02-16T10:32:13.143015+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:32:13.143015+0000","last_undegraded":"2024-02-16T10:32:13.143015+0000","last_fullsized":"2024-02-16T10:32:13.143015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.948837+0000","last_change":"2024-02-16T10:32:49.948909+0000","last_active":"2024-02-16T10:32:49.948837+0000","last_peered":"2024-02-16T10:32:49.948837+0000","last_clean":"2024-02-16T10:32:49.948837+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:32:49.948837+0000","last_undegraded":"2024-02-16T10:32:49.948837+0000","last_fullsized":"2024-02-16T10:32:49.948837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.948648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:05.258497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607879+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:32:13.607879+0000","last_peered":"2024-02-16T10:32:13.607879+0000","last_clean":"2024-02-16T10:32:13.607879+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:32:13.607879+0000","last_undegraded":"2024-02-16T10:32:13.607879+0000","last_fullsized":"2024-02-16T10:32:13.607879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.571062+0000","last_change":"2024-02-16T10:32:47.571125+0000","last_active":"2024-02-16T10:32:47.571062+0000","last_peered":"2024-02-16T10:32:47.571062+0000","last_clean":"2024-02-16T10:32:47.571062+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:32:47.571062+0000","last_undegraded":"2024-02-16T10:32:47.571062+0000","last_fullsized":"2024-02-16T10:32:47.571062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.570876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:07:21.048590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.736135+0000","last_change":"2024-02-16T10:32:14.736135+0000","last_active":"2024-02-16T10:32:14.736135+0000","last_peered":"2024-02-16T10:32:14.736135+0000","last_clean":"2024-02-16T10:32:14.736135+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:32:14.736135+0000","last_undegraded":"2024-02-16T10:32:14.736135+0000","last_fullsized":"2024-02-16T10:32:14.736135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.735884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:40.928168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.273669+0000","last_change":"2024-02-16T10:32:19.273669+0000","last_active":"2024-02-16T10:32:19.273669+0000","last_peered":"2024-02-16T10:32:19.273669+0000","last_clean":"2024-02-16T10:32:19.273669+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:19.273669+0000","last_undegraded":"2024-02-16T10:32:19.273669+0000","last_fullsized":"2024-02-16T10:32:19.273669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.273406+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:49.900639+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.978134+0000","last_change":"2024-02-16T10:32:48.978193+0000","last_active":"2024-02-16T10:32:48.978134+0000","last_peered":"2024-02-16T10:32:48.978134+0000","last_clean":"2024-02-16T10:32:48.978134+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:32:48.978134+0000","last_undegraded":"2024-02-16T10:32:48.978134+0000","last_fullsized":"2024-02-16T10:32:48.978134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.977937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:51.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.174869+0000","last_change":"2024-02-16T10:32:38.174869+0000","last_active":"2024-02-16T10:32:38.174869+0000","last_peered":"2024-02-16T10:32:38.174869+0000","last_clean":"2024-02-16T10:32:38.174869+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:32:38.174869+0000","last_undegraded":"2024-02-16T10:32:38.174869+0000","last_fullsized":"2024-02-16T10:32:38.174869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.174629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:56.601626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.613284+0000","last_change":"2024-02-16T10:32:41.613350+0000","last_active":"2024-02-16T10:32:41.613284+0000","last_peered":"2024-02-16T10:32:41.613284+0000","last_clean":"2024-02-16T10:32:41.613284+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:41.613284+0000","last_undegraded":"2024-02-16T10:32:41.613284+0000","last_fullsized":"2024-02-16T10:32:41.613284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.613065+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:19.969376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141210+0000","last_change":"2024-02-16T10:30:18.006430+0000","last_active":"2024-02-16T10:32:13.141210+0000","last_peered":"2024-02-16T10:32:13.141210+0000","last_clean":"2024-02-16T10:32:13.141210+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:32:13.141210+0000","last_undegraded":"2024-02-16T10:32:13.141210+0000","last_fullsized":"2024-02-16T10:32:13.141210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233308+0000","last_change":"2024-02-16T10:30:26.097887+0000","last_active":"2024-02-16T10:32:12.233308+0000","last_peered":"2024-02-16T10:32:12.233308+0000","last_clean":"2024-02-16T10:32:12.233308+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:32:12.233308+0000","last_undegraded":"2024-02-16T10:32:12.233308+0000","last_fullsized":"2024-02-16T10:32:12.233308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.455727+0000","last_change":"2024-02-16T10:32:29.455727+0000","last_active":"2024-02-16T10:32:29.455727+0000","last_peered":"2024-02-16T10:32:29.455727+0000","last_clean":"2024-02-16T10:32:29.455727+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:32:29.455727+0000","last_undegraded":"2024-02-16T10:32:29.455727+0000","last_fullsized":"2024-02-16T10:32:29.455727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.455432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:16.827061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.278098+0000","last_change":"2024-02-16T10:32:20.278098+0000","last_active":"2024-02-16T10:32:20.278098+0000","last_peered":"2024-02-16T10:32:20.278098+0000","last_clean":"2024-02-16T10:32:20.278098+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:20.278098+0000","last_undegraded":"2024-02-16T10:32:20.278098+0000","last_fullsized":"2024-02-16T10:32:20.278098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.277804+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:57:46.102924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.694650+0000","last_change":"2024-02-16T10:32:36.694650+0000","last_active":"2024-02-16T10:32:36.694650+0000","last_peered":"2024-02-16T10:32:36.694650+0000","last_clean":"2024-02-16T10:32:36.694650+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:32:36.694650+0000","last_undegraded":"2024-02-16T10:32:36.694650+0000","last_fullsized":"2024-02-16T10:32:36.694650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.694397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:52.147451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610710+0000","last_change":"2024-02-16T10:30:36.131743+0000","last_active":"2024-02-16T10:32:13.610710+0000","last_peered":"2024-02-16T10:32:13.610710+0000","last_clean":"2024-02-16T10:32:13.610710+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:32:13.610710+0000","last_undegraded":"2024-02-16T10:32:13.610710+0000","last_fullsized":"2024-02-16T10:32:13.610710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233625+0000","last_change":"2024-02-16T10:30:28.073899+0000","last_active":"2024-02-16T10:32:12.233625+0000","last_peered":"2024-02-16T10:32:12.233625+0000","last_clean":"2024-02-16T10:32:12.233625+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:32:12.233625+0000","last_undegraded":"2024-02-16T10:32:12.233625+0000","last_fullsized":"2024-02-16T10:32:12.233625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607881+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:32:13.607881+0000","last_peered":"2024-02-16T10:32:13.607881+0000","last_clean":"2024-02-16T10:32:13.607881+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:32:13.607881+0000","last_undegraded":"2024-02-16T10:32:13.607881+0000","last_fullsized":"2024-02-16T10:32:13.607881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.301659+0000","last_change":"2024-02-16T10:32:47.301721+0000","last_active":"2024-02-16T10:32:47.301659+0000","last_peered":"2024-02-16T10:32:47.301659+0000","last_clean":"2024-02-16T10:32:47.301659+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:32:47.301659+0000","last_undegraded":"2024-02-16T10:32:47.301659+0000","last_fullsized":"2024-02-16T10:32:47.301659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.301448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:25.616217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.751469+0000","last_change":"2024-02-16T10:32:34.751469+0000","last_active":"2024-02-16T10:32:34.751469+0000","last_peered":"2024-02-16T10:32:34.751469+0000","last_clean":"2024-02-16T10:32:34.751469+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:32:34.751469+0000","last_undegraded":"2024-02-16T10:32:34.751469+0000","last_fullsized":"2024-02-16T10:32:34.751469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.751222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:00.943506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.979895+0000","last_change":"2024-02-16T10:32:39.979895+0000","last_active":"2024-02-16T10:32:39.979895+0000","last_peered":"2024-02-16T10:32:39.979895+0000","last_clean":"2024-02-16T10:32:39.979895+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:32:39.979895+0000","last_undegraded":"2024-02-16T10:32:39.979895+0000","last_fullsized":"2024-02-16T10:32:39.979895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.979639+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:56:47.790005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.981922+0000","last_change":"2024-02-16T10:32:44.981922+0000","last_active":"2024-02-16T10:32:44.981922+0000","last_peered":"2024-02-16T10:32:44.981922+0000","last_clean":"2024-02-16T10:32:44.981922+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:32:44.981922+0000","last_undegraded":"2024-02-16T10:32:44.981922+0000","last_fullsized":"2024-02-16T10:32:44.981922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.981644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:40.009681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.671721+0000","last_change":"2024-02-16T10:30:36.148250+0000","last_active":"2024-02-16T10:32:12.671721+0000","last_peered":"2024-02-16T10:32:12.671721+0000","last_clean":"2024-02-16T10:32:12.671721+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:32:12.671721+0000","last_undegraded":"2024-02-16T10:32:12.671721+0000","last_fullsized":"2024-02-16T10:32:12.671721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.246559+0000","last_change":"2024-02-16T10:32:44.246622+0000","last_active":"2024-02-16T10:32:44.246559+0000","last_peered":"2024-02-16T10:32:44.246559+0000","last_clean":"2024-02-16T10:32:44.246559+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:32:44.246559+0000","last_undegraded":"2024-02-16T10:32:44.246559+0000","last_fullsized":"2024-02-16T10:32:44.246559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.246379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:22.602690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.242816+0000","last_change":"2024-02-16T10:32:41.242876+0000","last_active":"2024-02-16T10:32:41.242816+0000","last_peered":"2024-02-16T10:32:41.242816+0000","last_clean":"2024-02-16T10:32:41.242816+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:32:41.242816+0000","last_undegraded":"2024-02-16T10:32:41.242816+0000","last_fullsized":"2024-02-16T10:32:41.242816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.242620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:47.758750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233235+0000","last_change":"2024-02-16T10:30:18.011728+0000","last_active":"2024-02-16T10:32:12.233235+0000","last_peered":"2024-02-16T10:32:12.233235+0000","last_clean":"2024-02-16T10:32:12.233235+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:32:12.233235+0000","last_undegraded":"2024-02-16T10:32:12.233235+0000","last_fullsized":"2024-02-16T10:32:12.233235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.723330+0000","last_change":"2024-02-16T10:32:35.723330+0000","last_active":"2024-02-16T10:32:35.723330+0000","last_peered":"2024-02-16T10:32:35.723330+0000","last_clean":"2024-02-16T10:32:35.723330+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:32:35.723330+0000","last_undegraded":"2024-02-16T10:32:35.723330+0000","last_fullsized":"2024-02-16T10:32:35.723330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.723078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:54.150076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'70","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.637878+0000","last_change":"2024-02-16T10:32:26.637878+0000","last_active":"2024-02-16T10:32:26.637878+0000","last_peered":"2024-02-16T10:32:26.637878+0000","last_clean":"2024-02-16T10:32:26.637878+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:26.637878+0000","last_undegraded":"2024-02-16T10:32:26.637878+0000","last_fullsized":"2024-02-16T10:32:26.637878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.637563+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:38.873163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.185179+0000","last_change":"2024-02-16T10:32:16.185179+0000","last_active":"2024-02-16T10:32:16.185179+0000","last_peered":"2024-02-16T10:32:16.185179+0000","last_clean":"2024-02-16T10:32:16.185179+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:32:16.185179+0000","last_undegraded":"2024-02-16T10:32:16.185179+0000","last_fullsized":"2024-02-16T10:32:16.185179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.184842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:49:06.247286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.647753+0000","last_change":"2024-02-16T10:32:40.647753+0000","last_active":"2024-02-16T10:32:40.647753+0000","last_peered":"2024-02-16T10:32:40.647753+0000","last_clean":"2024-02-16T10:32:40.647753+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:32:40.647753+0000","last_undegraded":"2024-02-16T10:32:40.647753+0000","last_fullsized":"2024-02-16T10:32:40.647753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.647500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:34.495274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670434+0000","last_change":"2024-02-16T10:30:28.077914+0000","last_active":"2024-02-16T10:32:12.670434+0000","last_peered":"2024-02-16T10:32:12.670434+0000","last_clean":"2024-02-16T10:32:12.670434+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:32:12.670434+0000","last_undegraded":"2024-02-16T10:32:12.670434+0000","last_fullsized":"2024-02-16T10:32:12.670434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233340+0000","last_change":"2024-02-16T10:30:26.087098+0000","last_active":"2024-02-16T10:32:12.233340+0000","last_peered":"2024-02-16T10:32:12.233340+0000","last_clean":"2024-02-16T10:32:12.233340+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:32:12.233340+0000","last_undegraded":"2024-02-16T10:32:12.233340+0000","last_fullsized":"2024-02-16T10:32:12.233340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608025+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:32:13.608025+0000","last_peered":"2024-02-16T10:32:13.608025+0000","last_clean":"2024-02-16T10:32:13.608025+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:32:13.608025+0000","last_undegraded":"2024-02-16T10:32:13.608025+0000","last_fullsized":"2024-02-16T10:32:13.608025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.858645+0000","last_change":"2024-02-16T10:32:19.858645+0000","last_active":"2024-02-16T10:32:19.858645+0000","last_peered":"2024-02-16T10:32:19.858645+0000","last_clean":"2024-02-16T10:32:19.858645+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:32:19.858645+0000","last_undegraded":"2024-02-16T10:32:19.858645+0000","last_fullsized":"2024-02-16T10:32:19.858645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.858393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:55.403466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.357240+0000","last_change":"2024-02-16T10:32:15.357240+0000","last_active":"2024-02-16T10:32:15.357240+0000","last_peered":"2024-02-16T10:32:15.357240+0000","last_clean":"2024-02-16T10:32:15.357240+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:32:15.357240+0000","last_undegraded":"2024-02-16T10:32:15.357240+0000","last_fullsized":"2024-02-16T10:32:15.357240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.356955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:04:12.700846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.354389+0000","last_change":"2024-02-16T10:32:14.354389+0000","last_active":"2024-02-16T10:32:14.354389+0000","last_peered":"2024-02-16T10:32:14.354389+0000","last_clean":"2024-02-16T10:32:14.354389+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:14.354389+0000","last_undegraded":"2024-02-16T10:32:14.354389+0000","last_fullsized":"2024-02-16T10:32:14.354389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.353994+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:24.095058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610738+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:32:13.610738+0000","last_peered":"2024-02-16T10:32:13.610738+0000","last_clean":"2024-02-16T10:32:13.610738+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:32:13.610738+0000","last_undegraded":"2024-02-16T10:32:13.610738+0000","last_fullsized":"2024-02-16T10:32:13.610738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.901200+0000","last_change":"2024-02-16T10:31:06.919262+0000","last_active":"2024-02-16T10:31:10.901200+0000","last_peered":"2024-02-16T10:31:10.901200+0000","last_clean":"2024-02-16T10:31:10.901200+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:31:10.901200+0000","last_undegraded":"2024-02-16T10:31:10.901200+0000","last_fullsized":"2024-02-16T10:31:10.901200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608240+0000","last_change":"2024-02-16T10:30:26.088799+0000","last_active":"2024-02-16T10:32:13.608240+0000","last_peered":"2024-02-16T10:32:13.608240+0000","last_clean":"2024-02-16T10:32:13.608240+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:32:13.608240+0000","last_undegraded":"2024-02-16T10:32:13.608240+0000","last_fullsized":"2024-02-16T10:32:13.608240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233154+0000","last_change":"2024-02-16T10:30:18.009721+0000","last_active":"2024-02-16T10:32:12.233154+0000","last_peered":"2024-02-16T10:32:12.233154+0000","last_clean":"2024-02-16T10:32:12.233154+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:32:12.233154+0000","last_undegraded":"2024-02-16T10:32:12.233154+0000","last_fullsized":"2024-02-16T10:32:12.233154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.913654+0000","last_change":"2024-02-16T10:32:21.913654+0000","last_active":"2024-02-16T10:32:21.913654+0000","last_peered":"2024-02-16T10:32:21.913654+0000","last_clean":"2024-02-16T10:32:21.913654+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:32:21.913654+0000","last_undegraded":"2024-02-16T10:32:21.913654+0000","last_fullsized":"2024-02-16T10:32:21.913654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.913396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:04.153154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.866581+0000","last_change":"2024-02-16T10:32:26.866581+0000","last_active":"2024-02-16T10:32:26.866581+0000","last_peered":"2024-02-16T10:32:26.866581+0000","last_clean":"2024-02-16T10:32:26.866581+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:32:26.866581+0000","last_undegraded":"2024-02-16T10:32:26.866581+0000","last_fullsized":"2024-02-16T10:32:26.866581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.866309+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:28.219357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.413073+0000","last_change":"2024-02-16T10:32:13.413073+0000","last_active":"2024-02-16T10:32:13.413073+0000","last_peered":"2024-02-16T10:32:13.413073+0000","last_clean":"2024-02-16T10:32:13.413073+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:13.413073+0000","last_undegraded":"2024-02-16T10:32:13.413073+0000","last_fullsized":"2024-02-16T10:32:13.413073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.412978+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:02.786844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.672032+0000","last_change":"2024-02-16T10:30:36.144376+0000","last_active":"2024-02-16T10:32:12.672032+0000","last_peered":"2024-02-16T10:32:12.672032+0000","last_clean":"2024-02-16T10:32:12.672032+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:32:12.672032+0000","last_undegraded":"2024-02-16T10:32:12.672032+0000","last_fullsized":"2024-02-16T10:32:12.672032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.364773+0000","last_change":"2024-02-16T10:32:37.364825+0000","last_active":"2024-02-16T10:32:37.364773+0000","last_peered":"2024-02-16T10:32:37.364773+0000","last_clean":"2024-02-16T10:32:37.364773+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:32:37.364773+0000","last_undegraded":"2024-02-16T10:32:37.364773+0000","last_fullsized":"2024-02-16T10:32:37.364773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.364585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:29.485895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.669885+0000","last_change":"2024-02-16T10:30:26.085644+0000","last_active":"2024-02-16T10:32:12.669885+0000","last_peered":"2024-02-16T10:32:12.669885+0000","last_clean":"2024-02-16T10:32:12.669885+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:32:12.669885+0000","last_undegraded":"2024-02-16T10:32:12.669885+0000","last_fullsized":"2024-02-16T10:32:12.669885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607996+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:32:13.607996+0000","last_peered":"2024-02-16T10:32:13.607996+0000","last_clean":"2024-02-16T10:32:13.607996+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:32:13.607996+0000","last_undegraded":"2024-02-16T10:32:13.607996+0000","last_fullsized":"2024-02-16T10:32:13.607996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.894998+0000","last_change":"2024-02-16T10:32:23.894998+0000","last_active":"2024-02-16T10:32:23.894998+0000","last_peered":"2024-02-16T10:32:23.894998+0000","last_clean":"2024-02-16T10:32:23.894998+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:32:23.894998+0000","last_undegraded":"2024-02-16T10:32:23.894998+0000","last_fullsized":"2024-02-16T10:32:23.894998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.894738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:24.572023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.394537+0000","last_change":"2024-02-16T10:32:25.394537+0000","last_active":"2024-02-16T10:32:25.394537+0000","last_peered":"2024-02-16T10:32:25.394537+0000","last_clean":"2024-02-16T10:32:25.394537+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:25.394537+0000","last_undegraded":"2024-02-16T10:32:25.394537+0000","last_fullsized":"2024-02-16T10:32:25.394537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.394250+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:35.971596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.461912+0000","last_change":"2024-02-16T10:32:15.461912+0000","last_active":"2024-02-16T10:32:15.461912+0000","last_peered":"2024-02-16T10:32:15.461912+0000","last_clean":"2024-02-16T10:32:15.461912+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:32:15.461912+0000","last_undegraded":"2024-02-16T10:32:15.461912+0000","last_fullsized":"2024-02-16T10:32:15.461912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.461664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:26.039010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.422778+0000","last_change":"2024-02-16T10:32:30.422778+0000","last_active":"2024-02-16T10:32:30.422778+0000","last_peered":"2024-02-16T10:32:30.422778+0000","last_clean":"2024-02-16T10:32:30.422778+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:32:30.422778+0000","last_undegraded":"2024-02-16T10:32:30.422778+0000","last_fullsized":"2024-02-16T10:32:30.422778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.422534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:07.000435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.143120+0000","last_change":"2024-02-16T10:30:36.152030+0000","last_active":"2024-02-16T10:32:13.143120+0000","last_peered":"2024-02-16T10:32:13.143120+0000","last_clean":"2024-02-16T10:32:13.143120+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:32:13.143120+0000","last_undegraded":"2024-02-16T10:32:13.143120+0000","last_fullsized":"2024-02-16T10:32:13.143120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.236856+0000","last_change":"2024-02-16T10:32:42.236856+0000","last_active":"2024-02-16T10:32:42.236856+0000","last_peered":"2024-02-16T10:32:42.236856+0000","last_clean":"2024-02-16T10:32:42.236856+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:42.236856+0000","last_undegraded":"2024-02-16T10:32:42.236856+0000","last_fullsized":"2024-02-16T10:32:42.236856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.236564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.168661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608345+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:32:13.608345+0000","last_peered":"2024-02-16T10:32:13.608345+0000","last_clean":"2024-02-16T10:32:13.608345+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:32:13.608345+0000","last_undegraded":"2024-02-16T10:32:13.608345+0000","last_fullsized":"2024-02-16T10:32:13.608345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.233102+0000","last_change":"2024-02-16T10:32:23.233102+0000","last_active":"2024-02-16T10:32:23.233102+0000","last_peered":"2024-02-16T10:32:23.233102+0000","last_clean":"2024-02-16T10:32:23.233102+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:32:23.233102+0000","last_undegraded":"2024-02-16T10:32:23.233102+0000","last_fullsized":"2024-02-16T10:32:23.233102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.232854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:06.883209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.871486+0000","last_change":"2024-02-16T10:32:18.871641+0000","last_active":"2024-02-16T10:32:18.871486+0000","last_peered":"2024-02-16T10:32:18.871486+0000","last_clean":"2024-02-16T10:32:18.871486+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:18.871486+0000","last_undegraded":"2024-02-16T10:32:18.871486+0000","last_fullsized":"2024-02-16T10:32:18.871486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.871268+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:47.245756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.003243+0000","last_change":"2024-02-16T10:32:38.003300+0000","last_active":"2024-02-16T10:32:38.003243+0000","last_peered":"2024-02-16T10:32:38.003243+0000","last_clean":"2024-02-16T10:32:38.003243+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:32:38.003243+0000","last_undegraded":"2024-02-16T10:32:38.003243+0000","last_fullsized":"2024-02-16T10:32:38.003243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.003041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:53.724413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234940+0000","last_change":"2024-02-16T10:30:36.132273+0000","last_active":"2024-02-16T10:32:12.234940+0000","last_peered":"2024-02-16T10:32:12.234940+0000","last_clean":"2024-02-16T10:32:12.234940+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:32:12.234940+0000","last_undegraded":"2024-02-16T10:32:12.234940+0000","last_fullsized":"2024-02-16T10:32:12.234940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.211875+0000","last_change":"2024-02-16T10:32:47.211875+0000","last_active":"2024-02-16T10:32:47.211875+0000","last_peered":"2024-02-16T10:32:47.211875+0000","last_clean":"2024-02-16T10:32:47.211875+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:32:47.211875+0000","last_undegraded":"2024-02-16T10:32:47.211875+0000","last_fullsized":"2024-02-16T10:32:47.211875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.211625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:59.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.320864+0000","last_change":"2024-02-16T10:32:39.320864+0000","last_active":"2024-02-16T10:32:39.320864+0000","last_peered":"2024-02-16T10:32:39.320864+0000","last_clean":"2024-02-16T10:32:39.320864+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:32:39.320864+0000","last_undegraded":"2024-02-16T10:32:39.320864+0000","last_fullsized":"2024-02-16T10:32:39.320864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.320594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:32.821736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.839228+0000","last_change":"2024-02-16T10:32:17.839228+0000","last_active":"2024-02-16T10:32:17.839228+0000","last_peered":"2024-02-16T10:32:17.839228+0000","last_clean":"2024-02-16T10:32:17.839228+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:32:17.839228+0000","last_undegraded":"2024-02-16T10:32:17.839228+0000","last_fullsized":"2024-02-16T10:32:17.839228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.838982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:56.153751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.552418+0000","last_change":"2024-02-16T10:32:21.552580+0000","last_active":"2024-02-16T10:32:21.552418+0000","last_peered":"2024-02-16T10:32:21.552418+0000","last_clean":"2024-02-16T10:32:21.552418+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:32:21.552418+0000","last_undegraded":"2024-02-16T10:32:21.552418+0000","last_fullsized":"2024-02-16T10:32:21.552418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.552195+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.202550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.348133+0000","last_change":"2024-02-16T10:32:22.348211+0000","last_active":"2024-02-16T10:32:22.348133+0000","last_peered":"2024-02-16T10:32:22.348133+0000","last_clean":"2024-02-16T10:32:22.348133+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:32:22.348133+0000","last_undegraded":"2024-02-16T10:32:22.348133+0000","last_fullsized":"2024-02-16T10:32:22.348133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.347938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:32.089002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926885+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:31:06.926885+0000","last_peered":"2024-02-16T10:31:06.926885+0000","last_clean":"2024-02-16T10:31:06.926885+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:31:06.926885+0000","last_undegraded":"2024-02-16T10:31:06.926885+0000","last_fullsized":"2024-02-16T10:31:06.926885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.596002+0000","last_change":"2024-02-16T10:32:42.596002+0000","last_active":"2024-02-16T10:32:42.596002+0000","last_peered":"2024-02-16T10:32:42.596002+0000","last_clean":"2024-02-16T10:32:42.596002+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:32:42.596002+0000","last_undegraded":"2024-02-16T10:32:42.596002+0000","last_fullsized":"2024-02-16T10:32:42.596002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.595633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:38.295504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141358+0000","last_change":"2024-02-16T10:30:26.078291+0000","last_active":"2024-02-16T10:32:13.141358+0000","last_peered":"2024-02-16T10:32:13.141358+0000","last_clean":"2024-02-16T10:32:13.141358+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:32:13.141358+0000","last_undegraded":"2024-02-16T10:32:13.141358+0000","last_fullsized":"2024-02-16T10:32:13.141358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.431239+0000","last_change":"2024-02-16T10:32:28.431239+0000","last_active":"2024-02-16T10:32:28.431239+0000","last_peered":"2024-02-16T10:32:28.431239+0000","last_clean":"2024-02-16T10:32:28.431239+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:32:28.431239+0000","last_undegraded":"2024-02-16T10:32:28.431239+0000","last_fullsized":"2024-02-16T10:32:28.431239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.430925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:39.907197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.547085+0000","last_change":"2024-02-16T10:32:23.547169+0000","last_active":"2024-02-16T10:32:23.547085+0000","last_peered":"2024-02-16T10:32:23.547085+0000","last_clean":"2024-02-16T10:32:23.547085+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:23.547085+0000","last_undegraded":"2024-02-16T10:32:23.547085+0000","last_fullsized":"2024-02-16T10:32:23.547085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.546894+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:50.589838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.353126+0000","last_change":"2024-02-16T10:32:13.353181+0000","last_active":"2024-02-16T10:32:13.353126+0000","last_peered":"2024-02-16T10:32:13.353126+0000","last_clean":"2024-02-16T10:32:13.353126+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:32:13.353126+0000","last_undegraded":"2024-02-16T10:32:13.353126+0000","last_fullsized":"2024-02-16T10:32:13.353126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.352927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:59.430673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.922790+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:31:06.922790+0000","last_peered":"2024-02-16T10:31:06.922790+0000","last_clean":"2024-02-16T10:31:06.922790+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:31:06.922790+0000","last_undegraded":"2024-02-16T10:31:06.922790+0000","last_fullsized":"2024-02-16T10:31:06.922790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.978151+0000","last_change":"2024-02-16T10:32:33.978151+0000","last_active":"2024-02-16T10:32:33.978151+0000","last_peered":"2024-02-16T10:32:33.978151+0000","last_clean":"2024-02-16T10:32:33.978151+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:33.978151+0000","last_undegraded":"2024-02-16T10:32:33.978151+0000","last_fullsized":"2024-02-16T10:32:33.978151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.977897+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:01.970621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670084+0000","last_change":"2024-02-16T10:30:26.094186+0000","last_active":"2024-02-16T10:32:12.670084+0000","last_peered":"2024-02-16T10:32:12.670084+0000","last_clean":"2024-02-16T10:32:12.670084+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:32:12.670084+0000","last_undegraded":"2024-02-16T10:32:12.670084+0000","last_fullsized":"2024-02-16T10:32:12.670084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.892358+0000","last_change":"2024-02-16T10:32:22.892358+0000","last_active":"2024-02-16T10:32:22.892358+0000","last_peered":"2024-02-16T10:32:22.892358+0000","last_clean":"2024-02-16T10:32:22.892358+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:32:22.892358+0000","last_undegraded":"2024-02-16T10:32:22.892358+0000","last_fullsized":"2024-02-16T10:32:22.892358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.892090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:42.373803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.352097+0000","last_change":"2024-02-16T10:32:24.352194+0000","last_active":"2024-02-16T10:32:24.352097+0000","last_peered":"2024-02-16T10:32:24.352097+0000","last_clean":"2024-02-16T10:32:24.352097+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:24.352097+0000","last_undegraded":"2024-02-16T10:32:24.352097+0000","last_fullsized":"2024-02-16T10:32:24.352097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.351933+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:53.942303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.181536+0000","last_change":"2024-02-16T10:32:15.181591+0000","last_active":"2024-02-16T10:32:15.181536+0000","last_peered":"2024-02-16T10:32:15.181536+0000","last_clean":"2024-02-16T10:32:15.181536+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:32:15.181536+0000","last_undegraded":"2024-02-16T10:32:15.181536+0000","last_fullsized":"2024-02-16T10:32:15.181536+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.181356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:14.859456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'23","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609204+0000","last_change":"2024-02-16T10:30:28.068211+0000","last_active":"2024-02-16T10:32:13.609204+0000","last_peered":"2024-02-16T10:32:13.609204+0000","last_clean":"2024-02-16T10:32:13.609204+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:32:13.609204+0000","last_undegraded":"2024-02-16T10:32:13.609204+0000","last_fullsized":"2024-02-16T10:32:13.609204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608347+0000","last_change":"2024-02-16T10:30:26.082255+0000","last_active":"2024-02-16T10:32:13.608347+0000","last_peered":"2024-02-16T10:32:13.608347+0000","last_clean":"2024-02-16T10:32:13.608347+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:32:13.608347+0000","last_undegraded":"2024-02-16T10:32:13.608347+0000","last_fullsized":"2024-02-16T10:32:13.608347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.901383+0000","last_change":"2024-02-16T10:31:06.934331+0000","last_active":"2024-02-16T10:31:10.901383+0000","last_peered":"2024-02-16T10:31:10.901383+0000","last_clean":"2024-02-16T10:31:10.901383+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:31:10.901383+0000","last_undegraded":"2024-02-16T10:31:10.901383+0000","last_fullsized":"2024-02-16T10:31:10.901383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.580265+0000","last_change":"2024-02-16T10:32:22.580433+0000","last_active":"2024-02-16T10:32:22.580265+0000","last_peered":"2024-02-16T10:32:22.580265+0000","last_clean":"2024-02-16T10:32:22.580265+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:22.580265+0000","last_undegraded":"2024-02-16T10:32:22.580265+0000","last_fullsized":"2024-02-16T10:32:22.580265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.580047+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:28.539775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.183132+0000","last_change":"2024-02-16T10:32:13.183196+0000","last_active":"2024-02-16T10:32:13.183132+0000","last_peered":"2024-02-16T10:32:13.183132+0000","last_clean":"2024-02-16T10:32:13.183132+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:32:13.183132+0000","last_undegraded":"2024-02-16T10:32:13.183132+0000","last_fullsized":"2024-02-16T10:32:13.183132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.182934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:58:32.694869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:01.014102+0000","last_change":"2024-02-16T10:30:36.138844+0000","last_active":"2024-02-16T10:32:01.014102+0000","last_peered":"2024-02-16T10:32:01.014102+0000","last_clean":"2024-02-16T10:32:01.014102+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:32:01.014102+0000","last_undegraded":"2024-02-16T10:32:01.014102+0000","last_fullsized":"2024-02-16T10:32:01.014102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233637+0000","last_change":"2024-02-16T10:30:28.078572+0000","last_active":"2024-02-16T10:32:12.233637+0000","last_peered":"2024-02-16T10:32:12.233637+0000","last_clean":"2024-02-16T10:32:12.233637+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:32:12.233637+0000","last_undegraded":"2024-02-16T10:32:12.233637+0000","last_fullsized":"2024-02-16T10:32:12.233637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.669917+0000","last_change":"2024-02-16T10:30:26.094072+0000","last_active":"2024-02-16T10:32:12.669917+0000","last_peered":"2024-02-16T10:32:12.669917+0000","last_clean":"2024-02-16T10:32:12.669917+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:32:12.669917+0000","last_undegraded":"2024-02-16T10:32:12.669917+0000","last_fullsized":"2024-02-16T10:32:12.669917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.440004+0000","last_change":"2024-02-16T10:32:32.440004+0000","last_active":"2024-02-16T10:32:32.440004+0000","last_peered":"2024-02-16T10:32:32.440004+0000","last_clean":"2024-02-16T10:32:32.440004+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:32:32.440004+0000","last_undegraded":"2024-02-16T10:32:32.440004+0000","last_fullsized":"2024-02-16T10:32:32.440004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.439721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:38.399449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.980043+0000","last_change":"2024-02-16T10:32:45.980131+0000","last_active":"2024-02-16T10:32:45.980043+0000","last_peered":"2024-02-16T10:32:45.980043+0000","last_clean":"2024-02-16T10:32:45.980043+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:45.980043+0000","last_undegraded":"2024-02-16T10:32:45.980043+0000","last_fullsized":"2024-02-16T10:32:45.980043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.979834+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:01.136119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.184132+0000","last_change":"2024-02-16T10:32:22.184210+0000","last_active":"2024-02-16T10:32:22.184132+0000","last_peered":"2024-02-16T10:32:22.184132+0000","last_clean":"2024-02-16T10:32:22.184132+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:32:22.184132+0000","last_undegraded":"2024-02-16T10:32:22.184132+0000","last_fullsized":"2024-02-16T10:32:22.184132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.183927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:58.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.914877+0000","last_change":"2024-02-16T10:30:36.132836+0000","last_active":"2024-02-16T10:31:06.914877+0000","last_peered":"2024-02-16T10:31:06.914877+0000","last_clean":"2024-02-16T10:31:06.914877+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:31:06.914877+0000","last_undegraded":"2024-02-16T10:31:06.914877+0000","last_fullsized":"2024-02-16T10:31:06.914877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.887511+0000","last_change":"2024-02-16T10:32:27.887571+0000","last_active":"2024-02-16T10:32:27.887511+0000","last_peered":"2024-02-16T10:32:27.887511+0000","last_clean":"2024-02-16T10:32:27.887511+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:32:27.887511+0000","last_undegraded":"2024-02-16T10:32:27.887511+0000","last_fullsized":"2024-02-16T10:32:27.887511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.887325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:24.904620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.912397+0000","last_change":"2024-02-16T10:30:26.091515+0000","last_active":"2024-02-16T10:31:06.912397+0000","last_peered":"2024-02-16T10:31:06.912397+0000","last_clean":"2024-02-16T10:31:06.912397+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:31:06.912397+0000","last_undegraded":"2024-02-16T10:31:06.912397+0000","last_fullsized":"2024-02-16T10:31:06.912397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.435974+0000","last_change":"2024-02-16T10:32:31.436035+0000","last_active":"2024-02-16T10:32:31.435974+0000","last_peered":"2024-02-16T10:32:31.435974+0000","last_clean":"2024-02-16T10:32:31.435974+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:32:31.435974+0000","last_undegraded":"2024-02-16T10:32:31.435974+0000","last_fullsized":"2024-02-16T10:32:31.435974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:15.086149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.510077+0000","last_change":"2024-02-16T10:32:19.510077+0000","last_active":"2024-02-16T10:32:19.510077+0000","last_peered":"2024-02-16T10:32:19.510077+0000","last_clean":"2024-02-16T10:32:19.510077+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:19.510077+0000","last_undegraded":"2024-02-16T10:32:19.510077+0000","last_fullsized":"2024-02-16T10:32:19.510077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.509815+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:06.881445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.449861+0000","last_change":"2024-02-16T10:32:12.449861+0000","last_active":"2024-02-16T10:32:12.449861+0000","last_peered":"2024-02-16T10:32:12.449861+0000","last_clean":"2024-02-16T10:32:12.449861+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:32:12.449861+0000","last_undegraded":"2024-02-16T10:32:12.449861+0000","last_fullsized":"2024-02-16T10:32:12.449861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_clean_scrub_stamp":"2024-02-16T10:32:12.449759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:28.024682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.917347+0000","last_change":"2024-02-16T10:30:36.143634+0000","last_active":"2024-02-16T10:31:06.917347+0000","last_peered":"2024-02-16T10:31:06.917347+0000","last_clean":"2024-02-16T10:31:06.917347+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:31:06.917347+0000","last_undegraded":"2024-02-16T10:31:06.917347+0000","last_fullsized":"2024-02-16T10:31:06.917347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.930283+0000","last_change":"2024-02-16T10:30:28.073370+0000","last_active":"2024-02-16T10:31:06.930283+0000","last_peered":"2024-02-16T10:31:06.930283+0000","last_clean":"2024-02-16T10:31:06.930283+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:31:06.930283+0000","last_undegraded":"2024-02-16T10:31:06.930283+0000","last_fullsized":"2024-02-16T10:31:06.930283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.167225+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:31:11.167225+0000","last_peered":"2024-02-16T10:31:11.167225+0000","last_clean":"2024-02-16T10:31:11.167225+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:31:11.167225+0000","last_undegraded":"2024-02-16T10:31:11.167225+0000","last_fullsized":"2024-02-16T10:31:11.167225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.250790+0000","last_change":"2024-02-16T10:32:28.250844+0000","last_active":"2024-02-16T10:32:28.250790+0000","last_peered":"2024-02-16T10:32:28.250790+0000","last_clean":"2024-02-16T10:32:28.250790+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:32:28.250790+0000","last_undegraded":"2024-02-16T10:32:28.250790+0000","last_fullsized":"2024-02-16T10:32:28.250790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.250601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:40.734413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.941423+0000","last_change":"2024-02-16T10:32:42.941509+0000","last_active":"2024-02-16T10:32:42.941423+0000","last_peered":"2024-02-16T10:32:42.941423+0000","last_clean":"2024-02-16T10:32:42.941423+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:32:42.941423+0000","last_undegraded":"2024-02-16T10:32:42.941423+0000","last_fullsized":"2024-02-16T10:32:42.941423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.941156+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:58:59.562490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.416755+0000","last_change":"2024-02-16T10:32:26.416755+0000","last_active":"2024-02-16T10:32:26.416755+0000","last_peered":"2024-02-16T10:32:26.416755+0000","last_clean":"2024-02-16T10:32:26.416755+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:26.416755+0000","last_undegraded":"2024-02-16T10:32:26.416755+0000","last_fullsized":"2024-02-16T10:32:26.416755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.416475+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:59.606871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.913385+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:31:06.913385+0000","last_peered":"2024-02-16T10:31:06.913385+0000","last_clean":"2024-02-16T10:31:06.913385+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:31:06.913385+0000","last_undegraded":"2024-02-16T10:31:06.913385+0000","last_fullsized":"2024-02-16T10:31:06.913385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.312188+0000","last_change":"2024-02-16T10:32:48.312242+0000","last_active":"2024-02-16T10:32:48.312188+0000","last_peered":"2024-02-16T10:32:48.312188+0000","last_clean":"2024-02-16T10:32:48.312188+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:32:48.312188+0000","last_undegraded":"2024-02-16T10:32:48.312188+0000","last_fullsized":"2024-02-16T10:32:48.312188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.311977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:16.686464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.976176+0000","last_change":"2024-02-16T10:30:26.085358+0000","last_active":"2024-02-16T10:31:11.976176+0000","last_peered":"2024-02-16T10:31:11.976176+0000","last_clean":"2024-02-16T10:31:11.976176+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:31:11.976176+0000","last_undegraded":"2024-02-16T10:31:11.976176+0000","last_fullsized":"2024-02-16T10:31:11.976176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.296087+0000","last_change":"2024-02-16T10:32:25.296238+0000","last_active":"2024-02-16T10:32:25.296087+0000","last_peered":"2024-02-16T10:32:25.296087+0000","last_clean":"2024-02-16T10:32:25.296087+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:32:25.296087+0000","last_undegraded":"2024-02-16T10:32:25.296087+0000","last_fullsized":"2024-02-16T10:32:25.296087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.295850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:52.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.346302+0000","last_change":"2024-02-16T10:32:17.346391+0000","last_active":"2024-02-16T10:32:17.346302+0000","last_peered":"2024-02-16T10:32:17.346302+0000","last_clean":"2024-02-16T10:32:17.346302+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:17.346302+0000","last_undegraded":"2024-02-16T10:32:17.346302+0000","last_fullsized":"2024-02-16T10:32:17.346302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.346100+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:27.923447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.576597+0000","last_change":"2024-02-16T10:32:24.576651+0000","last_active":"2024-02-16T10:32:24.576597+0000","last_peered":"2024-02-16T10:32:24.576597+0000","last_clean":"2024-02-16T10:32:24.576597+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:32:24.576597+0000","last_undegraded":"2024-02-16T10:32:24.576597+0000","last_fullsized":"2024-02-16T10:32:24.576597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.576402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:39.040594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:12.697042+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:31:12.697042+0000","last_peered":"2024-02-16T10:31:12.697042+0000","last_clean":"2024-02-16T10:31:12.697042+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:31:12.697042+0000","last_undegraded":"2024-02-16T10:31:12.697042+0000","last_fullsized":"2024-02-16T10:31:12.697042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.301277+0000","last_change":"2024-02-16T10:32:50.301320+0000","last_active":"2024-02-16T10:32:50.301277+0000","last_peered":"2024-02-16T10:32:50.301277+0000","last_clean":"2024-02-16T10:32:50.301277+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:50.301277+0000","last_undegraded":"2024-02-16T10:32:50.301277+0000","last_fullsized":"2024-02-16T10:32:50.301277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.301175+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:18.159316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.926607+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:31:06.926607+0000","last_peered":"2024-02-16T10:31:06.926607+0000","last_clean":"2024-02-16T10:31:06.926607+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:31:06.926607+0000","last_undegraded":"2024-02-16T10:31:06.926607+0000","last_fullsized":"2024-02-16T10:31:06.926607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.413308+0000","last_change":"2024-02-16T10:32:33.413364+0000","last_active":"2024-02-16T10:32:33.413308+0000","last_peered":"2024-02-16T10:32:33.413308+0000","last_clean":"2024-02-16T10:32:33.413308+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:32:33.413308+0000","last_undegraded":"2024-02-16T10:32:33.413308+0000","last_fullsized":"2024-02-16T10:32:33.413308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.413126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:45:00.456070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.600372+0000","last_change":"2024-02-16T10:32:25.600445+0000","last_active":"2024-02-16T10:32:25.600372+0000","last_peered":"2024-02-16T10:32:25.600372+0000","last_clean":"2024-02-16T10:32:25.600372+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:25.600372+0000","last_undegraded":"2024-02-16T10:32:25.600372+0000","last_fullsized":"2024-02-16T10:32:25.600372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.600171+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:50.787242+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.000300+0000","last_change":"2024-02-16T10:32:36.000355+0000","last_active":"2024-02-16T10:32:36.000300+0000","last_peered":"2024-02-16T10:32:36.000300+0000","last_clean":"2024-02-16T10:32:36.000300+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:32:36.000300+0000","last_undegraded":"2024-02-16T10:32:36.000300+0000","last_fullsized":"2024-02-16T10:32:36.000300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.000094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:36.814271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.931163+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:31:06.931163+0000","last_peered":"2024-02-16T10:31:06.931163+0000","last_clean":"2024-02-16T10:31:06.931163+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:31:06.931163+0000","last_undegraded":"2024-02-16T10:31:06.931163+0000","last_fullsized":"2024-02-16T10:31:06.931163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'1","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852229+0000","last_change":"2024-02-16T10:30:28.068383+0000","last_active":"2024-02-16T10:31:54.852229+0000","last_peered":"2024-02-16T10:31:54.852229+0000","last_clean":"2024-02-16T10:31:54.852229+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:31:54.852229+0000","last_undegraded":"2024-02-16T10:31:54.852229+0000","last_fullsized":"2024-02-16T10:31:54.852229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233371+0000","last_change":"2024-02-16T10:30:26.086582+0000","last_active":"2024-02-16T10:32:12.233371+0000","last_peered":"2024-02-16T10:32:12.233371+0000","last_clean":"2024-02-16T10:32:12.233371+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:32:12.233371+0000","last_undegraded":"2024-02-16T10:32:12.233371+0000","last_fullsized":"2024-02-16T10:32:12.233371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.282488+0000","last_change":"2024-02-16T10:32:24.282549+0000","last_active":"2024-02-16T10:32:24.282488+0000","last_peered":"2024-02-16T10:32:24.282488+0000","last_clean":"2024-02-16T10:32:24.282488+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:32:24.282488+0000","last_undegraded":"2024-02-16T10:32:24.282488+0000","last_fullsized":"2024-02-16T10:32:24.282488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.282291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:30.242018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.877004+0000","last_change":"2024-02-16T10:32:20.877073+0000","last_active":"2024-02-16T10:32:20.877004+0000","last_peered":"2024-02-16T10:32:20.877004+0000","last_clean":"2024-02-16T10:32:20.877004+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:20.877004+0000","last_undegraded":"2024-02-16T10:32:20.877004+0000","last_fullsized":"2024-02-16T10:32:20.877004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.876820+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:18:48.734961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.958981+0000","last_change":"2024-02-16T10:32:34.959040+0000","last_active":"2024-02-16T10:32:34.958981+0000","last_peered":"2024-02-16T10:32:34.958981+0000","last_clean":"2024-02-16T10:32:34.958981+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:32:34.958981+0000","last_undegraded":"2024-02-16T10:32:34.958981+0000","last_fullsized":"2024-02-16T10:32:34.958981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.958764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:01.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:11.670244+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:31:11.670244+0000","last_peered":"2024-02-16T10:31:11.670244+0000","last_clean":"2024-02-16T10:31:11.670244+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:31:11.670244+0000","last_undegraded":"2024-02-16T10:31:11.670244+0000","last_fullsized":"2024-02-16T10:31:11.670244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.240932+0000","last_change":"2024-02-16T10:32:44.240998+0000","last_active":"2024-02-16T10:32:44.240932+0000","last_peered":"2024-02-16T10:32:44.240932+0000","last_clean":"2024-02-16T10:32:44.240932+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:44.240932+0000","last_undegraded":"2024-02-16T10:32:44.240932+0000","last_fullsized":"2024-02-16T10:32:44.240932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.240707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:10.432991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670190+0000","last_change":"2024-02-16T10:30:26.097044+0000","last_active":"2024-02-16T10:32:12.670190+0000","last_peered":"2024-02-16T10:32:12.670190+0000","last_clean":"2024-02-16T10:32:12.670190+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:32:12.670190+0000","last_undegraded":"2024-02-16T10:32:12.670190+0000","last_fullsized":"2024-02-16T10:32:12.670190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":213,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.164270+0000","last_change":"2024-02-16T10:32:32.164334+0000","last_active":"2024-02-16T10:32:32.164270+0000","last_peered":"2024-02-16T10:32:32.164270+0000","last_clean":"2024-02-16T10:32:32.164270+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:32.164270+0000","last_undegraded":"2024-02-16T10:32:32.164270+0000","last_fullsized":"2024-02-16T10:32:32.164270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.164046+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:25.665188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.857213+0000","last_change":"2024-02-16T10:32:24.857295+0000","last_active":"2024-02-16T10:32:24.857213+0000","last_peered":"2024-02-16T10:32:24.857213+0000","last_clean":"2024-02-16T10:32:24.857213+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:24.857213+0000","last_undegraded":"2024-02-16T10:32:24.857213+0000","last_fullsized":"2024-02-16T10:32:24.857213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.857001+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:32.050416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.493910+0000","last_change":"2024-02-16T10:32:18.493966+0000","last_active":"2024-02-16T10:32:18.493910+0000","last_peered":"2024-02-16T10:32:18.493910+0000","last_clean":"2024-02-16T10:32:18.493910+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:32:18.493910+0000","last_undegraded":"2024-02-16T10:32:18.493910+0000","last_fullsized":"2024-02-16T10:32:18.493910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.493720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:29.969992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:06.923584+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:31:06.923584+0000","last_peered":"2024-02-16T10:31:06.923584+0000","last_clean":"2024-02-16T10:31:06.923584+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:31:06.923584+0000","last_undegraded":"2024-02-16T10:31:06.923584+0000","last_fullsized":"2024-02-16T10:31:06.923584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.185600+0000","last_change":"2024-02-16T10:32:33.185600+0000","last_active":"2024-02-16T10:32:33.185600+0000","last_peered":"2024-02-16T10:32:33.185600+0000","last_clean":"2024-02-16T10:32:33.185600+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:32:33.185600+0000","last_undegraded":"2024-02-16T10:32:33.185600+0000","last_fullsized":"2024-02-16T10:32:33.185600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.185313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:38.162727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141330+0000","last_change":"2024-02-16T10:30:26.082804+0000","last_active":"2024-02-16T10:32:13.141330+0000","last_peered":"2024-02-16T10:32:13.141330+0000","last_clean":"2024-02-16T10:32:13.141330+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:32:13.141330+0000","last_undegraded":"2024-02-16T10:32:13.141330+0000","last_fullsized":"2024-02-16T10:32:13.141330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.540064+0000","last_change":"2024-02-16T10:32:48.540133+0000","last_active":"2024-02-16T10:32:48.540064+0000","last_peered":"2024-02-16T10:32:48.540064+0000","last_clean":"2024-02-16T10:32:48.540064+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:32:48.540064+0000","last_undegraded":"2024-02-16T10:32:48.540064+0000","last_fullsized":"2024-02-16T10:32:48.540064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.539875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:16.085207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233460+0000","last_change":"2024-02-16T10:30:26.086799+0000","last_active":"2024-02-16T10:32:12.233460+0000","last_peered":"2024-02-16T10:32:12.233460+0000","last_clean":"2024-02-16T10:32:12.233460+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:32:12.233460+0000","last_undegraded":"2024-02-16T10:32:12.233460+0000","last_fullsized":"2024-02-16T10:32:12.233460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609611+0000","last_change":"2024-02-16T10:30:28.067014+0000","last_active":"2024-02-16T10:32:13.609611+0000","last_peered":"2024-02-16T10:32:13.609611+0000","last_clean":"2024-02-16T10:32:13.609611+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:32:13.609611+0000","last_undegraded":"2024-02-16T10:32:13.609611+0000","last_fullsized":"2024-02-16T10:32:13.609611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608468+0000","last_change":"2024-02-16T10:30:26.082639+0000","last_active":"2024-02-16T10:32:13.608468+0000","last_peered":"2024-02-16T10:32:13.608468+0000","last_clean":"2024-02-16T10:32:13.608468+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:32:13.608468+0000","last_undegraded":"2024-02-16T10:32:13.608468+0000","last_fullsized":"2024-02-16T10:32:13.608468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233905+0000","last_change":"2024-02-16T10:30:28.073787+0000","last_active":"2024-02-16T10:32:12.233905+0000","last_peered":"2024-02-16T10:32:12.233905+0000","last_clean":"2024-02-16T10:32:12.233905+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:32:12.233905+0000","last_undegraded":"2024-02-16T10:32:12.233905+0000","last_fullsized":"2024-02-16T10:32:12.233905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233313+0000","last_change":"2024-02-16T10:30:26.088981+0000","last_active":"2024-02-16T10:32:12.233313+0000","last_peered":"2024-02-16T10:32:12.233313+0000","last_clean":"2024-02-16T10:32:12.233313+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:32:12.233313+0000","last_undegraded":"2024-02-16T10:32:12.233313+0000","last_fullsized":"2024-02-16T10:32:12.233313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.579220+0000","last_change":"2024-02-16T10:32:50.579281+0000","last_active":"2024-02-16T10:32:50.579220+0000","last_peered":"2024-02-16T10:32:50.579220+0000","last_clean":"2024-02-16T10:32:50.579220+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:50.579220+0000","last_undegraded":"2024-02-16T10:32:50.579220+0000","last_fullsized":"2024-02-16T10:32:50.579220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.579036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:33:04.624348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233448+0000","last_change":"2024-02-16T10:30:26.097730+0000","last_active":"2024-02-16T10:32:12.233448+0000","last_peered":"2024-02-16T10:32:12.233448+0000","last_clean":"2024-02-16T10:32:12.233448+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:32:12.233448+0000","last_undegraded":"2024-02-16T10:32:12.233448+0000","last_fullsized":"2024-02-16T10:32:12.233448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.190748+0000","last_change":"2024-02-16T10:32:36.190802+0000","last_active":"2024-02-16T10:32:36.190748+0000","last_peered":"2024-02-16T10:32:36.190748+0000","last_clean":"2024-02-16T10:32:36.190748+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:32:36.190748+0000","last_undegraded":"2024-02-16T10:32:36.190748+0000","last_fullsized":"2024-02-16T10:32:36.190748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.190560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:11.479999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670104+0000","last_change":"2024-02-16T10:30:26.090914+0000","last_active":"2024-02-16T10:32:12.670104+0000","last_peered":"2024-02-16T10:32:12.670104+0000","last_clean":"2024-02-16T10:32:12.670104+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:32:12.670104+0000","last_undegraded":"2024-02-16T10:32:12.670104+0000","last_fullsized":"2024-02-16T10:32:12.670104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.677808+0000","last_change":"2024-02-16T10:32:37.677881+0000","last_active":"2024-02-16T10:32:37.677808+0000","last_peered":"2024-02-16T10:32:37.677808+0000","last_clean":"2024-02-16T10:32:37.677808+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:32:37.677808+0000","last_undegraded":"2024-02-16T10:32:37.677808+0000","last_fullsized":"2024-02-16T10:32:37.677808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.677622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:43.521167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.141442+0000","last_change":"2024-02-16T10:30:26.083584+0000","last_active":"2024-02-16T10:32:13.141442+0000","last_peered":"2024-02-16T10:32:13.141442+0000","last_clean":"2024-02-16T10:32:13.141442+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:32:13.141442+0000","last_undegraded":"2024-02-16T10:32:13.141442+0000","last_fullsized":"2024-02-16T10:32:13.141442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670555+0000","last_change":"2024-02-16T10:30:28.073126+0000","last_active":"2024-02-16T10:32:12.670555+0000","last_peered":"2024-02-16T10:32:12.670555+0000","last_clean":"2024-02-16T10:32:12.670555+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:32:12.670555+0000","last_undegraded":"2024-02-16T10:32:12.670555+0000","last_fullsized":"2024-02-16T10:32:12.670555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.233466+0000","last_change":"2024-02-16T10:30:26.087852+0000","last_active":"2024-02-16T10:32:12.233466+0000","last_peered":"2024-02-16T10:32:12.233466+0000","last_clean":"2024-02-16T10:32:12.233466+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:32:12.233466+0000","last_undegraded":"2024-02-16T10:32:12.233466+0000","last_fullsized":"2024-02-16T10:32:12.233466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.246185+0000","last_change":"2024-02-16T10:32:41.246185+0000","last_active":"2024-02-16T10:32:41.246185+0000","last_peered":"2024-02-16T10:32:41.246185+0000","last_clean":"2024-02-16T10:32:41.246185+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:32:41.246185+0000","last_undegraded":"2024-02-16T10:32:41.246185+0000","last_fullsized":"2024-02-16T10:32:41.246185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.245938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:09.620425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608529+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:32:13.608529+0000","last_peered":"2024-02-16T10:32:13.608529+0000","last_clean":"2024-02-16T10:32:13.608529+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:32:13.608529+0000","last_undegraded":"2024-02-16T10:32:13.608529+0000","last_fullsized":"2024-02-16T10:32:13.608529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.952981+0000","last_change":"2024-02-16T10:32:47.952981+0000","last_active":"2024-02-16T10:32:47.952981+0000","last_peered":"2024-02-16T10:32:47.952981+0000","last_clean":"2024-02-16T10:32:47.952981+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:47.952981+0000","last_undegraded":"2024-02-16T10:32:47.952981+0000","last_fullsized":"2024-02-16T10:32:47.952981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.952562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:39.742244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.575826+0000","last_change":"2024-02-16T10:32:45.575891+0000","last_active":"2024-02-16T10:32:45.575826+0000","last_peered":"2024-02-16T10:32:45.575826+0000","last_clean":"2024-02-16T10:32:45.575826+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:32:45.575826+0000","last_undegraded":"2024-02-16T10:32:45.575826+0000","last_fullsized":"2024-02-16T10:32:45.575826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.575628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:23:09.375444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.598992+0000","last_change":"2024-02-16T10:32:44.598992+0000","last_active":"2024-02-16T10:32:44.598992+0000","last_peered":"2024-02-16T10:32:44.598992+0000","last_clean":"2024-02-16T10:32:44.598992+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:32:44.598992+0000","last_undegraded":"2024-02-16T10:32:44.598992+0000","last_fullsized":"2024-02-16T10:32:44.598992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.598712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:57.295017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670163+0000","last_change":"2024-02-16T10:30:26.093740+0000","last_active":"2024-02-16T10:32:12.670163+0000","last_peered":"2024-02-16T10:32:12.670163+0000","last_clean":"2024-02-16T10:32:12.670163+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:32:12.670163+0000","last_undegraded":"2024-02-16T10:32:12.670163+0000","last_fullsized":"2024-02-16T10:32:12.670163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670834+0000","last_change":"2024-02-16T10:30:28.075601+0000","last_active":"2024-02-16T10:32:12.670834+0000","last_peered":"2024-02-16T10:32:12.670834+0000","last_clean":"2024-02-16T10:32:12.670834+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:32:12.670834+0000","last_undegraded":"2024-02-16T10:32:12.670834+0000","last_fullsized":"2024-02-16T10:32:12.670834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670163+0000","last_change":"2024-02-16T10:30:26.086804+0000","last_active":"2024-02-16T10:32:12.670163+0000","last_peered":"2024-02-16T10:32:12.670163+0000","last_clean":"2024-02-16T10:32:12.670163+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:32:12.670163+0000","last_undegraded":"2024-02-16T10:32:12.670163+0000","last_fullsized":"2024-02-16T10:32:12.670163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.293261+0000","last_change":"2024-02-16T10:32:45.293261+0000","last_active":"2024-02-16T10:32:45.293261+0000","last_peered":"2024-02-16T10:32:45.293261+0000","last_clean":"2024-02-16T10:32:45.293261+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:32:45.293261+0000","last_undegraded":"2024-02-16T10:32:45.293261+0000","last_fullsized":"2024-02-16T10:32:45.293261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.293004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:04.774717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608443+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:32:13.608443+0000","last_peered":"2024-02-16T10:32:13.608443+0000","last_clean":"2024-02-16T10:32:13.608443+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:32:13.608443+0000","last_undegraded":"2024-02-16T10:32:13.608443+0000","last_fullsized":"2024-02-16T10:32:13.608443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670785+0000","last_change":"2024-02-16T10:30:28.077390+0000","last_active":"2024-02-16T10:32:12.670785+0000","last_peered":"2024-02-16T10:32:12.670785+0000","last_clean":"2024-02-16T10:32:12.670785+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:32:12.670785+0000","last_undegraded":"2024-02-16T10:32:12.670785+0000","last_fullsized":"2024-02-16T10:32:12.670785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608714+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:32:13.608714+0000","last_peered":"2024-02-16T10:32:13.608714+0000","last_clean":"2024-02-16T10:32:13.608714+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:32:13.608714+0000","last_undegraded":"2024-02-16T10:32:13.608714+0000","last_fullsized":"2024-02-16T10:32:13.608714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.834500+0000","last_change":"2024-02-16T10:32:25.834500+0000","last_active":"2024-02-16T10:32:25.834500+0000","last_peered":"2024-02-16T10:32:25.834500+0000","last_clean":"2024-02-16T10:32:25.834500+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:25.834500+0000","last_undegraded":"2024-02-16T10:32:25.834500+0000","last_fullsized":"2024-02-16T10:32:25.834500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.834247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:24.022521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.284240+0000","last_change":"2024-02-16T10:32:49.284313+0000","last_active":"2024-02-16T10:32:49.284240+0000","last_peered":"2024-02-16T10:32:49.284240+0000","last_clean":"2024-02-16T10:32:49.284240+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:32:49.284240+0000","last_undegraded":"2024-02-16T10:32:49.284240+0000","last_fullsized":"2024-02-16T10:32:49.284240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.284010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:24.829083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.208137+0000","last_change":"2024-02-16T10:32:50.208221+0000","last_active":"2024-02-16T10:32:50.208137+0000","last_peered":"2024-02-16T10:32:50.208137+0000","last_clean":"2024-02-16T10:32:50.208137+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:32:50.208137+0000","last_undegraded":"2024-02-16T10:32:50.208137+0000","last_fullsized":"2024-02-16T10:32:50.208137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.207953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:47.225247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608743+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:32:13.608743+0000","last_peered":"2024-02-16T10:32:13.608743+0000","last_clean":"2024-02-16T10:32:13.608743+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:32:13.608743+0000","last_undegraded":"2024-02-16T10:32:13.608743+0000","last_fullsized":"2024-02-16T10:32:13.608743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608815+0000","last_change":"2024-02-16T10:30:26.084624+0000","last_active":"2024-02-16T10:32:13.608815+0000","last_peered":"2024-02-16T10:32:13.608815+0000","last_clean":"2024-02-16T10:32:13.608815+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:32:13.608815+0000","last_undegraded":"2024-02-16T10:32:13.608815+0000","last_fullsized":"2024-02-16T10:32:13.608815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.631718+0000","last_change":"2024-02-16T10:32:39.631778+0000","last_active":"2024-02-16T10:32:39.631718+0000","last_peered":"2024-02-16T10:32:39.631718+0000","last_clean":"2024-02-16T10:32:39.631718+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:32:39.631718+0000","last_undegraded":"2024-02-16T10:32:39.631718+0000","last_fullsized":"2024-02-16T10:32:39.631718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.631520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:18:00.127318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.564996+0000","last_change":"2024-02-16T10:32:43.564996+0000","last_active":"2024-02-16T10:32:43.564996+0000","last_peered":"2024-02-16T10:32:43.564996+0000","last_clean":"2024-02-16T10:32:43.564996+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:32:43.564996+0000","last_undegraded":"2024-02-16T10:32:43.564996+0000","last_fullsized":"2024-02-16T10:32:43.564996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.564745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:47.346981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:54.852162+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:31:54.852162+0000","last_peered":"2024-02-16T10:31:54.852162+0000","last_clean":"2024-02-16T10:31:54.852162+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:31:54.852162+0000","last_undegraded":"2024-02-16T10:31:54.852162+0000","last_fullsized":"2024-02-16T10:31:54.852162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705699,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.745},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":1.268,"15min":1.268},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.77800000000000002,"5min":1.139,"15min":1.139},"last":0.503},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.79200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66600000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705701,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.92900000000000005,"15min":0.97499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77000000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.4239999999999999,"15min":1.5660000000000001},"min":{"1min":0.29999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.78900000000000003,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.71299999999999997,"5min":0.873,"15min":0.873},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.751,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.2470000000000001,"15min":1.343},"min":{"1min":0.35199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.83899999999999997,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.623}]}]},{"osd":1,"up_from":9,"seq":38654705701,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78000000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.81699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.72999999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.58299999999999996,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88900000000000001,"5min":1.115,"15min":1.115},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.865 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.866 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.866 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.866 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.866 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.866 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.867 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.868 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.871 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.872 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.872 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.872 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.872 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.873 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.873 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.873 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.873 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.873 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.874 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.875 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.875 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.875 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.875 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-16T10:30:11.961442+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.875 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.876 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.876 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.876 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.876 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.876 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.877 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.878 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.878 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.878 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.878 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.878 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.879 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.880 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.880 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.880 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.880 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.881 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.882 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.883 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.883 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.883 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.883 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.884 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.884 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.884 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.884 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.884 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.885 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.886 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.887 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.888 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.888 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.888 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:32:54.888 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:33:14.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:33:15.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.010+0000 7f68fd89d640 1 Processor -- start 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.010+0000 7f68fd89d640 1 -- start start 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.010+0000 7f68fd89d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68f806f8b0 0x7f68f8133140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.010+0000 7f68fd89d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f809bf20 con 0x7f68f812e080 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.010+0000 7f68fd89d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80716b0 con 0x7f68f806f8b0 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f67fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68f806f8b0 0x7f68f8133140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:15.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f6ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f68f812e080 0x7f68f812e460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45194/0 (socket says 172.21.15.107:45194) 2024-02-16T10:33:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f6ffd640 1 -- 172.21.15.107:0/886812688 learned_addr learned my addr 172.21.15.107:0/886812688 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:33:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f67fc640 1 --2- 172.21.15.107:0/886812688 >> v2:172.21.15.107:3300/0 conn(0x7f68f806f8b0 0x7f68f8133140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49608/0 (socket says 172.21.15.107:49608) 2024-02-16T10:33:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f67fc640 1 -- 172.21.15.107:0/886812688 >> v1:172.21.15.107:6789/0 conn(0x7f68f812e080 legacy=0x7f68f812e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f67fc640 1 -- 172.21.15.107:0/886812688 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f812eb70 con 0x7f68f806f8b0 2024-02-16T10:33:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f67fc640 1 --2- 172.21.15.107:0/886812688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f8133140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009740 tx=0x7f68e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a227c1da37b34a89 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f5ffb640 1 -- 172.21.15.107:0/886812688 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68e00ab530 con 0x7f68f806f8b0 2024-02-16T10:33:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f5ffb640 1 -- 172.21.15.107:0/886812688 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00a7050 con 0x7f68f806f8b0 2024-02-16T10:33:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68f5ffb640 1 -- 172.21.15.107:0/886812688 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68e00ab7e0 con 0x7f68f806f8b0 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 -- 172.21.15.107:0/886812688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 msgr2=0x7f68f8133140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 --2- 172.21.15.107:0/886812688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f8133140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009740 tx=0x7f68e001c400 comp rx=0 tx=0).stop 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 -- 172.21.15.107:0/886812688 shutdown_connections 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 --2- 172.21.15.107:0/886812688 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f8133140 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 -- 172.21.15.107:0/886812688 >> 172.21.15.107:0/886812688 conn(0x7f68f809a1c0 msgr2=0x7f68f809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 -- 172.21.15.107:0/886812688 shutdown_connections 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.014+0000 7f68fd89d640 1 -- 172.21.15.107:0/886812688 wait complete. 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 Processor -- start 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 -- start start 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f811fc00 con 0x7f68f806f8b0 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49622/0 (socket says 172.21.15.107:49622) 2024-02-16T10:33:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f6ffd640 1 -- 172.21.15.107:0/1237095563 learned_addr learned my addr 172.21.15.107:0/1237095563 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:33:15.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f6ffd640 1 -- 172.21.15.107:0/1237095563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009420 con 0x7f68f806f8b0 2024-02-16T10:33:15.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f6ffd640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f68f000cb20 tx=0x7f68f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68f000abf0 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000ad50 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f811f770 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f68f0012400 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f811f490 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f68f0012560 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f811e360 con 0x7f68f806f8b0 2024-02-16T10:33:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 0x7f68d8037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f68f0048850 con 0x7f68f806f8b0 2024-02-16T10:33:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.018+0000 7f68f67fc640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 0x7f68d8037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.022+0000 7f68f67fc640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 0x7f68d8037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f68f809c1b0 tx=0x7f68e00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.022+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f68f0007070 con 0x7f68f806f8b0 2024-02-16T10:33:15.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.178+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68f8062980 con 0x7f68d8035a10 2024-02-16T10:33:15.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.226+0000 7f68effff640 1 -- 172.21.15.107:0/1237095563 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672824 (secure 0 0 0) 0x7f68f8062980 con 0x7f68d8035a10 2024-02-16T10:33:15.237 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:33:15.243 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:33:15.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 msgr2=0x7f68d8037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:15.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 0x7f68d8037ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f68f809c1b0 tx=0x7f68e00a6000 comp rx=0 tx=0).stop 2024-02-16T10:33:15.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 msgr2=0x7f68f811c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f68f000cb20 tx=0x7f68f000a060 comp rx=0 tx=0).stop 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 shutdown_connections 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f68d8035a10 0x7f68d8037ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 --2- 172.21.15.107:0/1237095563 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68f806f8b0 0x7f68f811c870 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 >> 172.21.15.107:0/1237095563 conn(0x7f68f809a1c0 msgr2=0x7f68f806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 shutdown_connections 2024-02-16T10:33:15.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:15.230+0000 7f68fd89d640 1 -- 172.21.15.107:0/1237095563 wait complete. 2024-02-16T10:33:15.257 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-02-16T10:33:13.895360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1885,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3964,"ondisk_log_size":3964,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006782"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.286924+0000","last_change":"2024-02-16T10:32:51.287001+0000","last_active":"2024-02-16T10:32:51.286924+0000","last_peered":"2024-02-16T10:32:51.286924+0000","last_clean":"2024-02-16T10:32:51.286924+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:32:51.286924+0000","last_undegraded":"2024-02-16T10:32:51.286924+0000","last_fullsized":"2024-02-16T10:32:51.286924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.286736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:29.643046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.252936+0000","last_change":"2024-02-16T10:32:46.252936+0000","last_active":"2024-02-16T10:32:46.252936+0000","last_peered":"2024-02-16T10:32:46.252936+0000","last_clean":"2024-02-16T10:32:46.252936+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:32:46.252936+0000","last_undegraded":"2024-02-16T10:32:46.252936+0000","last_fullsized":"2024-02-16T10:32:46.252936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.252657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:46.929942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.621221+0000","last_change":"2024-02-16T10:33:03.621303+0000","last_active":"2024-02-16T10:33:03.621221+0000","last_peered":"2024-02-16T10:33:03.621221+0000","last_clean":"2024-02-16T10:33:03.621221+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:33:03.621221+0000","last_undegraded":"2024-02-16T10:33:03.621221+0000","last_fullsized":"2024-02-16T10:33:03.621221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.621029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:54.673180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.055307+0000","last_change":"2024-02-16T10:33:02.055365+0000","last_active":"2024-02-16T10:33:02.055307+0000","last_peered":"2024-02-16T10:33:02.055307+0000","last_clean":"2024-02-16T10:33:02.055307+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:33:02.055307+0000","last_undegraded":"2024-02-16T10:33:02.055307+0000","last_fullsized":"2024-02-16T10:33:02.055307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.055114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:47:50.528621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608910+0000","last_change":"2024-02-16T10:30:26.069296+0000","last_active":"2024-02-16T10:32:13.608910+0000","last_peered":"2024-02-16T10:32:13.608910+0000","last_clean":"2024-02-16T10:32:13.608910+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:32:13.608910+0000","last_undegraded":"2024-02-16T10:32:13.608910+0000","last_fullsized":"2024-02-16T10:32:13.608910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.003805+0000","last_change":"2024-02-16T10:32:59.003805+0000","last_active":"2024-02-16T10:32:59.003805+0000","last_peered":"2024-02-16T10:32:59.003805+0000","last_clean":"2024-02-16T10:32:59.003805+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:32:59.003805+0000","last_undegraded":"2024-02-16T10:32:59.003805+0000","last_fullsized":"2024-02-16T10:32:59.003805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.003421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:59.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.297606+0000","last_change":"2024-02-16T10:32:53.297683+0000","last_active":"2024-02-16T10:32:53.297606+0000","last_peered":"2024-02-16T10:32:53.297606+0000","last_clean":"2024-02-16T10:32:53.297606+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:32:53.297606+0000","last_undegraded":"2024-02-16T10:32:53.297606+0000","last_fullsized":"2024-02-16T10:32:53.297606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.297394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:53.974678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.986589+0000","last_change":"2024-02-16T10:32:57.986589+0000","last_active":"2024-02-16T10:32:57.986589+0000","last_peered":"2024-02-16T10:32:57.986589+0000","last_clean":"2024-02-16T10:32:57.986589+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:32:57.986589+0000","last_undegraded":"2024-02-16T10:32:57.986589+0000","last_fullsized":"2024-02-16T10:32:57.986589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.986335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:45.120448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608924+0000","last_change":"2024-02-16T10:30:26.068265+0000","last_active":"2024-02-16T10:32:13.608924+0000","last_peered":"2024-02-16T10:32:13.608924+0000","last_clean":"2024-02-16T10:32:13.608924+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:32:13.608924+0000","last_undegraded":"2024-02-16T10:32:13.608924+0000","last_fullsized":"2024-02-16T10:32:13.608924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.266000+0000","last_change":"2024-02-16T10:32:43.266072+0000","last_active":"2024-02-16T10:32:43.266000+0000","last_peered":"2024-02-16T10:32:43.266000+0000","last_clean":"2024-02-16T10:32:43.266000+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:43.266000+0000","last_undegraded":"2024-02-16T10:32:43.266000+0000","last_fullsized":"2024-02-16T10:32:43.266000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.265822+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:11.123964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.300998+0000","last_change":"2024-02-16T10:32:54.300998+0000","last_active":"2024-02-16T10:32:54.300998+0000","last_peered":"2024-02-16T10:32:54.300998+0000","last_clean":"2024-02-16T10:32:54.300998+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:32:54.300998+0000","last_undegraded":"2024-02-16T10:32:54.300998+0000","last_fullsized":"2024-02-16T10:32:54.300998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.300740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:06.997045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.953068+0000","last_change":"2024-02-16T10:32:31.953068+0000","last_active":"2024-02-16T10:32:31.953068+0000","last_peered":"2024-02-16T10:32:31.953068+0000","last_clean":"2024-02-16T10:32:31.953068+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:32:31.953068+0000","last_undegraded":"2024-02-16T10:32:31.953068+0000","last_fullsized":"2024-02-16T10:32:31.953068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.952772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:14.372551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.091844+0000","last_change":"2024-02-16T10:33:03.091915+0000","last_active":"2024-02-16T10:33:03.091844+0000","last_peered":"2024-02-16T10:33:03.091844+0000","last_clean":"2024-02-16T10:33:03.091844+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:33:03.091844+0000","last_undegraded":"2024-02-16T10:33:03.091844+0000","last_fullsized":"2024-02-16T10:33:03.091844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.091594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:02.360828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.337640+0000","last_change":"2024-02-16T10:32:35.337640+0000","last_active":"2024-02-16T10:32:35.337640+0000","last_peered":"2024-02-16T10:32:35.337640+0000","last_clean":"2024-02-16T10:32:35.337640+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:32:35.337640+0000","last_undegraded":"2024-02-16T10:32:35.337640+0000","last_fullsized":"2024-02-16T10:32:35.337640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.337391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:00.524461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.625149+0000","last_change":"2024-02-16T10:33:04.625313+0000","last_active":"2024-02-16T10:33:04.625149+0000","last_peered":"2024-02-16T10:33:04.625149+0000","last_clean":"2024-02-16T10:33:04.625149+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:33:04.625149+0000","last_undegraded":"2024-02-16T10:33:04.625149+0000","last_fullsized":"2024-02-16T10:33:04.625149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.624916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:59.652953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.340659+0000","last_change":"2024-02-16T10:32:38.340723+0000","last_active":"2024-02-16T10:32:38.340659+0000","last_peered":"2024-02-16T10:32:38.340659+0000","last_clean":"2024-02-16T10:32:38.340659+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:32:38.340659+0000","last_undegraded":"2024-02-16T10:32:38.340659+0000","last_fullsized":"2024-02-16T10:32:38.340659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.340456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:20.043427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.032266+0000","last_change":"2024-02-16T10:33:00.032324+0000","last_active":"2024-02-16T10:33:00.032266+0000","last_peered":"2024-02-16T10:33:00.032266+0000","last_clean":"2024-02-16T10:33:00.032266+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:33:00.032266+0000","last_undegraded":"2024-02-16T10:33:00.032266+0000","last_fullsized":"2024-02-16T10:33:00.032266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.031986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:09.549907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.250297+0000","last_change":"2024-02-16T10:32:49.250297+0000","last_active":"2024-02-16T10:32:49.250297+0000","last_peered":"2024-02-16T10:32:49.250297+0000","last_clean":"2024-02-16T10:32:49.250297+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:32:49.250297+0000","last_undegraded":"2024-02-16T10:32:49.250297+0000","last_fullsized":"2024-02-16T10:32:49.250297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:50.603059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.176433+0000","last_change":"2024-02-16T10:32:37.176433+0000","last_active":"2024-02-16T10:32:37.176433+0000","last_peered":"2024-02-16T10:32:37.176433+0000","last_clean":"2024-02-16T10:32:37.176433+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:32:37.176433+0000","last_undegraded":"2024-02-16T10:32:37.176433+0000","last_fullsized":"2024-02-16T10:32:37.176433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.176164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:03.368447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.273865+0000","last_change":"2024-02-16T10:32:43.273865+0000","last_active":"2024-02-16T10:32:43.273865+0000","last_peered":"2024-02-16T10:32:43.273865+0000","last_clean":"2024-02-16T10:32:43.273865+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:43.273865+0000","last_undegraded":"2024-02-16T10:32:43.273865+0000","last_fullsized":"2024-02-16T10:32:43.273865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.273587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:18.563027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.240319+0000","last_change":"2024-02-16T10:32:40.240319+0000","last_active":"2024-02-16T10:32:40.240319+0000","last_peered":"2024-02-16T10:32:40.240319+0000","last_clean":"2024-02-16T10:32:40.240319+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:32:40.240319+0000","last_undegraded":"2024-02-16T10:32:40.240319+0000","last_fullsized":"2024-02-16T10:32:40.240319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.239977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:18.554745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.263487+0000","last_change":"2024-02-16T10:33:07.263547+0000","last_active":"2024-02-16T10:33:07.263487+0000","last_peered":"2024-02-16T10:33:07.263487+0000","last_clean":"2024-02-16T10:33:07.263487+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:33:07.263487+0000","last_undegraded":"2024-02-16T10:33:07.263487+0000","last_fullsized":"2024-02-16T10:33:07.263487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.263284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:58.315436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.593305+0000","last_change":"2024-02-16T10:32:46.593305+0000","last_active":"2024-02-16T10:32:46.593305+0000","last_peered":"2024-02-16T10:32:46.593305+0000","last_clean":"2024-02-16T10:32:46.593305+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:32:46.593305+0000","last_undegraded":"2024-02-16T10:32:46.593305+0000","last_fullsized":"2024-02-16T10:32:46.593305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.593037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:59:45.718528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.193382+0000","last_change":"2024-02-16T10:32:51.193449+0000","last_active":"2024-02-16T10:32:51.193382+0000","last_peered":"2024-02-16T10:32:51.193382+0000","last_clean":"2024-02-16T10:32:51.193382+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:32:51.193382+0000","last_undegraded":"2024-02-16T10:32:51.193382+0000","last_fullsized":"2024-02-16T10:32:51.193382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.193190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:27.003267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.354961+0000","last_change":"2024-02-16T10:33:00.355034+0000","last_active":"2024-02-16T10:33:00.354961+0000","last_peered":"2024-02-16T10:33:00.354961+0000","last_clean":"2024-02-16T10:33:00.354961+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:33:00.354961+0000","last_undegraded":"2024-02-16T10:33:00.354961+0000","last_fullsized":"2024-02-16T10:33:00.354961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.354775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:31.134954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.595681+0000","last_change":"2024-02-16T10:32:53.595817+0000","last_active":"2024-02-16T10:32:53.595681+0000","last_peered":"2024-02-16T10:32:53.595681+0000","last_clean":"2024-02-16T10:32:53.595681+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:32:53.595681+0000","last_undegraded":"2024-02-16T10:32:53.595681+0000","last_fullsized":"2024-02-16T10:32:53.595681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.595459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:21.588183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.224650+0000","last_change":"2024-02-16T10:32:39.224650+0000","last_active":"2024-02-16T10:32:39.224650+0000","last_peered":"2024-02-16T10:32:39.224650+0000","last_clean":"2024-02-16T10:32:39.224650+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:32:39.224650+0000","last_undegraded":"2024-02-16T10:32:39.224650+0000","last_fullsized":"2024-02-16T10:32:39.224650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.224377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:54.677431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608818+0000","last_change":"2024-02-16T10:30:26.068095+0000","last_active":"2024-02-16T10:32:13.608818+0000","last_peered":"2024-02-16T10:32:13.608818+0000","last_clean":"2024-02-16T10:32:13.608818+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:32:13.608818+0000","last_undegraded":"2024-02-16T10:32:13.608818+0000","last_fullsized":"2024-02-16T10:32:13.608818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.249451+0000","last_change":"2024-02-16T10:32:42.249451+0000","last_active":"2024-02-16T10:32:42.249451+0000","last_peered":"2024-02-16T10:32:42.249451+0000","last_clean":"2024-02-16T10:32:42.249451+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:42.249451+0000","last_undegraded":"2024-02-16T10:32:42.249451+0000","last_fullsized":"2024-02-16T10:32:42.249451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.249133+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:17.794206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.013994+0000","last_change":"2024-02-16T10:32:55.014055+0000","last_active":"2024-02-16T10:32:55.013994+0000","last_peered":"2024-02-16T10:32:55.013994+0000","last_clean":"2024-02-16T10:32:55.013994+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:32:55.013994+0000","last_undegraded":"2024-02-16T10:32:55.013994+0000","last_fullsized":"2024-02-16T10:32:55.013994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.013774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:43:39.758624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608466+0000","last_change":"2024-02-16T10:30:26.081144+0000","last_active":"2024-02-16T10:32:13.608466+0000","last_peered":"2024-02-16T10:32:13.608466+0000","last_clean":"2024-02-16T10:32:13.608466+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:32:13.608466+0000","last_undegraded":"2024-02-16T10:32:13.608466+0000","last_fullsized":"2024-02-16T10:32:13.608466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609800+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:32:13.609800+0000","last_peered":"2024-02-16T10:32:13.609800+0000","last_clean":"2024-02-16T10:32:13.609800+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:32:13.609800+0000","last_undegraded":"2024-02-16T10:32:13.609800+0000","last_fullsized":"2024-02-16T10:32:13.609800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.978713+0000","last_change":"2024-02-16T10:32:32.978713+0000","last_active":"2024-02-16T10:32:32.978713+0000","last_peered":"2024-02-16T10:32:32.978713+0000","last_clean":"2024-02-16T10:32:32.978713+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:32.978713+0000","last_undegraded":"2024-02-16T10:32:32.978713+0000","last_fullsized":"2024-02-16T10:32:32.978713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.978443+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:07.123372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.263617+0000","last_change":"2024-02-16T10:32:26.263617+0000","last_active":"2024-02-16T10:32:26.263617+0000","last_peered":"2024-02-16T10:32:26.263617+0000","last_clean":"2024-02-16T10:32:26.263617+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:32:26.263617+0000","last_undegraded":"2024-02-16T10:32:26.263617+0000","last_fullsized":"2024-02-16T10:32:26.263617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.263353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:40.727544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.672103+0000","last_change":"2024-02-16T10:30:36.151542+0000","last_active":"2024-02-16T10:32:12.672103+0000","last_peered":"2024-02-16T10:32:12.672103+0000","last_clean":"2024-02-16T10:32:12.672103+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:32:12.672103+0000","last_undegraded":"2024-02-16T10:32:12.672103+0000","last_fullsized":"2024-02-16T10:32:12.672103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.341417+0000","last_change":"2024-02-16T10:33:07.341484+0000","last_active":"2024-02-16T10:33:07.341417+0000","last_peered":"2024-02-16T10:33:07.341417+0000","last_clean":"2024-02-16T10:33:07.341417+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:33:07.341417+0000","last_undegraded":"2024-02-16T10:33:07.341417+0000","last_fullsized":"2024-02-16T10:33:07.341417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.341236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:08.832698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.337168+0000","last_change":"2024-02-16T10:32:55.337229+0000","last_active":"2024-02-16T10:32:55.337168+0000","last_peered":"2024-02-16T10:32:55.337168+0000","last_clean":"2024-02-16T10:32:55.337168+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:32:55.337168+0000","last_undegraded":"2024-02-16T10:32:55.337168+0000","last_fullsized":"2024-02-16T10:32:55.337168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.336944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:53.525218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:31:10.924569+0000","last_change":"2024-02-16T10:31:06.926453+0000","last_active":"2024-02-16T10:31:10.924569+0000","last_peered":"2024-02-16T10:31:10.924569+0000","last_clean":"2024-02-16T10:31:10.924569+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:31:10.924569+0000","last_undegraded":"2024-02-16T10:31:10.924569+0000","last_fullsized":"2024-02-16T10:31:10.924569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.304935+0000","last_change":"2024-02-16T10:32:16.304935+0000","last_active":"2024-02-16T10:32:16.304935+0000","last_peered":"2024-02-16T10:32:16.304935+0000","last_clean":"2024-02-16T10:32:16.304935+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:32:16.304935+0000","last_undegraded":"2024-02-16T10:32:16.304935+0000","last_fullsized":"2024-02-16T10:32:16.304935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.304645+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:45.895015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.217226+0000","last_change":"2024-02-16T10:32:30.217226+0000","last_active":"2024-02-16T10:32:30.217226+0000","last_peered":"2024-02-16T10:32:30.217226+0000","last_clean":"2024-02-16T10:32:30.217226+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:32:30.217226+0000","last_undegraded":"2024-02-16T10:32:30.217226+0000","last_fullsized":"2024-02-16T10:32:30.217226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.216971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:22.338282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.235030+0000","last_change":"2024-02-16T10:30:36.140936+0000","last_active":"2024-02-16T10:32:12.235030+0000","last_peered":"2024-02-16T10:32:12.235030+0000","last_clean":"2024-02-16T10:32:12.235030+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:32:12.235030+0000","last_undegraded":"2024-02-16T10:32:12.235030+0000","last_fullsized":"2024-02-16T10:32:12.235030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.975475+0000","last_change":"2024-02-16T10:32:51.975475+0000","last_active":"2024-02-16T10:32:51.975475+0000","last_peered":"2024-02-16T10:32:51.975475+0000","last_clean":"2024-02-16T10:32:51.975475+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:51.975475+0000","last_undegraded":"2024-02-16T10:32:51.975475+0000","last_fullsized":"2024-02-16T10:32:51.975475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.975220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:24.082042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608323+0000","last_change":"2024-02-16T10:30:26.086259+0000","last_active":"2024-02-16T10:32:13.608323+0000","last_peered":"2024-02-16T10:32:13.608323+0000","last_clean":"2024-02-16T10:32:13.608323+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:32:13.608323+0000","last_undegraded":"2024-02-16T10:32:13.608323+0000","last_fullsized":"2024-02-16T10:32:13.608323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.731408+0000","last_change":"2024-02-16T10:32:31.731408+0000","last_active":"2024-02-16T10:32:31.731408+0000","last_peered":"2024-02-16T10:32:31.731408+0000","last_clean":"2024-02-16T10:32:31.731408+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:32:31.731408+0000","last_undegraded":"2024-02-16T10:32:31.731408+0000","last_fullsized":"2024-02-16T10:32:31.731408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.731089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:38.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.284906+0000","last_change":"2024-02-16T10:32:19.284906+0000","last_active":"2024-02-16T10:32:19.284906+0000","last_peered":"2024-02-16T10:32:19.284906+0000","last_clean":"2024-02-16T10:32:19.284906+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:32:19.284906+0000","last_undegraded":"2024-02-16T10:32:19.284906+0000","last_fullsized":"2024-02-16T10:32:19.284906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.284625+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:24.273342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.940256+0000","last_change":"2024-02-16T10:32:40.940256+0000","last_active":"2024-02-16T10:32:40.940256+0000","last_peered":"2024-02-16T10:32:40.940256+0000","last_clean":"2024-02-16T10:32:40.940256+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:40.940256+0000","last_undegraded":"2024-02-16T10:32:40.940256+0000","last_fullsized":"2024-02-16T10:32:40.940256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.939974+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:39.316923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.379056+0000","last_change":"2024-02-16T10:32:34.379056+0000","last_active":"2024-02-16T10:32:34.379056+0000","last_peered":"2024-02-16T10:32:34.379056+0000","last_clean":"2024-02-16T10:32:34.379056+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:32:34.379056+0000","last_undegraded":"2024-02-16T10:32:34.379056+0000","last_fullsized":"2024-02-16T10:32:34.379056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.378676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:48.842868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.644457+0000","last_change":"2024-02-16T10:32:38.644457+0000","last_active":"2024-02-16T10:32:38.644457+0000","last_peered":"2024-02-16T10:32:38.644457+0000","last_clean":"2024-02-16T10:32:38.644457+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:38.644457+0000","last_undegraded":"2024-02-16T10:32:38.644457+0000","last_fullsized":"2024-02-16T10:32:38.644457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.644187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:07.018674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.216949+0000","last_change":"2024-02-16T10:33:01.217013+0000","last_active":"2024-02-16T10:33:01.216949+0000","last_peered":"2024-02-16T10:33:01.216949+0000","last_clean":"2024-02-16T10:33:01.216949+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:33:01.216949+0000","last_undegraded":"2024-02-16T10:33:01.216949+0000","last_fullsized":"2024-02-16T10:33:01.216949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.216732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:27.927734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.781557+0000","last_change":"2024-02-16T10:32:15.781557+0000","last_active":"2024-02-16T10:32:15.781557+0000","last_peered":"2024-02-16T10:32:15.781557+0000","last_clean":"2024-02-16T10:32:15.781557+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:32:15.781557+0000","last_undegraded":"2024-02-16T10:32:15.781557+0000","last_fullsized":"2024-02-16T10:32:15.781557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.781303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:34.208301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.238141+0000","last_change":"2024-02-16T10:32:17.238141+0000","last_active":"2024-02-16T10:32:17.238141+0000","last_peered":"2024-02-16T10:32:17.238141+0000","last_clean":"2024-02-16T10:32:17.238141+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:17.238141+0000","last_undegraded":"2024-02-16T10:32:17.238141+0000","last_fullsized":"2024-02-16T10:32:17.238141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.237729+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:01.114959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.449321+0000","last_change":"2024-02-16T10:32:14.449321+0000","last_active":"2024-02-16T10:32:14.449321+0000","last_peered":"2024-02-16T10:32:14.449321+0000","last_clean":"2024-02-16T10:32:14.449321+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:14.449321+0000","last_undegraded":"2024-02-16T10:32:14.449321+0000","last_fullsized":"2024-02-16T10:32:14.449321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.449055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:44.039424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.921754+0000","last_change":"2024-02-16T10:32:46.921910+0000","last_active":"2024-02-16T10:32:46.921754+0000","last_peered":"2024-02-16T10:32:46.921754+0000","last_clean":"2024-02-16T10:32:46.921754+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:32:46.921754+0000","last_undegraded":"2024-02-16T10:32:46.921754+0000","last_fullsized":"2024-02-16T10:32:46.921754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.921537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:02.923520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.268360+0000","last_change":"2024-02-16T10:32:45.268426+0000","last_active":"2024-02-16T10:32:45.268360+0000","last_peered":"2024-02-16T10:32:45.268360+0000","last_clean":"2024-02-16T10:32:45.268360+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:32:45.268360+0000","last_undegraded":"2024-02-16T10:32:45.268360+0000","last_fullsized":"2024-02-16T10:32:45.268360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.268134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:03.695131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.167563+0000","last_change":"2024-02-16T10:32:31.167563+0000","last_active":"2024-02-16T10:32:31.167563+0000","last_peered":"2024-02-16T10:32:31.167563+0000","last_clean":"2024-02-16T10:32:31.167563+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:32:31.167563+0000","last_undegraded":"2024-02-16T10:32:31.167563+0000","last_fullsized":"2024-02-16T10:32:31.167563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.167309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:12.870280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.399916+0000","last_change":"2024-02-16T10:32:23.399916+0000","last_active":"2024-02-16T10:32:23.399916+0000","last_peered":"2024-02-16T10:32:23.399916+0000","last_clean":"2024-02-16T10:32:23.399916+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:23.399916+0000","last_undegraded":"2024-02-16T10:32:23.399916+0000","last_fullsized":"2024-02-16T10:32:23.399916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.399643+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:12.773508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.465612+0000","last_change":"2024-02-16T10:32:16.465612+0000","last_active":"2024-02-16T10:32:16.465612+0000","last_peered":"2024-02-16T10:32:16.465612+0000","last_clean":"2024-02-16T10:32:16.465612+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:32:16.465612+0000","last_undegraded":"2024-02-16T10:32:16.465612+0000","last_fullsized":"2024-02-16T10:32:16.465612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.465378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:49.655775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.393059+0000","last_change":"2024-02-16T10:33:04.393116+0000","last_active":"2024-02-16T10:33:04.393059+0000","last_peered":"2024-02-16T10:33:04.393059+0000","last_clean":"2024-02-16T10:33:04.393059+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:33:04.393059+0000","last_undegraded":"2024-02-16T10:33:04.393059+0000","last_fullsized":"2024-02-16T10:33:04.393059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.392874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:32.385598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.232956+0000","last_change":"2024-02-16T10:32:48.233019+0000","last_active":"2024-02-16T10:32:48.232956+0000","last_peered":"2024-02-16T10:32:48.232956+0000","last_clean":"2024-02-16T10:32:48.232956+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:32:48.232956+0000","last_undegraded":"2024-02-16T10:32:48.232956+0000","last_fullsized":"2024-02-16T10:32:48.232956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.232778+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.274224+0000","last_change":"2024-02-16T10:32:57.274286+0000","last_active":"2024-02-16T10:32:57.274224+0000","last_peered":"2024-02-16T10:32:57.274224+0000","last_clean":"2024-02-16T10:32:57.274224+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:32:57.274224+0000","last_undegraded":"2024-02-16T10:32:57.274224+0000","last_fullsized":"2024-02-16T10:32:57.274224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.274014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:54.291309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.647776+0000","last_change":"2024-02-16T10:32:27.647776+0000","last_active":"2024-02-16T10:32:27.647776+0000","last_peered":"2024-02-16T10:32:27.647776+0000","last_clean":"2024-02-16T10:32:27.647776+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:32:27.647776+0000","last_undegraded":"2024-02-16T10:32:27.647776+0000","last_fullsized":"2024-02-16T10:32:27.647776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.647521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:04.955314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.933959+0000","last_change":"2024-02-16T10:32:28.933959+0000","last_active":"2024-02-16T10:32:28.933959+0000","last_peered":"2024-02-16T10:32:28.933959+0000","last_clean":"2024-02-16T10:32:28.933959+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:28.933959+0000","last_undegraded":"2024-02-16T10:32:28.933959+0000","last_fullsized":"2024-02-16T10:32:28.933959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.933703+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:04.743780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.755709+0000","last_change":"2024-02-16T10:32:32.755709+0000","last_active":"2024-02-16T10:32:32.755709+0000","last_peered":"2024-02-16T10:32:32.755709+0000","last_clean":"2024-02-16T10:32:32.755709+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:32:32.755709+0000","last_undegraded":"2024-02-16T10:32:32.755709+0000","last_fullsized":"2024-02-16T10:32:32.755709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.755469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:24.687565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.672129+0000","last_change":"2024-02-16T10:30:36.153983+0000","last_active":"2024-02-16T10:32:12.672129+0000","last_peered":"2024-02-16T10:32:12.672129+0000","last_clean":"2024-02-16T10:32:12.672129+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:32:12.672129+0000","last_undegraded":"2024-02-16T10:32:12.672129+0000","last_fullsized":"2024-02-16T10:32:12.672129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.286011+0000","last_change":"2024-02-16T10:32:40.286011+0000","last_active":"2024-02-16T10:32:40.286011+0000","last_peered":"2024-02-16T10:32:40.286011+0000","last_clean":"2024-02-16T10:32:40.286011+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:32:40.286011+0000","last_undegraded":"2024-02-16T10:32:40.286011+0000","last_fullsized":"2024-02-16T10:32:40.286011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.285731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:45.263145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608282+0000","last_change":"2024-02-16T10:30:26.085250+0000","last_active":"2024-02-16T10:32:13.608282+0000","last_peered":"2024-02-16T10:32:13.608282+0000","last_clean":"2024-02-16T10:32:13.608282+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:32:13.608282+0000","last_undegraded":"2024-02-16T10:32:13.608282+0000","last_fullsized":"2024-02-16T10:32:13.608282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.768452+0000","last_change":"2024-02-16T10:32:33.768452+0000","last_active":"2024-02-16T10:32:33.768452+0000","last_peered":"2024-02-16T10:32:33.768452+0000","last_clean":"2024-02-16T10:32:33.768452+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:32:33.768452+0000","last_undegraded":"2024-02-16T10:32:33.768452+0000","last_fullsized":"2024-02-16T10:32:33.768452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.768198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:09.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.803505+0000","last_change":"2024-02-16T10:32:16.803505+0000","last_active":"2024-02-16T10:32:16.803505+0000","last_peered":"2024-02-16T10:32:16.803505+0000","last_clean":"2024-02-16T10:32:16.803505+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:16.803505+0000","last_undegraded":"2024-02-16T10:32:16.803505+0000","last_fullsized":"2024-02-16T10:32:16.803505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.803212+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:32.256266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.644180+0000","last_change":"2024-02-16T10:32:28.644180+0000","last_active":"2024-02-16T10:32:28.644180+0000","last_peered":"2024-02-16T10:32:28.644180+0000","last_clean":"2024-02-16T10:32:28.644180+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:28.644180+0000","last_undegraded":"2024-02-16T10:32:28.644180+0000","last_fullsized":"2024-02-16T10:32:28.644180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.643929+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:10.346900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234791+0000","last_change":"2024-02-16T10:30:36.159892+0000","last_active":"2024-02-16T10:32:12.234791+0000","last_peered":"2024-02-16T10:32:12.234791+0000","last_clean":"2024-02-16T10:32:12.234791+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:32:12.234791+0000","last_undegraded":"2024-02-16T10:32:12.234791+0000","last_fullsized":"2024-02-16T10:32:12.234791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.286063+0000","last_change":"2024-02-16T10:32:46.286129+0000","last_active":"2024-02-16T10:32:46.286063+0000","last_peered":"2024-02-16T10:32:46.286063+0000","last_clean":"2024-02-16T10:32:46.286063+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:32:46.286063+0000","last_undegraded":"2024-02-16T10:32:46.286063+0000","last_fullsized":"2024-02-16T10:32:46.286063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.285887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:01.738941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608183+0000","last_change":"2024-02-16T10:30:26.086084+0000","last_active":"2024-02-16T10:32:13.608183+0000","last_peered":"2024-02-16T10:32:13.608183+0000","last_clean":"2024-02-16T10:32:13.608183+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:32:13.608183+0000","last_undegraded":"2024-02-16T10:32:13.608183+0000","last_fullsized":"2024-02-16T10:32:13.608183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.695562+0000","last_change":"2024-02-16T10:32:30.695562+0000","last_active":"2024-02-16T10:32:30.695562+0000","last_peered":"2024-02-16T10:32:30.695562+0000","last_clean":"2024-02-16T10:32:30.695562+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:32:30.695562+0000","last_undegraded":"2024-02-16T10:32:30.695562+0000","last_fullsized":"2024-02-16T10:32:30.695562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.695316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:35.672730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.964066+0000","last_change":"2024-02-16T10:32:43.964066+0000","last_active":"2024-02-16T10:32:43.964066+0000","last_peered":"2024-02-16T10:32:43.964066+0000","last_clean":"2024-02-16T10:32:43.964066+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:43.964066+0000","last_undegraded":"2024-02-16T10:32:43.964066+0000","last_fullsized":"2024-02-16T10:32:43.964066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.963784+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:35.015936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.497295+0000","last_change":"2024-02-16T10:32:17.497295+0000","last_active":"2024-02-16T10:32:17.497295+0000","last_peered":"2024-02-16T10:32:17.497295+0000","last_clean":"2024-02-16T10:32:17.497295+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:32:17.497295+0000","last_undegraded":"2024-02-16T10:32:17.497295+0000","last_fullsized":"2024-02-16T10:32:17.497295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.496921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:48.124154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.620154+0000","last_change":"2024-02-16T10:33:10.620322+0000","last_active":"2024-02-16T10:33:10.620154+0000","last_peered":"2024-02-16T10:33:10.620154+0000","last_clean":"2024-02-16T10:33:10.620154+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:33:10.620154+0000","last_undegraded":"2024-02-16T10:33:10.620154+0000","last_fullsized":"2024-02-16T10:33:10.620154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.619902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:34.041848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.229630+0000","last_change":"2024-02-16T10:33:08.229696+0000","last_active":"2024-02-16T10:33:08.229630+0000","last_peered":"2024-02-16T10:33:08.229630+0000","last_clean":"2024-02-16T10:33:08.229630+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:33:08.229630+0000","last_undegraded":"2024-02-16T10:33:08.229630+0000","last_fullsized":"2024-02-16T10:33:08.229630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.229415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:08:03.257453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.532455+0000","last_change":"2024-02-16T10:32:49.532517+0000","last_active":"2024-02-16T10:32:49.532455+0000","last_peered":"2024-02-16T10:32:49.532455+0000","last_clean":"2024-02-16T10:32:49.532455+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:32:49.532455+0000","last_undegraded":"2024-02-16T10:32:49.532455+0000","last_fullsized":"2024-02-16T10:32:49.532455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.532266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:57.734052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.451331+0000","last_change":"2024-02-16T10:32:27.451331+0000","last_active":"2024-02-16T10:32:27.451331+0000","last_peered":"2024-02-16T10:32:27.451331+0000","last_clean":"2024-02-16T10:32:27.451331+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:27.451331+0000","last_undegraded":"2024-02-16T10:32:27.451331+0000","last_fullsized":"2024-02-16T10:32:27.451331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.451069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:58.078302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.240843+0000","last_change":"2024-02-16T10:32:20.240843+0000","last_active":"2024-02-16T10:32:20.240843+0000","last_peered":"2024-02-16T10:32:20.240843+0000","last_clean":"2024-02-16T10:32:20.240843+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:20.240843+0000","last_undegraded":"2024-02-16T10:32:20.240843+0000","last_fullsized":"2024-02-16T10:32:20.240843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.240570+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:31.716842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.017811+0000","last_change":"2024-02-16T10:32:37.017811+0000","last_active":"2024-02-16T10:32:37.017811+0000","last_peered":"2024-02-16T10:32:37.017811+0000","last_clean":"2024-02-16T10:32:37.017811+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:32:37.017811+0000","last_undegraded":"2024-02-16T10:32:37.017811+0000","last_fullsized":"2024-02-16T10:32:37.017811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.017556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:51.032253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.115773+0000","last_change":"2024-02-16T10:33:05.115828+0000","last_active":"2024-02-16T10:33:05.115773+0000","last_peered":"2024-02-16T10:33:05.115773+0000","last_clean":"2024-02-16T10:33:05.115773+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:33:05.115773+0000","last_undegraded":"2024-02-16T10:33:05.115773+0000","last_fullsized":"2024-02-16T10:33:05.115773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.115560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:07.229889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.929301+0000","last_change":"2024-02-16T10:32:29.929301+0000","last_active":"2024-02-16T10:32:29.929301+0000","last_peered":"2024-02-16T10:32:29.929301+0000","last_clean":"2024-02-16T10:32:29.929301+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:32:29.929301+0000","last_undegraded":"2024-02-16T10:32:29.929301+0000","last_fullsized":"2024-02-16T10:32:29.929301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.929048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:38.130834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608287+0000","last_change":"2024-02-16T10:30:26.086064+0000","last_active":"2024-02-16T10:32:13.608287+0000","last_peered":"2024-02-16T10:32:13.608287+0000","last_clean":"2024-02-16T10:32:13.608287+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:32:13.608287+0000","last_undegraded":"2024-02-16T10:32:13.608287+0000","last_fullsized":"2024-02-16T10:32:13.608287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.646038+0000","last_change":"2024-02-16T10:32:29.646038+0000","last_active":"2024-02-16T10:32:29.646038+0000","last_peered":"2024-02-16T10:32:29.646038+0000","last_clean":"2024-02-16T10:32:29.646038+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:32:29.646038+0000","last_undegraded":"2024-02-16T10:32:29.646038+0000","last_fullsized":"2024-02-16T10:32:29.646038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.645785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:23.146927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.309318+0000","last_change":"2024-02-16T10:32:21.309318+0000","last_active":"2024-02-16T10:32:21.309318+0000","last_peered":"2024-02-16T10:32:21.309318+0000","last_clean":"2024-02-16T10:32:21.309318+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:21.309318+0000","last_undegraded":"2024-02-16T10:32:21.309318+0000","last_fullsized":"2024-02-16T10:32:21.309318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.309051+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:16:57.682746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.163489+0000","last_change":"2024-02-16T10:32:14.163489+0000","last_active":"2024-02-16T10:32:14.163489+0000","last_peered":"2024-02-16T10:32:14.163489+0000","last_clean":"2024-02-16T10:32:14.163489+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:14.163489+0000","last_undegraded":"2024-02-16T10:32:14.163489+0000","last_fullsized":"2024-02-16T10:32:14.163489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.163228+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:11.600065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.620194+0000","last_change":"2024-02-16T10:33:08.620253+0000","last_active":"2024-02-16T10:33:08.620194+0000","last_peered":"2024-02-16T10:33:08.620194+0000","last_clean":"2024-02-16T10:33:08.620194+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:33:08.620194+0000","last_undegraded":"2024-02-16T10:33:08.620194+0000","last_fullsized":"2024-02-16T10:33:08.620194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.620010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:10.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.368195+0000","last_change":"2024-02-16T10:32:36.368195+0000","last_active":"2024-02-16T10:32:36.368195+0000","last_peered":"2024-02-16T10:32:36.368195+0000","last_clean":"2024-02-16T10:32:36.368195+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:32:36.368195+0000","last_undegraded":"2024-02-16T10:32:36.368195+0000","last_fullsized":"2024-02-16T10:32:36.368195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.367915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:48.603515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.161223+0000","last_change":"2024-02-16T10:33:06.161296+0000","last_active":"2024-02-16T10:33:06.161223+0000","last_peered":"2024-02-16T10:33:06.161223+0000","last_clean":"2024-02-16T10:33:06.161223+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:33:06.161223+0000","last_undegraded":"2024-02-16T10:33:06.161223+0000","last_fullsized":"2024-02-16T10:33:06.161223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.161008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:51.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.227428+0000","last_change":"2024-02-16T10:32:29.227428+0000","last_active":"2024-02-16T10:32:29.227428+0000","last_peered":"2024-02-16T10:32:29.227428+0000","last_clean":"2024-02-16T10:32:29.227428+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:29.227428+0000","last_undegraded":"2024-02-16T10:32:29.227428+0000","last_fullsized":"2024-02-16T10:32:29.227428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.227174+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:41.462774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.984249+0000","last_change":"2024-02-16T10:32:41.984249+0000","last_active":"2024-02-16T10:32:41.984249+0000","last_peered":"2024-02-16T10:32:41.984249+0000","last_clean":"2024-02-16T10:32:41.984249+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:32:41.984249+0000","last_undegraded":"2024-02-16T10:32:41.984249+0000","last_fullsized":"2024-02-16T10:32:41.984249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.983908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:16.170915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.304415+0000","last_change":"2024-02-16T10:32:18.304415+0000","last_active":"2024-02-16T10:32:18.304415+0000","last_peered":"2024-02-16T10:32:18.304415+0000","last_clean":"2024-02-16T10:32:18.304415+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:18.304415+0000","last_undegraded":"2024-02-16T10:32:18.304415+0000","last_fullsized":"2024-02-16T10:32:18.304415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.304138+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:51.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.397338+0000","last_change":"2024-02-16T10:33:01.397402+0000","last_active":"2024-02-16T10:33:01.397338+0000","last_peered":"2024-02-16T10:33:01.397338+0000","last_clean":"2024-02-16T10:33:01.397338+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:33:01.397338+0000","last_undegraded":"2024-02-16T10:33:01.397338+0000","last_fullsized":"2024-02-16T10:33:01.397338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.397137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:59.997013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.143875+0000","last_change":"2024-02-16T10:32:35.143875+0000","last_active":"2024-02-16T10:32:35.143875+0000","last_peered":"2024-02-16T10:32:35.143875+0000","last_clean":"2024-02-16T10:32:35.143875+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:32:35.143875+0000","last_undegraded":"2024-02-16T10:32:35.143875+0000","last_fullsized":"2024-02-16T10:32:35.143875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.143615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:27.075711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.119660+0000","last_change":"2024-02-16T10:33:09.119719+0000","last_active":"2024-02-16T10:33:09.119660+0000","last_peered":"2024-02-16T10:33:09.119660+0000","last_clean":"2024-02-16T10:33:09.119660+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:33:09.119660+0000","last_undegraded":"2024-02-16T10:33:09.119660+0000","last_fullsized":"2024-02-16T10:33:09.119660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.119459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:05.115810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.781651+0000","last_change":"2024-02-16T10:32:13.781651+0000","last_active":"2024-02-16T10:32:13.781651+0000","last_peered":"2024-02-16T10:32:13.781651+0000","last_clean":"2024-02-16T10:32:13.781651+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:32:13.781651+0000","last_undegraded":"2024-02-16T10:32:13.781651+0000","last_fullsized":"2024-02-16T10:32:13.781651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.781400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:02:49.070840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.203087+0000","last_change":"2024-02-16T10:32:21.203087+0000","last_active":"2024-02-16T10:32:21.203087+0000","last_peered":"2024-02-16T10:32:21.203087+0000","last_clean":"2024-02-16T10:32:21.203087+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:21.203087+0000","last_undegraded":"2024-02-16T10:32:21.203087+0000","last_fullsized":"2024-02-16T10:32:21.203087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.202707+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:08.574336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.238385+0000","last_change":"2024-02-16T10:32:18.238385+0000","last_active":"2024-02-16T10:32:18.238385+0000","last_peered":"2024-02-16T10:32:18.238385+0000","last_clean":"2024-02-16T10:32:18.238385+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:32:18.238385+0000","last_undegraded":"2024-02-16T10:32:18.238385+0000","last_fullsized":"2024-02-16T10:32:18.238385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.238111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:31.457700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.136516+0000","last_change":"2024-02-16T10:32:34.136516+0000","last_active":"2024-02-16T10:32:34.136516+0000","last_peered":"2024-02-16T10:32:34.136516+0000","last_clean":"2024-02-16T10:32:34.136516+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:32:34.136516+0000","last_undegraded":"2024-02-16T10:32:34.136516+0000","last_fullsized":"2024-02-16T10:32:34.136516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.136238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:40.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.943470+0000","last_change":"2024-02-16T10:32:30.943470+0000","last_active":"2024-02-16T10:32:30.943470+0000","last_peered":"2024-02-16T10:32:30.943470+0000","last_clean":"2024-02-16T10:32:30.943470+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:32:30.943470+0000","last_undegraded":"2024-02-16T10:32:30.943470+0000","last_fullsized":"2024-02-16T10:32:30.943470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.943169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:44.988481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.240077+0000","last_change":"2024-02-16T10:33:00.240148+0000","last_active":"2024-02-16T10:33:00.240077+0000","last_peered":"2024-02-16T10:33:00.240077+0000","last_clean":"2024-02-16T10:33:00.240077+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:33:00.240077+0000","last_undegraded":"2024-02-16T10:33:00.240077+0000","last_fullsized":"2024-02-16T10:33:00.240077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.239869+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:01.731330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607902+0000","last_change":"2024-02-16T10:30:18.010319+0000","last_active":"2024-02-16T10:32:13.607902+0000","last_peered":"2024-02-16T10:32:13.607902+0000","last_clean":"2024-02-16T10:32:13.607902+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:32:13.607902+0000","last_undegraded":"2024-02-16T10:32:13.607902+0000","last_fullsized":"2024-02-16T10:32:13.607902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608068+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:32:13.608068+0000","last_peered":"2024-02-16T10:32:13.608068+0000","last_clean":"2024-02-16T10:32:13.608068+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:32:13.608068+0000","last_undegraded":"2024-02-16T10:32:13.608068+0000","last_fullsized":"2024-02-16T10:32:13.608068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.279935+0000","last_change":"2024-02-16T10:32:27.279935+0000","last_active":"2024-02-16T10:32:27.279935+0000","last_peered":"2024-02-16T10:32:27.279935+0000","last_clean":"2024-02-16T10:32:27.279935+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:32:27.279935+0000","last_undegraded":"2024-02-16T10:32:27.279935+0000","last_fullsized":"2024-02-16T10:32:27.279935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.279691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:39:24.188579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.960833+0000","last_change":"2024-02-16T10:32:38.960833+0000","last_active":"2024-02-16T10:32:38.960833+0000","last_peered":"2024-02-16T10:32:38.960833+0000","last_clean":"2024-02-16T10:32:38.960833+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:38.960833+0000","last_undegraded":"2024-02-16T10:32:38.960833+0000","last_fullsized":"2024-02-16T10:32:38.960833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.960420+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:29:47.645317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.512594+0000","last_change":"2024-02-16T10:32:20.512594+0000","last_active":"2024-02-16T10:32:20.512594+0000","last_peered":"2024-02-16T10:32:20.512594+0000","last_clean":"2024-02-16T10:32:20.512594+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:32:20.512594+0000","last_undegraded":"2024-02-16T10:32:20.512594+0000","last_fullsized":"2024-02-16T10:32:20.512594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.512313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:57.090214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.430846+0000","last_change":"2024-02-16T10:33:02.430910+0000","last_active":"2024-02-16T10:33:02.430846+0000","last_peered":"2024-02-16T10:33:02.430846+0000","last_clean":"2024-02-16T10:33:02.430846+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:33:02.430846+0000","last_undegraded":"2024-02-16T10:33:02.430846+0000","last_fullsized":"2024-02-16T10:33:02.430846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.430646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:22.558915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.948837+0000","last_change":"2024-02-16T10:32:49.948909+0000","last_active":"2024-02-16T10:32:49.948837+0000","last_peered":"2024-02-16T10:32:49.948837+0000","last_clean":"2024-02-16T10:32:49.948837+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:32:49.948837+0000","last_undegraded":"2024-02-16T10:32:49.948837+0000","last_fullsized":"2024-02-16T10:32:49.948837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.948648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:05.258497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607879+0000","last_change":"2024-02-16T10:30:18.009463+0000","last_active":"2024-02-16T10:32:13.607879+0000","last_peered":"2024-02-16T10:32:13.607879+0000","last_clean":"2024-02-16T10:32:13.607879+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:32:13.607879+0000","last_undegraded":"2024-02-16T10:32:13.607879+0000","last_fullsized":"2024-02-16T10:32:13.607879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.571062+0000","last_change":"2024-02-16T10:32:47.571125+0000","last_active":"2024-02-16T10:32:47.571062+0000","last_peered":"2024-02-16T10:32:47.571062+0000","last_clean":"2024-02-16T10:32:47.571062+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:32:47.571062+0000","last_undegraded":"2024-02-16T10:32:47.571062+0000","last_fullsized":"2024-02-16T10:32:47.571062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.570876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:07:21.048590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.736135+0000","last_change":"2024-02-16T10:32:14.736135+0000","last_active":"2024-02-16T10:32:14.736135+0000","last_peered":"2024-02-16T10:32:14.736135+0000","last_clean":"2024-02-16T10:32:14.736135+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:32:14.736135+0000","last_undegraded":"2024-02-16T10:32:14.736135+0000","last_fullsized":"2024-02-16T10:32:14.736135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.735884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:40.928168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.273669+0000","last_change":"2024-02-16T10:32:19.273669+0000","last_active":"2024-02-16T10:32:19.273669+0000","last_peered":"2024-02-16T10:32:19.273669+0000","last_clean":"2024-02-16T10:32:19.273669+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:19.273669+0000","last_undegraded":"2024-02-16T10:32:19.273669+0000","last_fullsized":"2024-02-16T10:32:19.273669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.273406+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:49.900639+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.978134+0000","last_change":"2024-02-16T10:32:48.978193+0000","last_active":"2024-02-16T10:32:48.978134+0000","last_peered":"2024-02-16T10:32:48.978134+0000","last_clean":"2024-02-16T10:32:48.978134+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:32:48.978134+0000","last_undegraded":"2024-02-16T10:32:48.978134+0000","last_fullsized":"2024-02-16T10:32:48.978134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.977937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:51.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.174869+0000","last_change":"2024-02-16T10:32:38.174869+0000","last_active":"2024-02-16T10:32:38.174869+0000","last_peered":"2024-02-16T10:32:38.174869+0000","last_clean":"2024-02-16T10:32:38.174869+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:32:38.174869+0000","last_undegraded":"2024-02-16T10:32:38.174869+0000","last_fullsized":"2024-02-16T10:32:38.174869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.174629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:56.601626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.613284+0000","last_change":"2024-02-16T10:32:41.613350+0000","last_active":"2024-02-16T10:32:41.613284+0000","last_peered":"2024-02-16T10:32:41.613284+0000","last_clean":"2024-02-16T10:32:41.613284+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:41.613284+0000","last_undegraded":"2024-02-16T10:32:41.613284+0000","last_fullsized":"2024-02-16T10:32:41.613284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.613065+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:19.969376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.273965+0000","last_change":"2024-02-16T10:32:52.274043+0000","last_active":"2024-02-16T10:32:52.273965+0000","last_peered":"2024-02-16T10:32:52.273965+0000","last_clean":"2024-02-16T10:32:52.273965+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:32:52.273965+0000","last_undegraded":"2024-02-16T10:32:52.273965+0000","last_fullsized":"2024-02-16T10:32:52.273965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.273779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:11.755492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.628916+0000","last_change":"2024-02-16T10:32:51.629026+0000","last_active":"2024-02-16T10:32:51.628916+0000","last_peered":"2024-02-16T10:32:51.628916+0000","last_clean":"2024-02-16T10:32:51.628916+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:32:51.628916+0000","last_undegraded":"2024-02-16T10:32:51.628916+0000","last_fullsized":"2024-02-16T10:32:51.628916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.628708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:34.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.455727+0000","last_change":"2024-02-16T10:32:29.455727+0000","last_active":"2024-02-16T10:32:29.455727+0000","last_peered":"2024-02-16T10:32:29.455727+0000","last_clean":"2024-02-16T10:32:29.455727+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:32:29.455727+0000","last_undegraded":"2024-02-16T10:32:29.455727+0000","last_fullsized":"2024-02-16T10:32:29.455727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.455432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:16.827061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.278098+0000","last_change":"2024-02-16T10:32:20.278098+0000","last_active":"2024-02-16T10:32:20.278098+0000","last_peered":"2024-02-16T10:32:20.278098+0000","last_clean":"2024-02-16T10:32:20.278098+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:20.278098+0000","last_undegraded":"2024-02-16T10:32:20.278098+0000","last_fullsized":"2024-02-16T10:32:20.278098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.277804+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:57:46.102924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.694650+0000","last_change":"2024-02-16T10:32:36.694650+0000","last_active":"2024-02-16T10:32:36.694650+0000","last_peered":"2024-02-16T10:32:36.694650+0000","last_clean":"2024-02-16T10:32:36.694650+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:32:36.694650+0000","last_undegraded":"2024-02-16T10:32:36.694650+0000","last_fullsized":"2024-02-16T10:32:36.694650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.694397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:52.147451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.948881+0000","last_change":"2024-02-16T10:32:52.949022+0000","last_active":"2024-02-16T10:32:52.948881+0000","last_peered":"2024-02-16T10:32:52.948881+0000","last_clean":"2024-02-16T10:32:52.948881+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:32:52.948881+0000","last_undegraded":"2024-02-16T10:32:52.948881+0000","last_fullsized":"2024-02-16T10:32:52.948881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.948652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:15:00.595710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.539873+0000","last_change":"2024-02-16T10:32:56.539932+0000","last_active":"2024-02-16T10:32:56.539873+0000","last_peered":"2024-02-16T10:32:56.539873+0000","last_clean":"2024-02-16T10:32:56.539873+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:32:56.539873+0000","last_undegraded":"2024-02-16T10:32:56.539873+0000","last_fullsized":"2024-02-16T10:32:56.539873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.539683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:10.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607881+0000","last_change":"2024-02-16T10:30:18.010328+0000","last_active":"2024-02-16T10:32:13.607881+0000","last_peered":"2024-02-16T10:32:13.607881+0000","last_clean":"2024-02-16T10:32:13.607881+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:32:13.607881+0000","last_undegraded":"2024-02-16T10:32:13.607881+0000","last_fullsized":"2024-02-16T10:32:13.607881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.301659+0000","last_change":"2024-02-16T10:32:47.301721+0000","last_active":"2024-02-16T10:32:47.301659+0000","last_peered":"2024-02-16T10:32:47.301659+0000","last_clean":"2024-02-16T10:32:47.301659+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:32:47.301659+0000","last_undegraded":"2024-02-16T10:32:47.301659+0000","last_fullsized":"2024-02-16T10:32:47.301659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.301448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:25.616217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.751469+0000","last_change":"2024-02-16T10:32:34.751469+0000","last_active":"2024-02-16T10:32:34.751469+0000","last_peered":"2024-02-16T10:32:34.751469+0000","last_clean":"2024-02-16T10:32:34.751469+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:32:34.751469+0000","last_undegraded":"2024-02-16T10:32:34.751469+0000","last_fullsized":"2024-02-16T10:32:34.751469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.751222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:00.943506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.979895+0000","last_change":"2024-02-16T10:32:39.979895+0000","last_active":"2024-02-16T10:32:39.979895+0000","last_peered":"2024-02-16T10:32:39.979895+0000","last_clean":"2024-02-16T10:32:39.979895+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:32:39.979895+0000","last_undegraded":"2024-02-16T10:32:39.979895+0000","last_fullsized":"2024-02-16T10:32:39.979895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.979639+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:56:47.790005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.981922+0000","last_change":"2024-02-16T10:32:44.981922+0000","last_active":"2024-02-16T10:32:44.981922+0000","last_peered":"2024-02-16T10:32:44.981922+0000","last_clean":"2024-02-16T10:32:44.981922+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:32:44.981922+0000","last_undegraded":"2024-02-16T10:32:44.981922+0000","last_fullsized":"2024-02-16T10:32:44.981922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.981644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:40.009681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.188485+0000","last_change":"2024-02-16T10:33:10.188557+0000","last_active":"2024-02-16T10:33:10.188485+0000","last_peered":"2024-02-16T10:33:10.188485+0000","last_clean":"2024-02-16T10:33:10.188485+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:33:10.188485+0000","last_undegraded":"2024-02-16T10:33:10.188485+0000","last_fullsized":"2024-02-16T10:33:10.188485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.188305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:26.190288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.246559+0000","last_change":"2024-02-16T10:32:44.246622+0000","last_active":"2024-02-16T10:32:44.246559+0000","last_peered":"2024-02-16T10:32:44.246559+0000","last_clean":"2024-02-16T10:32:44.246559+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:32:44.246559+0000","last_undegraded":"2024-02-16T10:32:44.246559+0000","last_fullsized":"2024-02-16T10:32:44.246559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.246379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:22.602690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.242816+0000","last_change":"2024-02-16T10:32:41.242876+0000","last_active":"2024-02-16T10:32:41.242816+0000","last_peered":"2024-02-16T10:32:41.242816+0000","last_clean":"2024-02-16T10:32:41.242816+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:32:41.242816+0000","last_undegraded":"2024-02-16T10:32:41.242816+0000","last_fullsized":"2024-02-16T10:32:41.242816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.242620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:47.758750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.556651+0000","last_change":"2024-02-16T10:32:59.556711+0000","last_active":"2024-02-16T10:32:59.556651+0000","last_peered":"2024-02-16T10:32:59.556651+0000","last_clean":"2024-02-16T10:32:59.556651+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:32:59.556651+0000","last_undegraded":"2024-02-16T10:32:59.556651+0000","last_fullsized":"2024-02-16T10:32:59.556651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.556469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.723330+0000","last_change":"2024-02-16T10:32:35.723330+0000","last_active":"2024-02-16T10:32:35.723330+0000","last_peered":"2024-02-16T10:32:35.723330+0000","last_clean":"2024-02-16T10:32:35.723330+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:32:35.723330+0000","last_undegraded":"2024-02-16T10:32:35.723330+0000","last_fullsized":"2024-02-16T10:32:35.723330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.723078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:54.150076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'70","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.637878+0000","last_change":"2024-02-16T10:32:26.637878+0000","last_active":"2024-02-16T10:32:26.637878+0000","last_peered":"2024-02-16T10:32:26.637878+0000","last_clean":"2024-02-16T10:32:26.637878+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:26.637878+0000","last_undegraded":"2024-02-16T10:32:26.637878+0000","last_fullsized":"2024-02-16T10:32:26.637878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.637563+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:38.873163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.185179+0000","last_change":"2024-02-16T10:32:16.185179+0000","last_active":"2024-02-16T10:32:16.185179+0000","last_peered":"2024-02-16T10:32:16.185179+0000","last_clean":"2024-02-16T10:32:16.185179+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:32:16.185179+0000","last_undegraded":"2024-02-16T10:32:16.185179+0000","last_fullsized":"2024-02-16T10:32:16.185179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.184842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:49:06.247286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.647753+0000","last_change":"2024-02-16T10:32:40.647753+0000","last_active":"2024-02-16T10:32:40.647753+0000","last_peered":"2024-02-16T10:32:40.647753+0000","last_clean":"2024-02-16T10:32:40.647753+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:32:40.647753+0000","last_undegraded":"2024-02-16T10:32:40.647753+0000","last_fullsized":"2024-02-16T10:32:40.647753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.647500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:34.495274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.199955+0000","last_change":"2024-02-16T10:32:54.200020+0000","last_active":"2024-02-16T10:32:54.199955+0000","last_peered":"2024-02-16T10:32:54.199955+0000","last_clean":"2024-02-16T10:32:54.199955+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:32:54.199955+0000","last_undegraded":"2024-02-16T10:32:54.199955+0000","last_fullsized":"2024-02-16T10:32:54.199955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.199762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:52.799639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.622453+0000","last_change":"2024-02-16T10:33:02.622510+0000","last_active":"2024-02-16T10:33:02.622453+0000","last_peered":"2024-02-16T10:33:02.622453+0000","last_clean":"2024-02-16T10:33:02.622453+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:33:02.622453+0000","last_undegraded":"2024-02-16T10:33:02.622453+0000","last_fullsized":"2024-02-16T10:33:02.622453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.622254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:19.243588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608025+0000","last_change":"2024-02-16T10:30:18.009479+0000","last_active":"2024-02-16T10:32:13.608025+0000","last_peered":"2024-02-16T10:32:13.608025+0000","last_clean":"2024-02-16T10:32:13.608025+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:32:13.608025+0000","last_undegraded":"2024-02-16T10:32:13.608025+0000","last_fullsized":"2024-02-16T10:32:13.608025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.858645+0000","last_change":"2024-02-16T10:32:19.858645+0000","last_active":"2024-02-16T10:32:19.858645+0000","last_peered":"2024-02-16T10:32:19.858645+0000","last_clean":"2024-02-16T10:32:19.858645+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:32:19.858645+0000","last_undegraded":"2024-02-16T10:32:19.858645+0000","last_fullsized":"2024-02-16T10:32:19.858645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.858393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:55.403466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.357240+0000","last_change":"2024-02-16T10:32:15.357240+0000","last_active":"2024-02-16T10:32:15.357240+0000","last_peered":"2024-02-16T10:32:15.357240+0000","last_clean":"2024-02-16T10:32:15.357240+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:32:15.357240+0000","last_undegraded":"2024-02-16T10:32:15.357240+0000","last_fullsized":"2024-02-16T10:32:15.357240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.356955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:04:12.700846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.354389+0000","last_change":"2024-02-16T10:32:14.354389+0000","last_active":"2024-02-16T10:32:14.354389+0000","last_peered":"2024-02-16T10:32:14.354389+0000","last_clean":"2024-02-16T10:32:14.354389+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:14.354389+0000","last_undegraded":"2024-02-16T10:32:14.354389+0000","last_fullsized":"2024-02-16T10:32:14.354389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.353994+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:24.095058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610738+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:32:13.610738+0000","last_peered":"2024-02-16T10:32:13.610738+0000","last_clean":"2024-02-16T10:32:13.610738+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:32:13.610738+0000","last_undegraded":"2024-02-16T10:32:13.610738+0000","last_fullsized":"2024-02-16T10:32:13.610738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.422614+0000","last_change":"2024-02-16T10:33:05.422614+0000","last_active":"2024-02-16T10:33:05.422614+0000","last_peered":"2024-02-16T10:33:05.422614+0000","last_clean":"2024-02-16T10:33:05.422614+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:33:05.422614+0000","last_undegraded":"2024-02-16T10:33:05.422614+0000","last_fullsized":"2024-02-16T10:33:05.422614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.422384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:31.765105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.091468+0000","last_change":"2024-02-16T10:33:04.091545+0000","last_active":"2024-02-16T10:33:04.091468+0000","last_peered":"2024-02-16T10:33:04.091468+0000","last_clean":"2024-02-16T10:33:04.091468+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:33:04.091468+0000","last_undegraded":"2024-02-16T10:33:04.091468+0000","last_fullsized":"2024-02-16T10:33:04.091468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.091251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:26.782432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.556147+0000","last_change":"2024-02-16T10:32:58.556204+0000","last_active":"2024-02-16T10:32:58.556147+0000","last_peered":"2024-02-16T10:32:58.556147+0000","last_clean":"2024-02-16T10:32:58.556147+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:32:58.556147+0000","last_undegraded":"2024-02-16T10:32:58.556147+0000","last_fullsized":"2024-02-16T10:32:58.556147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.555957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:30:07.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.913654+0000","last_change":"2024-02-16T10:32:21.913654+0000","last_active":"2024-02-16T10:32:21.913654+0000","last_peered":"2024-02-16T10:32:21.913654+0000","last_clean":"2024-02-16T10:32:21.913654+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:32:21.913654+0000","last_undegraded":"2024-02-16T10:32:21.913654+0000","last_fullsized":"2024-02-16T10:32:21.913654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.913396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:04.153154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.866581+0000","last_change":"2024-02-16T10:32:26.866581+0000","last_active":"2024-02-16T10:32:26.866581+0000","last_peered":"2024-02-16T10:32:26.866581+0000","last_clean":"2024-02-16T10:32:26.866581+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:32:26.866581+0000","last_undegraded":"2024-02-16T10:32:26.866581+0000","last_fullsized":"2024-02-16T10:32:26.866581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.866309+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:28.219357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.413073+0000","last_change":"2024-02-16T10:32:13.413073+0000","last_active":"2024-02-16T10:32:13.413073+0000","last_peered":"2024-02-16T10:32:13.413073+0000","last_clean":"2024-02-16T10:32:13.413073+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:13.413073+0000","last_undegraded":"2024-02-16T10:32:13.413073+0000","last_fullsized":"2024-02-16T10:32:13.413073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.412978+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:02.786844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.201818+0000","last_change":"2024-02-16T10:33:09.201889+0000","last_active":"2024-02-16T10:33:09.201818+0000","last_peered":"2024-02-16T10:33:09.201818+0000","last_clean":"2024-02-16T10:33:09.201818+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:33:09.201818+0000","last_undegraded":"2024-02-16T10:33:09.201818+0000","last_fullsized":"2024-02-16T10:33:09.201818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.201598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:24.357883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.364773+0000","last_change":"2024-02-16T10:32:37.364825+0000","last_active":"2024-02-16T10:32:37.364773+0000","last_peered":"2024-02-16T10:32:37.364773+0000","last_clean":"2024-02-16T10:32:37.364773+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:32:37.364773+0000","last_undegraded":"2024-02-16T10:32:37.364773+0000","last_fullsized":"2024-02-16T10:32:37.364773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.364585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:29.485895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.228992+0000","last_change":"2024-02-16T10:33:03.229054+0000","last_active":"2024-02-16T10:33:03.228992+0000","last_peered":"2024-02-16T10:33:03.228992+0000","last_clean":"2024-02-16T10:33:03.228992+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:33:03.228992+0000","last_undegraded":"2024-02-16T10:33:03.228992+0000","last_fullsized":"2024-02-16T10:33:03.228992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.228797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:11.039164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.607996+0000","last_change":"2024-02-16T10:30:18.412777+0000","last_active":"2024-02-16T10:32:13.607996+0000","last_peered":"2024-02-16T10:32:13.607996+0000","last_clean":"2024-02-16T10:32:13.607996+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:32:13.607996+0000","last_undegraded":"2024-02-16T10:32:13.607996+0000","last_fullsized":"2024-02-16T10:32:13.607996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:16.986154+0000","last_clean_scrub_stamp":"2024-02-16T10:30:16.986154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.894998+0000","last_change":"2024-02-16T10:32:23.894998+0000","last_active":"2024-02-16T10:32:23.894998+0000","last_peered":"2024-02-16T10:32:23.894998+0000","last_clean":"2024-02-16T10:32:23.894998+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:32:23.894998+0000","last_undegraded":"2024-02-16T10:32:23.894998+0000","last_fullsized":"2024-02-16T10:32:23.894998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.894738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:24.572023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.394537+0000","last_change":"2024-02-16T10:32:25.394537+0000","last_active":"2024-02-16T10:32:25.394537+0000","last_peered":"2024-02-16T10:32:25.394537+0000","last_clean":"2024-02-16T10:32:25.394537+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:25.394537+0000","last_undegraded":"2024-02-16T10:32:25.394537+0000","last_fullsized":"2024-02-16T10:32:25.394537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.394250+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:35.971596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.461912+0000","last_change":"2024-02-16T10:32:15.461912+0000","last_active":"2024-02-16T10:32:15.461912+0000","last_peered":"2024-02-16T10:32:15.461912+0000","last_clean":"2024-02-16T10:32:15.461912+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:32:15.461912+0000","last_undegraded":"2024-02-16T10:32:15.461912+0000","last_fullsized":"2024-02-16T10:32:15.461912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.461664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:26.039010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.422778+0000","last_change":"2024-02-16T10:32:30.422778+0000","last_active":"2024-02-16T10:32:30.422778+0000","last_peered":"2024-02-16T10:32:30.422778+0000","last_clean":"2024-02-16T10:32:30.422778+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:32:30.422778+0000","last_undegraded":"2024-02-16T10:32:30.422778+0000","last_fullsized":"2024-02-16T10:32:30.422778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.422534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:07.000435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.404761+0000","last_change":"2024-02-16T10:33:03.404813+0000","last_active":"2024-02-16T10:33:03.404761+0000","last_peered":"2024-02-16T10:33:03.404761+0000","last_clean":"2024-02-16T10:33:03.404761+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:33:03.404761+0000","last_undegraded":"2024-02-16T10:33:03.404761+0000","last_fullsized":"2024-02-16T10:33:03.404761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.404578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:37:06.320135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.236856+0000","last_change":"2024-02-16T10:32:42.236856+0000","last_active":"2024-02-16T10:32:42.236856+0000","last_peered":"2024-02-16T10:32:42.236856+0000","last_clean":"2024-02-16T10:32:42.236856+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:42.236856+0000","last_undegraded":"2024-02-16T10:32:42.236856+0000","last_fullsized":"2024-02-16T10:32:42.236856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.236564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.168661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608345+0000","last_change":"2024-02-16T10:30:26.063741+0000","last_active":"2024-02-16T10:32:13.608345+0000","last_peered":"2024-02-16T10:32:13.608345+0000","last_clean":"2024-02-16T10:32:13.608345+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:32:13.608345+0000","last_undegraded":"2024-02-16T10:32:13.608345+0000","last_fullsized":"2024-02-16T10:32:13.608345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.233102+0000","last_change":"2024-02-16T10:32:23.233102+0000","last_active":"2024-02-16T10:32:23.233102+0000","last_peered":"2024-02-16T10:32:23.233102+0000","last_clean":"2024-02-16T10:32:23.233102+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:32:23.233102+0000","last_undegraded":"2024-02-16T10:32:23.233102+0000","last_fullsized":"2024-02-16T10:32:23.233102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.232854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:06.883209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.871641+0000","last_change":"2024-02-16T10:32:18.871641+0000","last_active":"2024-02-16T10:32:18.871641+0000","last_peered":"2024-02-16T10:32:18.871641+0000","last_clean":"2024-02-16T10:32:18.871641+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:18.871641+0000","last_undegraded":"2024-02-16T10:32:18.871641+0000","last_fullsized":"2024-02-16T10:32:18.871641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.871268+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:47.245756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.003300+0000","last_change":"2024-02-16T10:32:38.003300+0000","last_active":"2024-02-16T10:32:38.003300+0000","last_peered":"2024-02-16T10:32:38.003300+0000","last_clean":"2024-02-16T10:32:38.003300+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:32:38.003300+0000","last_undegraded":"2024-02-16T10:32:38.003300+0000","last_fullsized":"2024-02-16T10:32:38.003300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.003041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:53.724413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.613781+0000","last_change":"2024-02-16T10:33:07.613834+0000","last_active":"2024-02-16T10:33:07.613781+0000","last_peered":"2024-02-16T10:33:07.613781+0000","last_clean":"2024-02-16T10:33:07.613781+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:33:07.613781+0000","last_undegraded":"2024-02-16T10:33:07.613781+0000","last_fullsized":"2024-02-16T10:33:07.613781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.613584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:59.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.211875+0000","last_change":"2024-02-16T10:32:47.211875+0000","last_active":"2024-02-16T10:32:47.211875+0000","last_peered":"2024-02-16T10:32:47.211875+0000","last_clean":"2024-02-16T10:32:47.211875+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:32:47.211875+0000","last_undegraded":"2024-02-16T10:32:47.211875+0000","last_fullsized":"2024-02-16T10:32:47.211875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.211625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:59.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.320864+0000","last_change":"2024-02-16T10:32:39.320864+0000","last_active":"2024-02-16T10:32:39.320864+0000","last_peered":"2024-02-16T10:32:39.320864+0000","last_clean":"2024-02-16T10:32:39.320864+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:32:39.320864+0000","last_undegraded":"2024-02-16T10:32:39.320864+0000","last_fullsized":"2024-02-16T10:32:39.320864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.320594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:32.821736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.839228+0000","last_change":"2024-02-16T10:32:17.839228+0000","last_active":"2024-02-16T10:32:17.839228+0000","last_peered":"2024-02-16T10:32:17.839228+0000","last_clean":"2024-02-16T10:32:17.839228+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:32:17.839228+0000","last_undegraded":"2024-02-16T10:32:17.839228+0000","last_fullsized":"2024-02-16T10:32:17.839228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.838982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:56.153751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.552580+0000","last_change":"2024-02-16T10:32:21.552580+0000","last_active":"2024-02-16T10:32:21.552580+0000","last_peered":"2024-02-16T10:32:21.552580+0000","last_clean":"2024-02-16T10:32:21.552580+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:32:21.552580+0000","last_undegraded":"2024-02-16T10:32:21.552580+0000","last_fullsized":"2024-02-16T10:32:21.552580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.552195+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.202550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.348211+0000","last_change":"2024-02-16T10:32:22.348211+0000","last_active":"2024-02-16T10:32:22.348211+0000","last_peered":"2024-02-16T10:32:22.348211+0000","last_clean":"2024-02-16T10:32:22.348211+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:32:22.348211+0000","last_undegraded":"2024-02-16T10:32:22.348211+0000","last_fullsized":"2024-02-16T10:32:22.348211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.347938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:32.089002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.234893+0000","last_change":"2024-02-16T10:30:36.155487+0000","last_active":"2024-02-16T10:32:12.234893+0000","last_peered":"2024-02-16T10:32:12.234893+0000","last_clean":"2024-02-16T10:32:12.234893+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:32:12.234893+0000","last_undegraded":"2024-02-16T10:32:12.234893+0000","last_fullsized":"2024-02-16T10:32:12.234893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.596002+0000","last_change":"2024-02-16T10:32:42.596002+0000","last_active":"2024-02-16T10:32:42.596002+0000","last_peered":"2024-02-16T10:32:42.596002+0000","last_clean":"2024-02-16T10:32:42.596002+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:32:42.596002+0000","last_undegraded":"2024-02-16T10:32:42.596002+0000","last_fullsized":"2024-02-16T10:32:42.596002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.595633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:38.295504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.312391+0000","last_change":"2024-02-16T10:32:56.312453+0000","last_active":"2024-02-16T10:32:56.312391+0000","last_peered":"2024-02-16T10:32:56.312391+0000","last_clean":"2024-02-16T10:32:56.312391+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:32:56.312391+0000","last_undegraded":"2024-02-16T10:32:56.312391+0000","last_fullsized":"2024-02-16T10:32:56.312391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:57.665208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.431239+0000","last_change":"2024-02-16T10:32:28.431239+0000","last_active":"2024-02-16T10:32:28.431239+0000","last_peered":"2024-02-16T10:32:28.431239+0000","last_clean":"2024-02-16T10:32:28.431239+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:32:28.431239+0000","last_undegraded":"2024-02-16T10:32:28.431239+0000","last_fullsized":"2024-02-16T10:32:28.431239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.430925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:39.907197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.547169+0000","last_change":"2024-02-16T10:32:23.547169+0000","last_active":"2024-02-16T10:32:23.547169+0000","last_peered":"2024-02-16T10:32:23.547169+0000","last_clean":"2024-02-16T10:32:23.547169+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:23.547169+0000","last_undegraded":"2024-02-16T10:32:23.547169+0000","last_fullsized":"2024-02-16T10:32:23.547169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.546894+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:50.589838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.353181+0000","last_change":"2024-02-16T10:32:13.353181+0000","last_active":"2024-02-16T10:32:13.353181+0000","last_peered":"2024-02-16T10:32:13.353181+0000","last_clean":"2024-02-16T10:32:13.353181+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:32:13.353181+0000","last_undegraded":"2024-02-16T10:32:13.353181+0000","last_fullsized":"2024-02-16T10:32:13.353181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.352927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:59.430673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.611019+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:32:13.611019+0000","last_peered":"2024-02-16T10:32:13.611019+0000","last_clean":"2024-02-16T10:32:13.611019+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:32:13.611019+0000","last_undegraded":"2024-02-16T10:32:13.611019+0000","last_fullsized":"2024-02-16T10:32:13.611019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.978151+0000","last_change":"2024-02-16T10:32:33.978151+0000","last_active":"2024-02-16T10:32:33.978151+0000","last_peered":"2024-02-16T10:32:33.978151+0000","last_clean":"2024-02-16T10:32:33.978151+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:33.978151+0000","last_undegraded":"2024-02-16T10:32:33.978151+0000","last_fullsized":"2024-02-16T10:32:33.978151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.977897+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:01.970621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.246513+0000","last_change":"2024-02-16T10:32:55.246576+0000","last_active":"2024-02-16T10:32:55.246513+0000","last_peered":"2024-02-16T10:32:55.246513+0000","last_clean":"2024-02-16T10:32:55.246513+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:32:55.246513+0000","last_undegraded":"2024-02-16T10:32:55.246513+0000","last_fullsized":"2024-02-16T10:32:55.246513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.246320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:15.374588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.892358+0000","last_change":"2024-02-16T10:32:22.892358+0000","last_active":"2024-02-16T10:32:22.892358+0000","last_peered":"2024-02-16T10:32:22.892358+0000","last_clean":"2024-02-16T10:32:22.892358+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:32:22.892358+0000","last_undegraded":"2024-02-16T10:32:22.892358+0000","last_fullsized":"2024-02-16T10:32:22.892358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.892090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:42.373803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.352194+0000","last_change":"2024-02-16T10:32:24.352194+0000","last_active":"2024-02-16T10:32:24.352194+0000","last_peered":"2024-02-16T10:32:24.352194+0000","last_clean":"2024-02-16T10:32:24.352194+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:24.352194+0000","last_undegraded":"2024-02-16T10:32:24.352194+0000","last_fullsized":"2024-02-16T10:32:24.352194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.351933+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:53.942303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.181591+0000","last_change":"2024-02-16T10:32:15.181591+0000","last_active":"2024-02-16T10:32:15.181591+0000","last_peered":"2024-02-16T10:32:15.181591+0000","last_clean":"2024-02-16T10:32:15.181591+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:32:15.181591+0000","last_undegraded":"2024-02-16T10:32:15.181591+0000","last_fullsized":"2024-02-16T10:32:15.181591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.181356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:14.859456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'24","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.001573+0000","last_change":"2024-02-16T10:32:54.001753+0000","last_active":"2024-02-16T10:32:54.001573+0000","last_peered":"2024-02-16T10:32:54.001573+0000","last_clean":"2024-02-16T10:32:54.001573+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:32:54.001573+0000","last_undegraded":"2024-02-16T10:32:54.001573+0000","last_fullsized":"2024-02-16T10:32:54.001573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.001338+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:49:45.427964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.109834+0000","last_change":"2024-02-16T10:33:10.109901+0000","last_active":"2024-02-16T10:33:10.109834+0000","last_peered":"2024-02-16T10:33:10.109834+0000","last_clean":"2024-02-16T10:33:10.109834+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:33:10.109834+0000","last_undegraded":"2024-02-16T10:33:10.109834+0000","last_fullsized":"2024-02-16T10:33:10.109834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.109636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:45:03.216850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.378170+0000","last_change":"2024-02-16T10:33:06.378170+0000","last_active":"2024-02-16T10:33:06.378170+0000","last_peered":"2024-02-16T10:33:06.378170+0000","last_clean":"2024-02-16T10:33:06.378170+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:33:06.378170+0000","last_undegraded":"2024-02-16T10:33:06.378170+0000","last_fullsized":"2024-02-16T10:33:06.378170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.377937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:52.202390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.580433+0000","last_change":"2024-02-16T10:32:22.580433+0000","last_active":"2024-02-16T10:32:22.580433+0000","last_peered":"2024-02-16T10:32:22.580433+0000","last_clean":"2024-02-16T10:32:22.580433+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:22.580433+0000","last_undegraded":"2024-02-16T10:32:22.580433+0000","last_fullsized":"2024-02-16T10:32:22.580433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.580047+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:28.539775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.183196+0000","last_change":"2024-02-16T10:32:13.183196+0000","last_active":"2024-02-16T10:32:13.183196+0000","last_peered":"2024-02-16T10:32:13.183196+0000","last_clean":"2024-02-16T10:32:13.183196+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:32:13.183196+0000","last_undegraded":"2024-02-16T10:32:13.183196+0000","last_fullsized":"2024-02-16T10:32:13.183196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.182934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:58:32.694869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.576093+0000","last_change":"2024-02-16T10:33:09.576156+0000","last_active":"2024-02-16T10:33:09.576093+0000","last_peered":"2024-02-16T10:33:09.576093+0000","last_clean":"2024-02-16T10:33:09.576093+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:33:09.576093+0000","last_undegraded":"2024-02-16T10:33:09.576093+0000","last_fullsized":"2024-02-16T10:33:09.576093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.575901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:24.885751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.615377+0000","last_change":"2024-02-16T10:33:06.615431+0000","last_active":"2024-02-16T10:33:06.615377+0000","last_peered":"2024-02-16T10:33:06.615377+0000","last_clean":"2024-02-16T10:33:06.615377+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:33:06.615377+0000","last_undegraded":"2024-02-16T10:33:06.615377+0000","last_fullsized":"2024-02-16T10:33:06.615377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.615187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:22.617170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.279087+0000","last_change":"2024-02-16T10:32:57.279157+0000","last_active":"2024-02-16T10:32:57.279087+0000","last_peered":"2024-02-16T10:32:57.279087+0000","last_clean":"2024-02-16T10:32:57.279087+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:32:57.279087+0000","last_undegraded":"2024-02-16T10:32:57.279087+0000","last_fullsized":"2024-02-16T10:32:57.279087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.278888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:25.271612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.440004+0000","last_change":"2024-02-16T10:32:32.440004+0000","last_active":"2024-02-16T10:32:32.440004+0000","last_peered":"2024-02-16T10:32:32.440004+0000","last_clean":"2024-02-16T10:32:32.440004+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:32:32.440004+0000","last_undegraded":"2024-02-16T10:32:32.440004+0000","last_fullsized":"2024-02-16T10:32:32.440004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.439721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:38.399449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.980131+0000","last_change":"2024-02-16T10:32:45.980131+0000","last_active":"2024-02-16T10:32:45.980131+0000","last_peered":"2024-02-16T10:32:45.980131+0000","last_clean":"2024-02-16T10:32:45.980131+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:45.980131+0000","last_undegraded":"2024-02-16T10:32:45.980131+0000","last_fullsized":"2024-02-16T10:32:45.980131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.979834+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:01.136119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.184210+0000","last_change":"2024-02-16T10:32:22.184210+0000","last_active":"2024-02-16T10:32:22.184210+0000","last_peered":"2024-02-16T10:32:22.184210+0000","last_clean":"2024-02-16T10:32:22.184210+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:32:22.184210+0000","last_undegraded":"2024-02-16T10:32:22.184210+0000","last_fullsized":"2024-02-16T10:32:22.184210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.183927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:58.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.985188+0000","last_change":"2024-02-16T10:32:56.985252+0000","last_active":"2024-02-16T10:32:56.985188+0000","last_peered":"2024-02-16T10:32:56.985188+0000","last_clean":"2024-02-16T10:32:56.985188+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:32:56.985188+0000","last_undegraded":"2024-02-16T10:32:56.985188+0000","last_fullsized":"2024-02-16T10:32:56.985188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.984974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:05:02.646087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.887571+0000","last_change":"2024-02-16T10:32:27.887571+0000","last_active":"2024-02-16T10:32:27.887571+0000","last_peered":"2024-02-16T10:32:27.887571+0000","last_clean":"2024-02-16T10:32:27.887571+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:32:27.887571+0000","last_undegraded":"2024-02-16T10:32:27.887571+0000","last_fullsized":"2024-02-16T10:32:27.887571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.887325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:24.904620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.216574+0000","last_change":"2024-02-16T10:33:06.216636+0000","last_active":"2024-02-16T10:33:06.216574+0000","last_peered":"2024-02-16T10:33:06.216574+0000","last_clean":"2024-02-16T10:33:06.216574+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:33:06.216574+0000","last_undegraded":"2024-02-16T10:33:06.216574+0000","last_fullsized":"2024-02-16T10:33:06.216574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.216374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:22.837708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.436035+0000","last_change":"2024-02-16T10:32:31.436035+0000","last_active":"2024-02-16T10:32:31.436035+0000","last_peered":"2024-02-16T10:32:31.436035+0000","last_clean":"2024-02-16T10:32:31.436035+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:32:31.436035+0000","last_undegraded":"2024-02-16T10:32:31.436035+0000","last_fullsized":"2024-02-16T10:32:31.436035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:15.086149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.510077+0000","last_change":"2024-02-16T10:32:19.510077+0000","last_active":"2024-02-16T10:32:19.510077+0000","last_peered":"2024-02-16T10:32:19.510077+0000","last_clean":"2024-02-16T10:32:19.510077+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:19.510077+0000","last_undegraded":"2024-02-16T10:32:19.510077+0000","last_fullsized":"2024-02-16T10:32:19.510077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.509815+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:06.881445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.449861+0000","last_change":"2024-02-16T10:32:12.449861+0000","last_active":"2024-02-16T10:32:12.449861+0000","last_peered":"2024-02-16T10:32:12.449861+0000","last_clean":"2024-02-16T10:32:12.449861+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:32:12.449861+0000","last_undegraded":"2024-02-16T10:32:12.449861+0000","last_fullsized":"2024-02-16T10:32:12.449861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_clean_scrub_stamp":"2024-02-16T10:32:12.449759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:28.024682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.014475+0000","last_change":"2024-02-16T10:33:01.014585+0000","last_active":"2024-02-16T10:33:01.014475+0000","last_peered":"2024-02-16T10:33:01.014475+0000","last_clean":"2024-02-16T10:33:01.014475+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:33:01.014475+0000","last_undegraded":"2024-02-16T10:33:01.014475+0000","last_fullsized":"2024-02-16T10:33:01.014475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.014232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:43:02.321815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.608039+0000","last_change":"2024-02-16T10:32:52.608039+0000","last_active":"2024-02-16T10:32:52.608039+0000","last_peered":"2024-02-16T10:32:52.608039+0000","last_clean":"2024-02-16T10:32:52.608039+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:32:52.608039+0000","last_undegraded":"2024-02-16T10:32:52.608039+0000","last_fullsized":"2024-02-16T10:32:52.608039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.607781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:26.752711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608494+0000","last_change":"2024-02-16T10:30:26.068854+0000","last_active":"2024-02-16T10:32:13.608494+0000","last_peered":"2024-02-16T10:32:13.608494+0000","last_clean":"2024-02-16T10:32:13.608494+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:32:13.608494+0000","last_undegraded":"2024-02-16T10:32:13.608494+0000","last_fullsized":"2024-02-16T10:32:13.608494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.250844+0000","last_change":"2024-02-16T10:32:28.250844+0000","last_active":"2024-02-16T10:32:28.250844+0000","last_peered":"2024-02-16T10:32:28.250844+0000","last_clean":"2024-02-16T10:32:28.250844+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:32:28.250844+0000","last_undegraded":"2024-02-16T10:32:28.250844+0000","last_fullsized":"2024-02-16T10:32:28.250844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.250601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:40.734413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.941423+0000","last_change":"2024-02-16T10:32:42.941509+0000","last_active":"2024-02-16T10:32:42.941423+0000","last_peered":"2024-02-16T10:32:42.941423+0000","last_clean":"2024-02-16T10:32:42.941423+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:32:42.941423+0000","last_undegraded":"2024-02-16T10:32:42.941423+0000","last_fullsized":"2024-02-16T10:32:42.941423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.941156+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:58:59.562490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.416755+0000","last_change":"2024-02-16T10:32:26.416755+0000","last_active":"2024-02-16T10:32:26.416755+0000","last_peered":"2024-02-16T10:32:26.416755+0000","last_clean":"2024-02-16T10:32:26.416755+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:26.416755+0000","last_undegraded":"2024-02-16T10:32:26.416755+0000","last_fullsized":"2024-02-16T10:32:26.416755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.416475+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:59.606871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610753+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:32:13.610753+0000","last_peered":"2024-02-16T10:32:13.610753+0000","last_clean":"2024-02-16T10:32:13.610753+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:32:13.610753+0000","last_undegraded":"2024-02-16T10:32:13.610753+0000","last_fullsized":"2024-02-16T10:32:13.610753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.312242+0000","last_change":"2024-02-16T10:32:48.312242+0000","last_active":"2024-02-16T10:32:48.312242+0000","last_peered":"2024-02-16T10:32:48.312242+0000","last_clean":"2024-02-16T10:32:48.312242+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:32:48.312242+0000","last_undegraded":"2024-02-16T10:32:48.312242+0000","last_fullsized":"2024-02-16T10:32:48.312242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.311977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:16.686464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.230708+0000","last_change":"2024-02-16T10:33:02.230789+0000","last_active":"2024-02-16T10:33:02.230708+0000","last_peered":"2024-02-16T10:33:02.230708+0000","last_clean":"2024-02-16T10:33:02.230708+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:33:02.230708+0000","last_undegraded":"2024-02-16T10:33:02.230708+0000","last_fullsized":"2024-02-16T10:33:02.230708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.230512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:41.751700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.296238+0000","last_change":"2024-02-16T10:32:25.296238+0000","last_active":"2024-02-16T10:32:25.296238+0000","last_peered":"2024-02-16T10:32:25.296238+0000","last_clean":"2024-02-16T10:32:25.296238+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:32:25.296238+0000","last_undegraded":"2024-02-16T10:32:25.296238+0000","last_fullsized":"2024-02-16T10:32:25.296238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.295850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:52.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.346391+0000","last_change":"2024-02-16T10:32:17.346391+0000","last_active":"2024-02-16T10:32:17.346391+0000","last_peered":"2024-02-16T10:32:17.346391+0000","last_clean":"2024-02-16T10:32:17.346391+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:17.346391+0000","last_undegraded":"2024-02-16T10:32:17.346391+0000","last_fullsized":"2024-02-16T10:32:17.346391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.346100+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:27.923447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.576651+0000","last_change":"2024-02-16T10:32:24.576651+0000","last_active":"2024-02-16T10:32:24.576651+0000","last_peered":"2024-02-16T10:32:24.576651+0000","last_clean":"2024-02-16T10:32:24.576651+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:32:24.576651+0000","last_undegraded":"2024-02-16T10:32:24.576651+0000","last_fullsized":"2024-02-16T10:32:24.576651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.576402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:39.040594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.672053+0000","last_change":"2024-02-16T10:30:36.151172+0000","last_active":"2024-02-16T10:32:12.672053+0000","last_peered":"2024-02-16T10:32:12.672053+0000","last_clean":"2024-02-16T10:32:12.672053+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:32:12.672053+0000","last_undegraded":"2024-02-16T10:32:12.672053+0000","last_fullsized":"2024-02-16T10:32:12.672053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.301320+0000","last_change":"2024-02-16T10:32:50.301320+0000","last_active":"2024-02-16T10:32:50.301320+0000","last_peered":"2024-02-16T10:32:50.301320+0000","last_clean":"2024-02-16T10:32:50.301320+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:50.301320+0000","last_undegraded":"2024-02-16T10:32:50.301320+0000","last_fullsized":"2024-02-16T10:32:50.301320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.301175+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:18.159316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608450+0000","last_change":"2024-02-16T10:30:26.085766+0000","last_active":"2024-02-16T10:32:13.608450+0000","last_peered":"2024-02-16T10:32:13.608450+0000","last_clean":"2024-02-16T10:32:13.608450+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:32:13.608450+0000","last_undegraded":"2024-02-16T10:32:13.608450+0000","last_fullsized":"2024-02-16T10:32:13.608450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.413364+0000","last_change":"2024-02-16T10:32:33.413364+0000","last_active":"2024-02-16T10:32:33.413364+0000","last_peered":"2024-02-16T10:32:33.413364+0000","last_clean":"2024-02-16T10:32:33.413364+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:32:33.413364+0000","last_undegraded":"2024-02-16T10:32:33.413364+0000","last_fullsized":"2024-02-16T10:32:33.413364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.413126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:45:00.456070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.600445+0000","last_change":"2024-02-16T10:32:25.600445+0000","last_active":"2024-02-16T10:32:25.600445+0000","last_peered":"2024-02-16T10:32:25.600445+0000","last_clean":"2024-02-16T10:32:25.600445+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:25.600445+0000","last_undegraded":"2024-02-16T10:32:25.600445+0000","last_fullsized":"2024-02-16T10:32:25.600445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.600171+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:50.787242+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.000355+0000","last_change":"2024-02-16T10:32:36.000355+0000","last_active":"2024-02-16T10:32:36.000355+0000","last_peered":"2024-02-16T10:32:36.000355+0000","last_clean":"2024-02-16T10:32:36.000355+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:32:36.000355+0000","last_undegraded":"2024-02-16T10:32:36.000355+0000","last_fullsized":"2024-02-16T10:32:36.000355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.000094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:36.814271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610949+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:32:13.610949+0000","last_peered":"2024-02-16T10:32:13.610949+0000","last_clean":"2024-02-16T10:32:13.610949+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:32:13.610949+0000","last_undegraded":"2024-02-16T10:32:13.610949+0000","last_fullsized":"2024-02-16T10:32:13.610949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.991391+0000","last_change":"2024-02-16T10:32:50.991391+0000","last_active":"2024-02-16T10:32:50.991391+0000","last_peered":"2024-02-16T10:32:50.991391+0000","last_clean":"2024-02-16T10:32:50.991391+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:32:50.991391+0000","last_undegraded":"2024-02-16T10:32:50.991391+0000","last_fullsized":"2024-02-16T10:32:50.991391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.990977+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:14.412923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.548693+0000","last_change":"2024-02-16T10:33:00.548760+0000","last_active":"2024-02-16T10:33:00.548693+0000","last_peered":"2024-02-16T10:33:00.548693+0000","last_clean":"2024-02-16T10:33:00.548693+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:33:00.548693+0000","last_undegraded":"2024-02-16T10:33:00.548693+0000","last_fullsized":"2024-02-16T10:33:00.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.548502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:58.925451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.282549+0000","last_change":"2024-02-16T10:32:24.282549+0000","last_active":"2024-02-16T10:32:24.282549+0000","last_peered":"2024-02-16T10:32:24.282549+0000","last_clean":"2024-02-16T10:32:24.282549+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:32:24.282549+0000","last_undegraded":"2024-02-16T10:32:24.282549+0000","last_fullsized":"2024-02-16T10:32:24.282549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.282291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:30.242018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.877073+0000","last_change":"2024-02-16T10:32:20.877073+0000","last_active":"2024-02-16T10:32:20.877073+0000","last_peered":"2024-02-16T10:32:20.877073+0000","last_clean":"2024-02-16T10:32:20.877073+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:20.877073+0000","last_undegraded":"2024-02-16T10:32:20.877073+0000","last_fullsized":"2024-02-16T10:32:20.877073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.876820+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:18:48.734961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.959040+0000","last_change":"2024-02-16T10:32:34.959040+0000","last_active":"2024-02-16T10:32:34.959040+0000","last_peered":"2024-02-16T10:32:34.959040+0000","last_clean":"2024-02-16T10:32:34.959040+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:32:34.959040+0000","last_undegraded":"2024-02-16T10:32:34.959040+0000","last_fullsized":"2024-02-16T10:32:34.959040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.958764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:01.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610927+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:32:13.610927+0000","last_peered":"2024-02-16T10:32:13.610927+0000","last_clean":"2024-02-16T10:32:13.610927+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:32:13.610927+0000","last_undegraded":"2024-02-16T10:32:13.610927+0000","last_fullsized":"2024-02-16T10:32:13.610927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.240998+0000","last_change":"2024-02-16T10:32:44.240998+0000","last_active":"2024-02-16T10:32:44.240998+0000","last_peered":"2024-02-16T10:32:44.240998+0000","last_clean":"2024-02-16T10:32:44.240998+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:44.240998+0000","last_undegraded":"2024-02-16T10:32:44.240998+0000","last_fullsized":"2024-02-16T10:32:44.240998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.240707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:10.432991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.198662+0000","last_change":"2024-02-16T10:32:53.198731+0000","last_active":"2024-02-16T10:32:53.198662+0000","last_peered":"2024-02-16T10:32:53.198662+0000","last_clean":"2024-02-16T10:32:53.198662+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:32:53.198662+0000","last_undegraded":"2024-02-16T10:32:53.198662+0000","last_fullsized":"2024-02-16T10:32:53.198662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.198470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:23.978649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.164334+0000","last_change":"2024-02-16T10:32:32.164334+0000","last_active":"2024-02-16T10:32:32.164334+0000","last_peered":"2024-02-16T10:32:32.164334+0000","last_clean":"2024-02-16T10:32:32.164334+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:32.164334+0000","last_undegraded":"2024-02-16T10:32:32.164334+0000","last_fullsized":"2024-02-16T10:32:32.164334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.164046+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:25.665188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.857295+0000","last_change":"2024-02-16T10:32:24.857295+0000","last_active":"2024-02-16T10:32:24.857295+0000","last_peered":"2024-02-16T10:32:24.857295+0000","last_clean":"2024-02-16T10:32:24.857295+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:24.857295+0000","last_undegraded":"2024-02-16T10:32:24.857295+0000","last_fullsized":"2024-02-16T10:32:24.857295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.857001+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:32.050416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.493966+0000","last_change":"2024-02-16T10:32:18.493966+0000","last_active":"2024-02-16T10:32:18.493966+0000","last_peered":"2024-02-16T10:32:18.493966+0000","last_clean":"2024-02-16T10:32:18.493966+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:32:18.493966+0000","last_undegraded":"2024-02-16T10:32:18.493966+0000","last_fullsized":"2024-02-16T10:32:18.493966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.493720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:29.969992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610880+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:32:13.610880+0000","last_peered":"2024-02-16T10:32:13.610880+0000","last_clean":"2024-02-16T10:32:13.610880+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:32:13.610880+0000","last_undegraded":"2024-02-16T10:32:13.610880+0000","last_fullsized":"2024-02-16T10:32:13.610880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.185600+0000","last_change":"2024-02-16T10:32:33.185600+0000","last_active":"2024-02-16T10:32:33.185600+0000","last_peered":"2024-02-16T10:32:33.185600+0000","last_clean":"2024-02-16T10:32:33.185600+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:32:33.185600+0000","last_undegraded":"2024-02-16T10:32:33.185600+0000","last_fullsized":"2024-02-16T10:32:33.185600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.185313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:38.162727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.322881+0000","last_change":"2024-02-16T10:32:58.322937+0000","last_active":"2024-02-16T10:32:58.322881+0000","last_peered":"2024-02-16T10:32:58.322881+0000","last_clean":"2024-02-16T10:32:58.322881+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:32:58.322881+0000","last_undegraded":"2024-02-16T10:32:58.322881+0000","last_fullsized":"2024-02-16T10:32:58.322881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.322698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:34.132775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.540064+0000","last_change":"2024-02-16T10:32:48.540133+0000","last_active":"2024-02-16T10:32:48.540064+0000","last_peered":"2024-02-16T10:32:48.540064+0000","last_clean":"2024-02-16T10:32:48.540064+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:32:48.540064+0000","last_undegraded":"2024-02-16T10:32:48.540064+0000","last_fullsized":"2024-02-16T10:32:48.540064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.539875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:16.085207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.598643+0000","last_change":"2024-02-16T10:33:01.598701+0000","last_active":"2024-02-16T10:33:01.598643+0000","last_peered":"2024-02-16T10:33:01.598643+0000","last_clean":"2024-02-16T10:33:01.598643+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:33:01.598643+0000","last_undegraded":"2024-02-16T10:33:01.598643+0000","last_fullsized":"2024-02-16T10:33:01.598643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.598443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:35.785450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.000443+0000","last_change":"2024-02-16T10:32:56.000511+0000","last_active":"2024-02-16T10:32:56.000443+0000","last_peered":"2024-02-16T10:32:56.000443+0000","last_clean":"2024-02-16T10:32:56.000443+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:32:56.000443+0000","last_undegraded":"2024-02-16T10:32:56.000443+0000","last_fullsized":"2024-02-16T10:32:56.000443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.000250+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:26:36.211245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.145997+0000","last_change":"2024-02-16T10:33:08.146092+0000","last_active":"2024-02-16T10:33:08.145997+0000","last_peered":"2024-02-16T10:33:08.145997+0000","last_clean":"2024-02-16T10:33:08.145997+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:33:08.145997+0000","last_undegraded":"2024-02-16T10:33:08.145997+0000","last_fullsized":"2024-02-16T10:33:08.145997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.145748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:40:23.931103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.548252+0000","last_change":"2024-02-16T10:32:54.548318+0000","last_active":"2024-02-16T10:32:54.548252+0000","last_peered":"2024-02-16T10:32:54.548252+0000","last_clean":"2024-02-16T10:32:54.548252+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:32:54.548252+0000","last_undegraded":"2024-02-16T10:32:54.548252+0000","last_fullsized":"2024-02-16T10:32:54.548252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.548056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:20.890776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.566223+0000","last_change":"2024-02-16T10:32:57.566279+0000","last_active":"2024-02-16T10:32:57.566223+0000","last_peered":"2024-02-16T10:32:57.566223+0000","last_clean":"2024-02-16T10:32:57.566223+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:32:57.566223+0000","last_undegraded":"2024-02-16T10:32:57.566223+0000","last_fullsized":"2024-02-16T10:32:57.566223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.566031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:17:13.287403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.579220+0000","last_change":"2024-02-16T10:32:50.579281+0000","last_active":"2024-02-16T10:32:50.579220+0000","last_peered":"2024-02-16T10:32:50.579220+0000","last_clean":"2024-02-16T10:32:50.579220+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:50.579220+0000","last_undegraded":"2024-02-16T10:32:50.579220+0000","last_fullsized":"2024-02-16T10:32:50.579220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.579036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:33:04.624348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.576029+0000","last_change":"2024-02-16T10:32:55.576097+0000","last_active":"2024-02-16T10:32:55.576029+0000","last_peered":"2024-02-16T10:32:55.576029+0000","last_clean":"2024-02-16T10:32:55.576029+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:32:55.576029+0000","last_undegraded":"2024-02-16T10:32:55.576029+0000","last_fullsized":"2024-02-16T10:32:55.576029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.575824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:56.390001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.190748+0000","last_change":"2024-02-16T10:32:36.190802+0000","last_active":"2024-02-16T10:32:36.190748+0000","last_peered":"2024-02-16T10:32:36.190748+0000","last_clean":"2024-02-16T10:32:36.190748+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:32:36.190748+0000","last_undegraded":"2024-02-16T10:32:36.190748+0000","last_fullsized":"2024-02-16T10:32:36.190748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.190560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:11.479999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.205255+0000","last_change":"2024-02-16T10:33:05.205325+0000","last_active":"2024-02-16T10:33:05.205255+0000","last_peered":"2024-02-16T10:33:05.205255+0000","last_clean":"2024-02-16T10:33:05.205255+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:33:05.205255+0000","last_undegraded":"2024-02-16T10:33:05.205255+0000","last_fullsized":"2024-02-16T10:33:05.205255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:39.392051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.677808+0000","last_change":"2024-02-16T10:32:37.677881+0000","last_active":"2024-02-16T10:32:37.677808+0000","last_peered":"2024-02-16T10:32:37.677808+0000","last_clean":"2024-02-16T10:32:37.677808+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:32:37.677808+0000","last_undegraded":"2024-02-16T10:32:37.677808+0000","last_fullsized":"2024-02-16T10:32:37.677808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.677622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:43.521167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.315982+0000","last_change":"2024-02-16T10:32:59.316060+0000","last_active":"2024-02-16T10:32:59.315982+0000","last_peered":"2024-02-16T10:32:59.315982+0000","last_clean":"2024-02-16T10:32:59.315982+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:32:59.315982+0000","last_undegraded":"2024-02-16T10:32:59.315982+0000","last_fullsized":"2024-02-16T10:32:59.315982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.315796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:07.517582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.299862+0000","last_change":"2024-02-16T10:32:56.299931+0000","last_active":"2024-02-16T10:32:56.299862+0000","last_peered":"2024-02-16T10:32:56.299862+0000","last_clean":"2024-02-16T10:32:56.299862+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:32:56.299862+0000","last_undegraded":"2024-02-16T10:32:56.299862+0000","last_fullsized":"2024-02-16T10:32:56.299862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.299671+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:59.215228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.641025+0000","last_change":"2024-02-16T10:33:05.641087+0000","last_active":"2024-02-16T10:33:05.641025+0000","last_peered":"2024-02-16T10:33:05.641025+0000","last_clean":"2024-02-16T10:33:05.641025+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:33:05.641025+0000","last_undegraded":"2024-02-16T10:33:05.641025+0000","last_fullsized":"2024-02-16T10:33:05.641025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.640833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:20.797119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.246185+0000","last_change":"2024-02-16T10:32:41.246185+0000","last_active":"2024-02-16T10:32:41.246185+0000","last_peered":"2024-02-16T10:32:41.246185+0000","last_clean":"2024-02-16T10:32:41.246185+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:32:41.246185+0000","last_undegraded":"2024-02-16T10:32:41.246185+0000","last_fullsized":"2024-02-16T10:32:41.246185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.245938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:09.620425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608529+0000","last_change":"2024-02-16T10:30:26.087837+0000","last_active":"2024-02-16T10:32:13.608529+0000","last_peered":"2024-02-16T10:32:13.608529+0000","last_clean":"2024-02-16T10:32:13.608529+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:32:13.608529+0000","last_undegraded":"2024-02-16T10:32:13.608529+0000","last_fullsized":"2024-02-16T10:32:13.608529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.952981+0000","last_change":"2024-02-16T10:32:47.952981+0000","last_active":"2024-02-16T10:32:47.952981+0000","last_peered":"2024-02-16T10:32:47.952981+0000","last_clean":"2024-02-16T10:32:47.952981+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:47.952981+0000","last_undegraded":"2024-02-16T10:32:47.952981+0000","last_fullsized":"2024-02-16T10:32:47.952981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.952562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:39.742244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.575826+0000","last_change":"2024-02-16T10:32:45.575891+0000","last_active":"2024-02-16T10:32:45.575826+0000","last_peered":"2024-02-16T10:32:45.575826+0000","last_clean":"2024-02-16T10:32:45.575826+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:32:45.575826+0000","last_undegraded":"2024-02-16T10:32:45.575826+0000","last_fullsized":"2024-02-16T10:32:45.575826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.575628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:23:09.375444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.598992+0000","last_change":"2024-02-16T10:32:44.598992+0000","last_active":"2024-02-16T10:32:44.598992+0000","last_peered":"2024-02-16T10:32:44.598992+0000","last_clean":"2024-02-16T10:32:44.598992+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:32:44.598992+0000","last_undegraded":"2024-02-16T10:32:44.598992+0000","last_fullsized":"2024-02-16T10:32:44.598992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.598712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:57.295017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.202881+0000","last_change":"2024-02-16T10:32:59.202949+0000","last_active":"2024-02-16T10:32:59.202881+0000","last_peered":"2024-02-16T10:32:59.202881+0000","last_clean":"2024-02-16T10:32:59.202881+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:32:59.202881+0000","last_undegraded":"2024-02-16T10:32:59.202881+0000","last_fullsized":"2024-02-16T10:32:59.202881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.202685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:45.027138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.214931+0000","last_change":"2024-02-16T10:32:52.214993+0000","last_active":"2024-02-16T10:32:52.214931+0000","last_peered":"2024-02-16T10:32:52.214931+0000","last_clean":"2024-02-16T10:32:52.214931+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:32:52.214931+0000","last_undegraded":"2024-02-16T10:32:52.214931+0000","last_fullsized":"2024-02-16T10:32:52.214931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.214700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:00.416486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.225619+0000","last_change":"2024-02-16T10:33:04.225678+0000","last_active":"2024-02-16T10:33:04.225619+0000","last_peered":"2024-02-16T10:33:04.225619+0000","last_clean":"2024-02-16T10:33:04.225619+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:33:04.225619+0000","last_undegraded":"2024-02-16T10:33:04.225619+0000","last_fullsized":"2024-02-16T10:33:04.225619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.225415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:09.053096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.293261+0000","last_change":"2024-02-16T10:32:45.293261+0000","last_active":"2024-02-16T10:32:45.293261+0000","last_peered":"2024-02-16T10:32:45.293261+0000","last_clean":"2024-02-16T10:32:45.293261+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:32:45.293261+0000","last_undegraded":"2024-02-16T10:32:45.293261+0000","last_fullsized":"2024-02-16T10:32:45.293261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.293004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:04.774717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608443+0000","last_change":"2024-02-16T10:30:26.068968+0000","last_active":"2024-02-16T10:32:13.608443+0000","last_peered":"2024-02-16T10:32:13.608443+0000","last_clean":"2024-02-16T10:32:13.608443+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:32:13.608443+0000","last_undegraded":"2024-02-16T10:32:13.608443+0000","last_fullsized":"2024-02-16T10:32:13.608443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.239268+0000","last_change":"2024-02-16T10:32:58.239330+0000","last_active":"2024-02-16T10:32:58.239268+0000","last_peered":"2024-02-16T10:32:58.239268+0000","last_clean":"2024-02-16T10:32:58.239268+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:32:58.239268+0000","last_undegraded":"2024-02-16T10:32:58.239268+0000","last_fullsized":"2024-02-16T10:32:58.239268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.239053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:24.581773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608714+0000","last_change":"2024-02-16T10:30:26.068517+0000","last_active":"2024-02-16T10:32:13.608714+0000","last_peered":"2024-02-16T10:32:13.608714+0000","last_clean":"2024-02-16T10:32:13.608714+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:32:13.608714+0000","last_undegraded":"2024-02-16T10:32:13.608714+0000","last_fullsized":"2024-02-16T10:32:13.608714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.834500+0000","last_change":"2024-02-16T10:32:25.834500+0000","last_active":"2024-02-16T10:32:25.834500+0000","last_peered":"2024-02-16T10:32:25.834500+0000","last_clean":"2024-02-16T10:32:25.834500+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:25.834500+0000","last_undegraded":"2024-02-16T10:32:25.834500+0000","last_fullsized":"2024-02-16T10:32:25.834500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.834247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:24.022521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.284240+0000","last_change":"2024-02-16T10:32:49.284313+0000","last_active":"2024-02-16T10:32:49.284240+0000","last_peered":"2024-02-16T10:32:49.284240+0000","last_clean":"2024-02-16T10:32:49.284240+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:32:49.284240+0000","last_undegraded":"2024-02-16T10:32:49.284240+0000","last_fullsized":"2024-02-16T10:32:49.284240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.284010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:24.829083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.208137+0000","last_change":"2024-02-16T10:32:50.208221+0000","last_active":"2024-02-16T10:32:50.208137+0000","last_peered":"2024-02-16T10:32:50.208137+0000","last_clean":"2024-02-16T10:32:50.208137+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:32:50.208137+0000","last_undegraded":"2024-02-16T10:32:50.208137+0000","last_fullsized":"2024-02-16T10:32:50.208137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.207953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:47.225247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608743+0000","last_change":"2024-02-16T10:30:26.068944+0000","last_active":"2024-02-16T10:32:13.608743+0000","last_peered":"2024-02-16T10:32:13.608743+0000","last_clean":"2024-02-16T10:32:13.608743+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:32:13.608743+0000","last_undegraded":"2024-02-16T10:32:13.608743+0000","last_fullsized":"2024-02-16T10:32:13.608743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.177112+0000","last_change":"2024-02-16T10:33:07.177182+0000","last_active":"2024-02-16T10:33:07.177112+0000","last_peered":"2024-02-16T10:33:07.177112+0000","last_clean":"2024-02-16T10:33:07.177112+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:33:07.177112+0000","last_undegraded":"2024-02-16T10:33:07.177112+0000","last_fullsized":"2024-02-16T10:33:07.177112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.176913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:41.892085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.631778+0000","last_change":"2024-02-16T10:32:39.631778+0000","last_active":"2024-02-16T10:32:39.631778+0000","last_peered":"2024-02-16T10:32:39.631778+0000","last_clean":"2024-02-16T10:32:39.631778+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:32:39.631778+0000","last_undegraded":"2024-02-16T10:32:39.631778+0000","last_fullsized":"2024-02-16T10:32:39.631778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.631520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:18:00.127318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.564996+0000","last_change":"2024-02-16T10:32:43.564996+0000","last_active":"2024-02-16T10:32:43.564996+0000","last_peered":"2024-02-16T10:32:43.564996+0000","last_clean":"2024-02-16T10:32:43.564996+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:32:43.564996+0000","last_undegraded":"2024-02-16T10:32:43.564996+0000","last_fullsized":"2024-02-16T10:32:43.564996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.564745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:47.346981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.670970+0000","last_change":"2024-02-16T10:31:06.937850+0000","last_active":"2024-02-16T10:32:12.670970+0000","last_peered":"2024-02-16T10:32:12.670970+0000","last_clean":"2024-02-16T10:32:12.670970+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:32:12.670970+0000","last_undegraded":"2024-02-16T10:32:12.670970+0000","last_fullsized":"2024-02-16T10:32:12.670970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:27.029541+0000","last_clean_scrub_stamp":"2024-02-16T10:30:27.029541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705703,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84399999999999997,"5min":1.268,"15min":1.268},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.77800000000000002,"5min":1.139,"15min":1.139},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.79200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:32:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82199999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.627}]}]},{"osd":2,"up_from":9,"seq":38654705705,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.92900000000000005,"15min":0.97499999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77000000000000002,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80400000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.4239999999999999,"15min":1.5660000000000001},"min":{"1min":0.29999999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.78900000000000003,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.71299999999999997,"5min":0.873,"15min":0.873},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Feb 16 10:32:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.751,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.2470000000000001,"15min":1.343},"min":{"1min":0.35199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.83899999999999997,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.73599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705705,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70099999999999996,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78000000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.81699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.42299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.75600000000000001,"5min":1.022,"15min":1.022},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78700000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.43099999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.72999999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.92000000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.65700000000000003},"min":{"1min":0.58299999999999996,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88900000000000001,"5min":1.115,"15min":1.115},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Feb 16 10:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:33:15.269 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.269 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.270 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.270 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.270 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.270 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.271 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.271 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.271 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.271 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.272 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.272 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.272 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.272 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.273 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.273 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.273 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.273 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.274 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.274 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.274 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-16T10:30:16.986154+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=16, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.275 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.275 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.275 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.275 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.276 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.276 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.276 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.276 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.277 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.277 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.277 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.277 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.278 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.278 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.278 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-02-16T10:30:27.029541+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:15.278 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:33:35.279 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:33:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f365d400640 1 Processor -- start 2024-02-16T10:33:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f365d400640 1 -- start start 2024-02-16T10:33:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f365d400640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f365812ef80 0x7f3658131370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f365d400640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3658072450 con 0x7f365806f8b0 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f365d400640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365812bed0 con 0x7f365812ef80 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f36567fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f365812ef80 0x7f3658131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3656ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f365806f8b0 0x7f365812c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36492/0 (socket says 172.21.15.107:36492) 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3656ffd640 1 -- 172.21.15.107:0/3087706161 learned_addr learned my addr 172.21.15.107:0/3087706161 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f36567fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f365812ef80 0x7f3658131370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44644/0 (socket says 172.21.15.107:44644) 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f36567fc640 1 -- 172.21.15.107:0/3087706161 >> v1:172.21.15.107:6789/0 conn(0x7f365806f8b0 legacy=0x7f365812c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f36567fc640 1 -- 172.21.15.107:0/3087706161 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658112bd0 con 0x7f365812ef80 2024-02-16T10:33:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3655ffb640 1 -- 172.21.15.107:0/3087706161 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915231536 0 0) 0x7f3658072450 con 0x7f365806f8b0 2024-02-16T10:33:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f36567fc640 1 --2- 172.21.15.107:0/3087706161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365812ef80 0x7f3658131370 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3640009d90 tx=0x7f364001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f836357b7dc9b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3655ffb640 1 -- 172.21.15.107:0/3087706161 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36400a6640 con 0x7f365812ef80 2024-02-16T10:33:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3655ffb640 1 -- 172.21.15.107:0/3087706161 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400a67a0 con 0x7f365812ef80 2024-02-16T10:33:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.401+0000 7f3655ffb640 1 -- 172.21.15.107:0/3087706161 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36400a6a60 con 0x7f365812ef80 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/3087706161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365812ef80 msgr2=0x7f3658131370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 --2- 172.21.15.107:0/3087706161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365812ef80 0x7f3658131370 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3640009d90 tx=0x7f364001c8c0 comp rx=0 tx=0).stop 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/3087706161 shutdown_connections 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 --2- 172.21.15.107:0/3087706161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365812ef80 0x7f3658131370 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/3087706161 >> 172.21.15.107:0/3087706161 conn(0x7f365809a1c0 msgr2=0x7f365809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/3087706161 shutdown_connections 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/3087706161 wait complete. 2024-02-16T10:33:35.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 Processor -- start 2024-02-16T10:33:35.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- start start 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658125010 con 0x7f365806f8b0 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f3656ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f3656ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44654/0 (socket says 172.21.15.107:44654) 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f3656ffd640 1 -- 172.21.15.107:0/1296162833 learned_addr learned my addr 172.21.15.107:0/1296162833 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f3656ffd640 1 -- 172.21.15.107:0/1296162833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009a70 con 0x7f365806f8b0 2024-02-16T10:33:35.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f3656ffd640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f365000c420 tx=0x7f365000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36500074d0 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650007630 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3658125540 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3650004960 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3658124400 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f3650004ac0 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36581241a0 con 0x7f365806f8b0 2024-02-16T10:33:35.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 0x7f3638037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.405+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f3650047dd0 con 0x7f365806f8b0 2024-02-16T10:33:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.409+0000 7f36567fc640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 0x7f3638037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:35.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.409+0000 7f36567fc640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 0x7f3638037ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36400af000 tx=0x7f36400a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:35.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.413+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f365001ad70 con 0x7f365806f8b0 2024-02-16T10:33:35.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.557+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f365812cb30 con 0x7f3638035a10 2024-02-16T10:33:35.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.605+0000 7f364f7fe640 1 -- 172.21.15.107:0/1296162833 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673887 (secure 0 0 0) 0x7f36400be090 con 0x7f3638035a10 2024-02-16T10:33:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:33:35.625 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 msgr2=0x7f3638037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 0x7f3638037ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f36400af000 tx=0x7f36400a7000 comp rx=0 tx=0).stop 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 msgr2=0x7f3658122340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f365000c420 tx=0x7f365000c8e0 comp rx=0 tx=0).stop 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 shutdown_connections 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f3638035a10 0x7f3638037ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:35.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 --2- 172.21.15.107:0/1296162833 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f365806f8b0 0x7f3658122340 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 >> 172.21.15.107:0/1296162833 conn(0x7f365809a1c0 msgr2=0x7f365812f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 shutdown_connections 2024-02-16T10:33:35.628 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:35.609+0000 7f365d400640 1 -- 172.21.15.107:0/1296162833 wait complete. 2024-02-16T10:33:35.638 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-02-16T10:33:33.905895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2054,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007115"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.286924+0000","last_change":"2024-02-16T10:32:51.287001+0000","last_active":"2024-02-16T10:32:51.286924+0000","last_peered":"2024-02-16T10:32:51.286924+0000","last_clean":"2024-02-16T10:32:51.286924+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:32:51.286924+0000","last_undegraded":"2024-02-16T10:32:51.286924+0000","last_fullsized":"2024-02-16T10:32:51.286924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.286736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:29.643046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.252936+0000","last_change":"2024-02-16T10:32:46.252936+0000","last_active":"2024-02-16T10:32:46.252936+0000","last_peered":"2024-02-16T10:32:46.252936+0000","last_clean":"2024-02-16T10:32:46.252936+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:32:46.252936+0000","last_undegraded":"2024-02-16T10:32:46.252936+0000","last_fullsized":"2024-02-16T10:32:46.252936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.252657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:46.929942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.621221+0000","last_change":"2024-02-16T10:33:03.621303+0000","last_active":"2024-02-16T10:33:03.621221+0000","last_peered":"2024-02-16T10:33:03.621221+0000","last_clean":"2024-02-16T10:33:03.621221+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:33:03.621221+0000","last_undegraded":"2024-02-16T10:33:03.621221+0000","last_fullsized":"2024-02-16T10:33:03.621221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.621029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:54.673180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.055307+0000","last_change":"2024-02-16T10:33:02.055365+0000","last_active":"2024-02-16T10:33:02.055307+0000","last_peered":"2024-02-16T10:33:02.055307+0000","last_clean":"2024-02-16T10:33:02.055307+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:33:02.055307+0000","last_undegraded":"2024-02-16T10:33:02.055307+0000","last_fullsized":"2024-02-16T10:33:02.055307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.055114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:47:50.528621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:16.116215+0000","last_change":"2024-02-16T10:33:16.116374+0000","last_active":"2024-02-16T10:33:16.116215+0000","last_peered":"2024-02-16T10:33:16.116215+0000","last_clean":"2024-02-16T10:33:16.116215+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:33:16.116215+0000","last_undegraded":"2024-02-16T10:33:16.116215+0000","last_fullsized":"2024-02-16T10:33:16.116215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:16.115973+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:16.115973+0000","last_clean_scrub_stamp":"2024-02-16T10:33:16.115973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:41.769581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.003805+0000","last_change":"2024-02-16T10:32:59.003805+0000","last_active":"2024-02-16T10:32:59.003805+0000","last_peered":"2024-02-16T10:32:59.003805+0000","last_clean":"2024-02-16T10:32:59.003805+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:32:59.003805+0000","last_undegraded":"2024-02-16T10:32:59.003805+0000","last_fullsized":"2024-02-16T10:32:59.003805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.003421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:59.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.297606+0000","last_change":"2024-02-16T10:32:53.297683+0000","last_active":"2024-02-16T10:32:53.297606+0000","last_peered":"2024-02-16T10:32:53.297606+0000","last_clean":"2024-02-16T10:32:53.297606+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:32:53.297606+0000","last_undegraded":"2024-02-16T10:32:53.297606+0000","last_fullsized":"2024-02-16T10:32:53.297606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.297394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:53.974678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.986589+0000","last_change":"2024-02-16T10:32:57.986589+0000","last_active":"2024-02-16T10:32:57.986589+0000","last_peered":"2024-02-16T10:32:57.986589+0000","last_clean":"2024-02-16T10:32:57.986589+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:32:57.986589+0000","last_undegraded":"2024-02-16T10:32:57.986589+0000","last_fullsized":"2024-02-16T10:32:57.986589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.986335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:45.120448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:29.998372+0000","last_change":"2024-02-16T10:33:29.998539+0000","last_active":"2024-02-16T10:33:29.998372+0000","last_peered":"2024-02-16T10:33:29.998372+0000","last_clean":"2024-02-16T10:33:29.998372+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:33:29.998372+0000","last_undegraded":"2024-02-16T10:33:29.998372+0000","last_fullsized":"2024-02-16T10:33:29.998372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:33:29.998096+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:33:29.998096+0000","last_clean_scrub_stamp":"2024-02-16T10:33:29.998096+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:18:59.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.266000+0000","last_change":"2024-02-16T10:32:43.266072+0000","last_active":"2024-02-16T10:32:43.266000+0000","last_peered":"2024-02-16T10:32:43.266000+0000","last_clean":"2024-02-16T10:32:43.266000+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:43.266000+0000","last_undegraded":"2024-02-16T10:32:43.266000+0000","last_fullsized":"2024-02-16T10:32:43.266000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.265822+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:11.123964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.300998+0000","last_change":"2024-02-16T10:32:54.300998+0000","last_active":"2024-02-16T10:32:54.300998+0000","last_peered":"2024-02-16T10:32:54.300998+0000","last_clean":"2024-02-16T10:32:54.300998+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:32:54.300998+0000","last_undegraded":"2024-02-16T10:32:54.300998+0000","last_fullsized":"2024-02-16T10:32:54.300998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.300740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:06.997045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.953068+0000","last_change":"2024-02-16T10:32:31.953068+0000","last_active":"2024-02-16T10:32:31.953068+0000","last_peered":"2024-02-16T10:32:31.953068+0000","last_clean":"2024-02-16T10:32:31.953068+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:32:31.953068+0000","last_undegraded":"2024-02-16T10:32:31.953068+0000","last_fullsized":"2024-02-16T10:32:31.953068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.952772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:14.372551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.091844+0000","last_change":"2024-02-16T10:33:03.091915+0000","last_active":"2024-02-16T10:33:03.091844+0000","last_peered":"2024-02-16T10:33:03.091844+0000","last_clean":"2024-02-16T10:33:03.091844+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:33:03.091844+0000","last_undegraded":"2024-02-16T10:33:03.091844+0000","last_fullsized":"2024-02-16T10:33:03.091844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.091594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:02.360828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.337640+0000","last_change":"2024-02-16T10:32:35.337640+0000","last_active":"2024-02-16T10:32:35.337640+0000","last_peered":"2024-02-16T10:32:35.337640+0000","last_clean":"2024-02-16T10:32:35.337640+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:32:35.337640+0000","last_undegraded":"2024-02-16T10:32:35.337640+0000","last_fullsized":"2024-02-16T10:32:35.337640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.337391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:00.524461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.625149+0000","last_change":"2024-02-16T10:33:04.625313+0000","last_active":"2024-02-16T10:33:04.625149+0000","last_peered":"2024-02-16T10:33:04.625149+0000","last_clean":"2024-02-16T10:33:04.625149+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:33:04.625149+0000","last_undegraded":"2024-02-16T10:33:04.625149+0000","last_fullsized":"2024-02-16T10:33:04.625149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.624916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:59.652953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.340659+0000","last_change":"2024-02-16T10:32:38.340723+0000","last_active":"2024-02-16T10:32:38.340659+0000","last_peered":"2024-02-16T10:32:38.340659+0000","last_clean":"2024-02-16T10:32:38.340659+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:32:38.340659+0000","last_undegraded":"2024-02-16T10:32:38.340659+0000","last_fullsized":"2024-02-16T10:32:38.340659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.340456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:20.043427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.032266+0000","last_change":"2024-02-16T10:33:00.032324+0000","last_active":"2024-02-16T10:33:00.032266+0000","last_peered":"2024-02-16T10:33:00.032266+0000","last_clean":"2024-02-16T10:33:00.032266+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:33:00.032266+0000","last_undegraded":"2024-02-16T10:33:00.032266+0000","last_fullsized":"2024-02-16T10:33:00.032266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.031986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:09.549907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.250297+0000","last_change":"2024-02-16T10:32:49.250297+0000","last_active":"2024-02-16T10:32:49.250297+0000","last_peered":"2024-02-16T10:32:49.250297+0000","last_clean":"2024-02-16T10:32:49.250297+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:32:49.250297+0000","last_undegraded":"2024-02-16T10:32:49.250297+0000","last_fullsized":"2024-02-16T10:32:49.250297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:50.603059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.176433+0000","last_change":"2024-02-16T10:32:37.176433+0000","last_active":"2024-02-16T10:32:37.176433+0000","last_peered":"2024-02-16T10:32:37.176433+0000","last_clean":"2024-02-16T10:32:37.176433+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:32:37.176433+0000","last_undegraded":"2024-02-16T10:32:37.176433+0000","last_fullsized":"2024-02-16T10:32:37.176433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.176164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:03.368447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.273865+0000","last_change":"2024-02-16T10:32:43.273865+0000","last_active":"2024-02-16T10:32:43.273865+0000","last_peered":"2024-02-16T10:32:43.273865+0000","last_clean":"2024-02-16T10:32:43.273865+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:43.273865+0000","last_undegraded":"2024-02-16T10:32:43.273865+0000","last_fullsized":"2024-02-16T10:32:43.273865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.273587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:18.563027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.240319+0000","last_change":"2024-02-16T10:32:40.240319+0000","last_active":"2024-02-16T10:32:40.240319+0000","last_peered":"2024-02-16T10:32:40.240319+0000","last_clean":"2024-02-16T10:32:40.240319+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:32:40.240319+0000","last_undegraded":"2024-02-16T10:32:40.240319+0000","last_fullsized":"2024-02-16T10:32:40.240319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.239977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:18.554745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.263487+0000","last_change":"2024-02-16T10:33:07.263547+0000","last_active":"2024-02-16T10:33:07.263487+0000","last_peered":"2024-02-16T10:33:07.263487+0000","last_clean":"2024-02-16T10:33:07.263487+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:33:07.263487+0000","last_undegraded":"2024-02-16T10:33:07.263487+0000","last_fullsized":"2024-02-16T10:33:07.263487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.263284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:58.315436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.593305+0000","last_change":"2024-02-16T10:32:46.593305+0000","last_active":"2024-02-16T10:32:46.593305+0000","last_peered":"2024-02-16T10:32:46.593305+0000","last_clean":"2024-02-16T10:32:46.593305+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:32:46.593305+0000","last_undegraded":"2024-02-16T10:32:46.593305+0000","last_fullsized":"2024-02-16T10:32:46.593305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.593037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:59:45.718528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.193382+0000","last_change":"2024-02-16T10:32:51.193449+0000","last_active":"2024-02-16T10:32:51.193382+0000","last_peered":"2024-02-16T10:32:51.193382+0000","last_clean":"2024-02-16T10:32:51.193382+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:32:51.193382+0000","last_undegraded":"2024-02-16T10:32:51.193382+0000","last_fullsized":"2024-02-16T10:32:51.193382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.193190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:27.003267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.354961+0000","last_change":"2024-02-16T10:33:00.355034+0000","last_active":"2024-02-16T10:33:00.354961+0000","last_peered":"2024-02-16T10:33:00.354961+0000","last_clean":"2024-02-16T10:33:00.354961+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:33:00.354961+0000","last_undegraded":"2024-02-16T10:33:00.354961+0000","last_fullsized":"2024-02-16T10:33:00.354961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.354775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:31.134954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.595681+0000","last_change":"2024-02-16T10:32:53.595817+0000","last_active":"2024-02-16T10:32:53.595681+0000","last_peered":"2024-02-16T10:32:53.595681+0000","last_clean":"2024-02-16T10:32:53.595681+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:32:53.595681+0000","last_undegraded":"2024-02-16T10:32:53.595681+0000","last_fullsized":"2024-02-16T10:32:53.595681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.595459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:21.588183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.224650+0000","last_change":"2024-02-16T10:32:39.224650+0000","last_active":"2024-02-16T10:32:39.224650+0000","last_peered":"2024-02-16T10:32:39.224650+0000","last_clean":"2024-02-16T10:32:39.224650+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:32:39.224650+0000","last_undegraded":"2024-02-16T10:32:39.224650+0000","last_fullsized":"2024-02-16T10:32:39.224650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.224377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:54.677431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:28.981765+0000","last_change":"2024-02-16T10:33:28.981830+0000","last_active":"2024-02-16T10:33:28.981765+0000","last_peered":"2024-02-16T10:33:28.981765+0000","last_clean":"2024-02-16T10:33:28.981765+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:33:28.981765+0000","last_undegraded":"2024-02-16T10:33:28.981765+0000","last_fullsized":"2024-02-16T10:33:28.981765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:28.981556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:28.981556+0000","last_clean_scrub_stamp":"2024-02-16T10:33:28.981556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:16.551230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.249451+0000","last_change":"2024-02-16T10:32:42.249451+0000","last_active":"2024-02-16T10:32:42.249451+0000","last_peered":"2024-02-16T10:32:42.249451+0000","last_clean":"2024-02-16T10:32:42.249451+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:42.249451+0000","last_undegraded":"2024-02-16T10:32:42.249451+0000","last_fullsized":"2024-02-16T10:32:42.249451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.249133+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:17.794206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.013994+0000","last_change":"2024-02-16T10:32:55.014055+0000","last_active":"2024-02-16T10:32:55.013994+0000","last_peered":"2024-02-16T10:32:55.013994+0000","last_clean":"2024-02-16T10:32:55.013994+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:32:55.013994+0000","last_undegraded":"2024-02-16T10:32:55.013994+0000","last_fullsized":"2024-02-16T10:32:55.013994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.013774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:43:39.758624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.115174+0000","last_change":"2024-02-16T10:33:12.115247+0000","last_active":"2024-02-16T10:33:12.115174+0000","last_peered":"2024-02-16T10:33:12.115174+0000","last_clean":"2024-02-16T10:33:12.115174+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:33:12.115174+0000","last_undegraded":"2024-02-16T10:33:12.115174+0000","last_fullsized":"2024-02-16T10:33:12.115174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:12.114964+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:12.114964+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.114964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:14.461557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.609800+0000","last_change":"2024-02-16T10:31:06.938309+0000","last_active":"2024-02-16T10:32:13.609800+0000","last_peered":"2024-02-16T10:32:13.609800+0000","last_clean":"2024-02-16T10:32:13.609800+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:32:13.609800+0000","last_undegraded":"2024-02-16T10:32:13.609800+0000","last_fullsized":"2024-02-16T10:32:13.609800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:29.041869+0000","last_clean_scrub_stamp":"2024-02-16T10:30:29.041869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.978713+0000","last_change":"2024-02-16T10:32:32.978713+0000","last_active":"2024-02-16T10:32:32.978713+0000","last_peered":"2024-02-16T10:32:32.978713+0000","last_clean":"2024-02-16T10:32:32.978713+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:32.978713+0000","last_undegraded":"2024-02-16T10:32:32.978713+0000","last_fullsized":"2024-02-16T10:32:32.978713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.978443+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:07.123372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.263617+0000","last_change":"2024-02-16T10:32:26.263617+0000","last_active":"2024-02-16T10:32:26.263617+0000","last_peered":"2024-02-16T10:32:26.263617+0000","last_clean":"2024-02-16T10:32:26.263617+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:32:26.263617+0000","last_undegraded":"2024-02-16T10:32:26.263617+0000","last_fullsized":"2024-02-16T10:32:26.263617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.263353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:40.727544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.203597+0000","last_change":"2024-02-16T10:33:12.203657+0000","last_active":"2024-02-16T10:33:12.203597+0000","last_peered":"2024-02-16T10:33:12.203597+0000","last_clean":"2024-02-16T10:33:12.203597+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:33:12.203597+0000","last_undegraded":"2024-02-16T10:33:12.203597+0000","last_fullsized":"2024-02-16T10:33:12.203597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:12.203402+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:12.203402+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.203402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:41.688818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.341417+0000","last_change":"2024-02-16T10:33:07.341484+0000","last_active":"2024-02-16T10:33:07.341417+0000","last_peered":"2024-02-16T10:33:07.341417+0000","last_clean":"2024-02-16T10:33:07.341417+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:33:07.341417+0000","last_undegraded":"2024-02-16T10:33:07.341417+0000","last_fullsized":"2024-02-16T10:33:07.341417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.341236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:08.832698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.337168+0000","last_change":"2024-02-16T10:32:55.337229+0000","last_active":"2024-02-16T10:32:55.337168+0000","last_peered":"2024-02-16T10:32:55.337168+0000","last_clean":"2024-02-16T10:32:55.337168+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:32:55.337168+0000","last_undegraded":"2024-02-16T10:32:55.337168+0000","last_fullsized":"2024-02-16T10:32:55.337168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.336944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:53.525218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:14.173480+0000","last_change":"2024-02-16T10:33:14.173480+0000","last_active":"2024-02-16T10:33:14.173480+0000","last_peered":"2024-02-16T10:33:14.173480+0000","last_clean":"2024-02-16T10:33:14.173480+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:33:14.173480+0000","last_undegraded":"2024-02-16T10:33:14.173480+0000","last_fullsized":"2024-02-16T10:33:14.173480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:14.173244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:14.173244+0000","last_clean_scrub_stamp":"2024-02-16T10:33:14.173244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:37.595191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.304935+0000","last_change":"2024-02-16T10:32:16.304935+0000","last_active":"2024-02-16T10:32:16.304935+0000","last_peered":"2024-02-16T10:32:16.304935+0000","last_clean":"2024-02-16T10:32:16.304935+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:32:16.304935+0000","last_undegraded":"2024-02-16T10:32:16.304935+0000","last_fullsized":"2024-02-16T10:32:16.304935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.304645+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:45.895015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.217226+0000","last_change":"2024-02-16T10:32:30.217226+0000","last_active":"2024-02-16T10:32:30.217226+0000","last_peered":"2024-02-16T10:32:30.217226+0000","last_clean":"2024-02-16T10:32:30.217226+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:32:30.217226+0000","last_undegraded":"2024-02-16T10:32:30.217226+0000","last_fullsized":"2024-02-16T10:32:30.217226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.216971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:22.338282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.648137+0000","last_change":"2024-02-16T10:33:11.648303+0000","last_active":"2024-02-16T10:33:11.648137+0000","last_peered":"2024-02-16T10:33:11.648137+0000","last_clean":"2024-02-16T10:33:11.648137+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:33:11.648137+0000","last_undegraded":"2024-02-16T10:33:11.648137+0000","last_fullsized":"2024-02-16T10:33:11.648137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:11.647914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:11.647914+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.647914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:43.754736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.975475+0000","last_change":"2024-02-16T10:32:51.975475+0000","last_active":"2024-02-16T10:32:51.975475+0000","last_peered":"2024-02-16T10:32:51.975475+0000","last_clean":"2024-02-16T10:32:51.975475+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:51.975475+0000","last_undegraded":"2024-02-16T10:32:51.975475+0000","last_fullsized":"2024-02-16T10:32:51.975475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.975220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:24.082042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:19.063296+0000","last_change":"2024-02-16T10:33:19.063363+0000","last_active":"2024-02-16T10:33:19.063296+0000","last_peered":"2024-02-16T10:33:19.063296+0000","last_clean":"2024-02-16T10:33:19.063296+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:33:19.063296+0000","last_undegraded":"2024-02-16T10:33:19.063296+0000","last_fullsized":"2024-02-16T10:33:19.063296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:19.063078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:19.063078+0000","last_clean_scrub_stamp":"2024-02-16T10:33:19.063078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:00.965928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.731408+0000","last_change":"2024-02-16T10:32:31.731408+0000","last_active":"2024-02-16T10:32:31.731408+0000","last_peered":"2024-02-16T10:32:31.731408+0000","last_clean":"2024-02-16T10:32:31.731408+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:32:31.731408+0000","last_undegraded":"2024-02-16T10:32:31.731408+0000","last_fullsized":"2024-02-16T10:32:31.731408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.731089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:38.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.284906+0000","last_change":"2024-02-16T10:32:19.284906+0000","last_active":"2024-02-16T10:32:19.284906+0000","last_peered":"2024-02-16T10:32:19.284906+0000","last_clean":"2024-02-16T10:32:19.284906+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:32:19.284906+0000","last_undegraded":"2024-02-16T10:32:19.284906+0000","last_fullsized":"2024-02-16T10:32:19.284906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.284625+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:24.273342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.940256+0000","last_change":"2024-02-16T10:32:40.940256+0000","last_active":"2024-02-16T10:32:40.940256+0000","last_peered":"2024-02-16T10:32:40.940256+0000","last_clean":"2024-02-16T10:32:40.940256+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:40.940256+0000","last_undegraded":"2024-02-16T10:32:40.940256+0000","last_fullsized":"2024-02-16T10:32:40.940256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.939974+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:39.316923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.379056+0000","last_change":"2024-02-16T10:32:34.379056+0000","last_active":"2024-02-16T10:32:34.379056+0000","last_peered":"2024-02-16T10:32:34.379056+0000","last_clean":"2024-02-16T10:32:34.379056+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:32:34.379056+0000","last_undegraded":"2024-02-16T10:32:34.379056+0000","last_fullsized":"2024-02-16T10:32:34.379056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.378676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:48.842868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.644457+0000","last_change":"2024-02-16T10:32:38.644457+0000","last_active":"2024-02-16T10:32:38.644457+0000","last_peered":"2024-02-16T10:32:38.644457+0000","last_clean":"2024-02-16T10:32:38.644457+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:38.644457+0000","last_undegraded":"2024-02-16T10:32:38.644457+0000","last_fullsized":"2024-02-16T10:32:38.644457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.644187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:07.018674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.216949+0000","last_change":"2024-02-16T10:33:01.217013+0000","last_active":"2024-02-16T10:33:01.216949+0000","last_peered":"2024-02-16T10:33:01.216949+0000","last_clean":"2024-02-16T10:33:01.216949+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:33:01.216949+0000","last_undegraded":"2024-02-16T10:33:01.216949+0000","last_fullsized":"2024-02-16T10:33:01.216949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.216732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:27.927734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.781557+0000","last_change":"2024-02-16T10:32:15.781557+0000","last_active":"2024-02-16T10:32:15.781557+0000","last_peered":"2024-02-16T10:32:15.781557+0000","last_clean":"2024-02-16T10:32:15.781557+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:32:15.781557+0000","last_undegraded":"2024-02-16T10:32:15.781557+0000","last_fullsized":"2024-02-16T10:32:15.781557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.781303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:34.208301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.238141+0000","last_change":"2024-02-16T10:32:17.238141+0000","last_active":"2024-02-16T10:32:17.238141+0000","last_peered":"2024-02-16T10:32:17.238141+0000","last_clean":"2024-02-16T10:32:17.238141+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:17.238141+0000","last_undegraded":"2024-02-16T10:32:17.238141+0000","last_fullsized":"2024-02-16T10:32:17.238141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.237729+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:01.114959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.449321+0000","last_change":"2024-02-16T10:32:14.449321+0000","last_active":"2024-02-16T10:32:14.449321+0000","last_peered":"2024-02-16T10:32:14.449321+0000","last_clean":"2024-02-16T10:32:14.449321+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:14.449321+0000","last_undegraded":"2024-02-16T10:32:14.449321+0000","last_fullsized":"2024-02-16T10:32:14.449321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.449055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:44.039424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.921754+0000","last_change":"2024-02-16T10:32:46.921910+0000","last_active":"2024-02-16T10:32:46.921754+0000","last_peered":"2024-02-16T10:32:46.921754+0000","last_clean":"2024-02-16T10:32:46.921754+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:32:46.921754+0000","last_undegraded":"2024-02-16T10:32:46.921754+0000","last_fullsized":"2024-02-16T10:32:46.921754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.921537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:02.923520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.268360+0000","last_change":"2024-02-16T10:32:45.268426+0000","last_active":"2024-02-16T10:32:45.268360+0000","last_peered":"2024-02-16T10:32:45.268360+0000","last_clean":"2024-02-16T10:32:45.268360+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:32:45.268360+0000","last_undegraded":"2024-02-16T10:32:45.268360+0000","last_fullsized":"2024-02-16T10:32:45.268360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.268134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:03.695131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.167563+0000","last_change":"2024-02-16T10:32:31.167563+0000","last_active":"2024-02-16T10:32:31.167563+0000","last_peered":"2024-02-16T10:32:31.167563+0000","last_clean":"2024-02-16T10:32:31.167563+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:32:31.167563+0000","last_undegraded":"2024-02-16T10:32:31.167563+0000","last_fullsized":"2024-02-16T10:32:31.167563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.167309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:12.870280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.399916+0000","last_change":"2024-02-16T10:32:23.399916+0000","last_active":"2024-02-16T10:32:23.399916+0000","last_peered":"2024-02-16T10:32:23.399916+0000","last_clean":"2024-02-16T10:32:23.399916+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:23.399916+0000","last_undegraded":"2024-02-16T10:32:23.399916+0000","last_fullsized":"2024-02-16T10:32:23.399916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.399643+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:12.773508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.465612+0000","last_change":"2024-02-16T10:32:16.465612+0000","last_active":"2024-02-16T10:32:16.465612+0000","last_peered":"2024-02-16T10:32:16.465612+0000","last_clean":"2024-02-16T10:32:16.465612+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:32:16.465612+0000","last_undegraded":"2024-02-16T10:32:16.465612+0000","last_fullsized":"2024-02-16T10:32:16.465612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.465378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:49.655775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.393059+0000","last_change":"2024-02-16T10:33:04.393116+0000","last_active":"2024-02-16T10:33:04.393059+0000","last_peered":"2024-02-16T10:33:04.393059+0000","last_clean":"2024-02-16T10:33:04.393059+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:33:04.393059+0000","last_undegraded":"2024-02-16T10:33:04.393059+0000","last_fullsized":"2024-02-16T10:33:04.393059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.392874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:32.385598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.232956+0000","last_change":"2024-02-16T10:32:48.233019+0000","last_active":"2024-02-16T10:32:48.232956+0000","last_peered":"2024-02-16T10:32:48.232956+0000","last_clean":"2024-02-16T10:32:48.232956+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:32:48.232956+0000","last_undegraded":"2024-02-16T10:32:48.232956+0000","last_fullsized":"2024-02-16T10:32:48.232956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.232778+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.274224+0000","last_change":"2024-02-16T10:32:57.274286+0000","last_active":"2024-02-16T10:32:57.274224+0000","last_peered":"2024-02-16T10:32:57.274224+0000","last_clean":"2024-02-16T10:32:57.274224+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:32:57.274224+0000","last_undegraded":"2024-02-16T10:32:57.274224+0000","last_fullsized":"2024-02-16T10:32:57.274224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.274014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:54.291309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.647776+0000","last_change":"2024-02-16T10:32:27.647776+0000","last_active":"2024-02-16T10:32:27.647776+0000","last_peered":"2024-02-16T10:32:27.647776+0000","last_clean":"2024-02-16T10:32:27.647776+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:32:27.647776+0000","last_undegraded":"2024-02-16T10:32:27.647776+0000","last_fullsized":"2024-02-16T10:32:27.647776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.647521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:04.955314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.933959+0000","last_change":"2024-02-16T10:32:28.933959+0000","last_active":"2024-02-16T10:32:28.933959+0000","last_peered":"2024-02-16T10:32:28.933959+0000","last_clean":"2024-02-16T10:32:28.933959+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:28.933959+0000","last_undegraded":"2024-02-16T10:32:28.933959+0000","last_fullsized":"2024-02-16T10:32:28.933959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.933703+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:04.743780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.755709+0000","last_change":"2024-02-16T10:32:32.755709+0000","last_active":"2024-02-16T10:32:32.755709+0000","last_peered":"2024-02-16T10:32:32.755709+0000","last_clean":"2024-02-16T10:32:32.755709+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:32:32.755709+0000","last_undegraded":"2024-02-16T10:32:32.755709+0000","last_fullsized":"2024-02-16T10:32:32.755709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.755469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:24.687565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.201544+0000","last_change":"2024-02-16T10:33:13.201613+0000","last_active":"2024-02-16T10:33:13.201544+0000","last_peered":"2024-02-16T10:33:13.201544+0000","last_clean":"2024-02-16T10:33:13.201544+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:33:13.201544+0000","last_undegraded":"2024-02-16T10:33:13.201544+0000","last_fullsized":"2024-02-16T10:33:13.201544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:13.201355+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:13.201355+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.201355+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:28.511204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.286011+0000","last_change":"2024-02-16T10:32:40.286011+0000","last_active":"2024-02-16T10:32:40.286011+0000","last_peered":"2024-02-16T10:32:40.286011+0000","last_clean":"2024-02-16T10:32:40.286011+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:32:40.286011+0000","last_undegraded":"2024-02-16T10:32:40.286011+0000","last_fullsized":"2024-02-16T10:32:40.286011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.285731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:45.263145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.135108+0000","last_change":"2024-02-16T10:33:11.135166+0000","last_active":"2024-02-16T10:33:11.135108+0000","last_peered":"2024-02-16T10:33:11.135108+0000","last_clean":"2024-02-16T10:33:11.135108+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:33:11.135108+0000","last_undegraded":"2024-02-16T10:33:11.135108+0000","last_fullsized":"2024-02-16T10:33:11.135108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:11.134916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:11.134916+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.134916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:31.680717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.768452+0000","last_change":"2024-02-16T10:32:33.768452+0000","last_active":"2024-02-16T10:32:33.768452+0000","last_peered":"2024-02-16T10:32:33.768452+0000","last_clean":"2024-02-16T10:32:33.768452+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:32:33.768452+0000","last_undegraded":"2024-02-16T10:32:33.768452+0000","last_fullsized":"2024-02-16T10:32:33.768452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.768198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:09.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.803505+0000","last_change":"2024-02-16T10:32:16.803505+0000","last_active":"2024-02-16T10:32:16.803505+0000","last_peered":"2024-02-16T10:32:16.803505+0000","last_clean":"2024-02-16T10:32:16.803505+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:16.803505+0000","last_undegraded":"2024-02-16T10:32:16.803505+0000","last_fullsized":"2024-02-16T10:32:16.803505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.803212+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:32.256266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.644180+0000","last_change":"2024-02-16T10:32:28.644180+0000","last_active":"2024-02-16T10:32:28.644180+0000","last_peered":"2024-02-16T10:32:28.644180+0000","last_clean":"2024-02-16T10:32:28.644180+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:28.644180+0000","last_undegraded":"2024-02-16T10:32:28.644180+0000","last_fullsized":"2024-02-16T10:32:28.644180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.643929+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:10.346900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.658716+0000","last_change":"2024-02-16T10:33:13.658776+0000","last_active":"2024-02-16T10:33:13.658716+0000","last_peered":"2024-02-16T10:33:13.658716+0000","last_clean":"2024-02-16T10:33:13.658716+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:33:13.658716+0000","last_undegraded":"2024-02-16T10:33:13.658716+0000","last_fullsized":"2024-02-16T10:33:13.658716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:13.658522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:13.658522+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.658522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:05.085148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.286063+0000","last_change":"2024-02-16T10:32:46.286129+0000","last_active":"2024-02-16T10:32:46.286063+0000","last_peered":"2024-02-16T10:32:46.286063+0000","last_clean":"2024-02-16T10:32:46.286063+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:32:46.286063+0000","last_undegraded":"2024-02-16T10:32:46.286063+0000","last_fullsized":"2024-02-16T10:32:46.286063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.285887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:01.738941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:17.089264+0000","last_change":"2024-02-16T10:33:17.089325+0000","last_active":"2024-02-16T10:33:17.089264+0000","last_peered":"2024-02-16T10:33:17.089264+0000","last_clean":"2024-02-16T10:33:17.089264+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:33:17.089264+0000","last_undegraded":"2024-02-16T10:33:17.089264+0000","last_fullsized":"2024-02-16T10:33:17.089264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:17.089057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:17.089057+0000","last_clean_scrub_stamp":"2024-02-16T10:33:17.089057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:22:50.381445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.695562+0000","last_change":"2024-02-16T10:32:30.695562+0000","last_active":"2024-02-16T10:32:30.695562+0000","last_peered":"2024-02-16T10:32:30.695562+0000","last_clean":"2024-02-16T10:32:30.695562+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:32:30.695562+0000","last_undegraded":"2024-02-16T10:32:30.695562+0000","last_fullsized":"2024-02-16T10:32:30.695562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.695316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:35.672730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.964066+0000","last_change":"2024-02-16T10:32:43.964066+0000","last_active":"2024-02-16T10:32:43.964066+0000","last_peered":"2024-02-16T10:32:43.964066+0000","last_clean":"2024-02-16T10:32:43.964066+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:43.964066+0000","last_undegraded":"2024-02-16T10:32:43.964066+0000","last_fullsized":"2024-02-16T10:32:43.964066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.963784+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:35.015936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.497295+0000","last_change":"2024-02-16T10:32:17.497295+0000","last_active":"2024-02-16T10:32:17.497295+0000","last_peered":"2024-02-16T10:32:17.497295+0000","last_clean":"2024-02-16T10:32:17.497295+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:32:17.497295+0000","last_undegraded":"2024-02-16T10:32:17.497295+0000","last_fullsized":"2024-02-16T10:32:17.497295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.496921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:48.124154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.620154+0000","last_change":"2024-02-16T10:33:10.620322+0000","last_active":"2024-02-16T10:33:10.620154+0000","last_peered":"2024-02-16T10:33:10.620154+0000","last_clean":"2024-02-16T10:33:10.620154+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:33:10.620154+0000","last_undegraded":"2024-02-16T10:33:10.620154+0000","last_fullsized":"2024-02-16T10:33:10.620154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.619902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:34.041848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.229630+0000","last_change":"2024-02-16T10:33:08.229696+0000","last_active":"2024-02-16T10:33:08.229630+0000","last_peered":"2024-02-16T10:33:08.229630+0000","last_clean":"2024-02-16T10:33:08.229630+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:33:08.229630+0000","last_undegraded":"2024-02-16T10:33:08.229630+0000","last_fullsized":"2024-02-16T10:33:08.229630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.229415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:08:03.257453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.532455+0000","last_change":"2024-02-16T10:32:49.532517+0000","last_active":"2024-02-16T10:32:49.532455+0000","last_peered":"2024-02-16T10:32:49.532455+0000","last_clean":"2024-02-16T10:32:49.532455+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:32:49.532455+0000","last_undegraded":"2024-02-16T10:32:49.532455+0000","last_fullsized":"2024-02-16T10:32:49.532455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.532266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:57.734052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.451331+0000","last_change":"2024-02-16T10:32:27.451331+0000","last_active":"2024-02-16T10:32:27.451331+0000","last_peered":"2024-02-16T10:32:27.451331+0000","last_clean":"2024-02-16T10:32:27.451331+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:27.451331+0000","last_undegraded":"2024-02-16T10:32:27.451331+0000","last_fullsized":"2024-02-16T10:32:27.451331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.451069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:58.078302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.240843+0000","last_change":"2024-02-16T10:32:20.240843+0000","last_active":"2024-02-16T10:32:20.240843+0000","last_peered":"2024-02-16T10:32:20.240843+0000","last_clean":"2024-02-16T10:32:20.240843+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:20.240843+0000","last_undegraded":"2024-02-16T10:32:20.240843+0000","last_fullsized":"2024-02-16T10:32:20.240843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.240570+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:31.716842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.017811+0000","last_change":"2024-02-16T10:32:37.017811+0000","last_active":"2024-02-16T10:32:37.017811+0000","last_peered":"2024-02-16T10:32:37.017811+0000","last_clean":"2024-02-16T10:32:37.017811+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:32:37.017811+0000","last_undegraded":"2024-02-16T10:32:37.017811+0000","last_fullsized":"2024-02-16T10:32:37.017811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.017556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:51.032253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.115773+0000","last_change":"2024-02-16T10:33:05.115828+0000","last_active":"2024-02-16T10:33:05.115773+0000","last_peered":"2024-02-16T10:33:05.115773+0000","last_clean":"2024-02-16T10:33:05.115773+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:33:05.115773+0000","last_undegraded":"2024-02-16T10:33:05.115773+0000","last_fullsized":"2024-02-16T10:33:05.115773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.115560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:07.229889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.929301+0000","last_change":"2024-02-16T10:32:29.929301+0000","last_active":"2024-02-16T10:32:29.929301+0000","last_peered":"2024-02-16T10:32:29.929301+0000","last_clean":"2024-02-16T10:32:29.929301+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:32:29.929301+0000","last_undegraded":"2024-02-16T10:32:29.929301+0000","last_fullsized":"2024-02-16T10:32:29.929301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.929048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:38.130834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:15.074587+0000","last_change":"2024-02-16T10:33:15.074657+0000","last_active":"2024-02-16T10:33:15.074587+0000","last_peered":"2024-02-16T10:33:15.074587+0000","last_clean":"2024-02-16T10:33:15.074587+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:33:15.074587+0000","last_undegraded":"2024-02-16T10:33:15.074587+0000","last_fullsized":"2024-02-16T10:33:15.074587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:15.074371+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:15.074371+0000","last_clean_scrub_stamp":"2024-02-16T10:33:15.074371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:21:32.166640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.646038+0000","last_change":"2024-02-16T10:32:29.646038+0000","last_active":"2024-02-16T10:32:29.646038+0000","last_peered":"2024-02-16T10:32:29.646038+0000","last_clean":"2024-02-16T10:32:29.646038+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:32:29.646038+0000","last_undegraded":"2024-02-16T10:32:29.646038+0000","last_fullsized":"2024-02-16T10:32:29.646038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.645785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:23.146927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.309318+0000","last_change":"2024-02-16T10:32:21.309318+0000","last_active":"2024-02-16T10:32:21.309318+0000","last_peered":"2024-02-16T10:32:21.309318+0000","last_clean":"2024-02-16T10:32:21.309318+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:21.309318+0000","last_undegraded":"2024-02-16T10:32:21.309318+0000","last_fullsized":"2024-02-16T10:32:21.309318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.309051+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:16:57.682746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.163489+0000","last_change":"2024-02-16T10:32:14.163489+0000","last_active":"2024-02-16T10:32:14.163489+0000","last_peered":"2024-02-16T10:32:14.163489+0000","last_clean":"2024-02-16T10:32:14.163489+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:14.163489+0000","last_undegraded":"2024-02-16T10:32:14.163489+0000","last_fullsized":"2024-02-16T10:32:14.163489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.163228+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:11.600065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.620194+0000","last_change":"2024-02-16T10:33:08.620253+0000","last_active":"2024-02-16T10:33:08.620194+0000","last_peered":"2024-02-16T10:33:08.620194+0000","last_clean":"2024-02-16T10:33:08.620194+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:33:08.620194+0000","last_undegraded":"2024-02-16T10:33:08.620194+0000","last_fullsized":"2024-02-16T10:33:08.620194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.620010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:10.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.368195+0000","last_change":"2024-02-16T10:32:36.368195+0000","last_active":"2024-02-16T10:32:36.368195+0000","last_peered":"2024-02-16T10:32:36.368195+0000","last_clean":"2024-02-16T10:32:36.368195+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:32:36.368195+0000","last_undegraded":"2024-02-16T10:32:36.368195+0000","last_fullsized":"2024-02-16T10:32:36.368195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.367915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:48.603515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.161223+0000","last_change":"2024-02-16T10:33:06.161296+0000","last_active":"2024-02-16T10:33:06.161223+0000","last_peered":"2024-02-16T10:33:06.161223+0000","last_clean":"2024-02-16T10:33:06.161223+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:33:06.161223+0000","last_undegraded":"2024-02-16T10:33:06.161223+0000","last_fullsized":"2024-02-16T10:33:06.161223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.161008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:51.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.227428+0000","last_change":"2024-02-16T10:32:29.227428+0000","last_active":"2024-02-16T10:32:29.227428+0000","last_peered":"2024-02-16T10:32:29.227428+0000","last_clean":"2024-02-16T10:32:29.227428+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:29.227428+0000","last_undegraded":"2024-02-16T10:32:29.227428+0000","last_fullsized":"2024-02-16T10:32:29.227428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.227174+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:41.462774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.984249+0000","last_change":"2024-02-16T10:32:41.984249+0000","last_active":"2024-02-16T10:32:41.984249+0000","last_peered":"2024-02-16T10:32:41.984249+0000","last_clean":"2024-02-16T10:32:41.984249+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:32:41.984249+0000","last_undegraded":"2024-02-16T10:32:41.984249+0000","last_fullsized":"2024-02-16T10:32:41.984249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.983908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:16.170915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.304415+0000","last_change":"2024-02-16T10:32:18.304415+0000","last_active":"2024-02-16T10:32:18.304415+0000","last_peered":"2024-02-16T10:32:18.304415+0000","last_clean":"2024-02-16T10:32:18.304415+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:18.304415+0000","last_undegraded":"2024-02-16T10:32:18.304415+0000","last_fullsized":"2024-02-16T10:32:18.304415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.304138+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:51.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.397338+0000","last_change":"2024-02-16T10:33:01.397402+0000","last_active":"2024-02-16T10:33:01.397338+0000","last_peered":"2024-02-16T10:33:01.397338+0000","last_clean":"2024-02-16T10:33:01.397338+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:33:01.397338+0000","last_undegraded":"2024-02-16T10:33:01.397338+0000","last_fullsized":"2024-02-16T10:33:01.397338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.397137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:59.997013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.143875+0000","last_change":"2024-02-16T10:32:35.143875+0000","last_active":"2024-02-16T10:32:35.143875+0000","last_peered":"2024-02-16T10:32:35.143875+0000","last_clean":"2024-02-16T10:32:35.143875+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:32:35.143875+0000","last_undegraded":"2024-02-16T10:32:35.143875+0000","last_fullsized":"2024-02-16T10:32:35.143875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.143615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:27.075711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.119660+0000","last_change":"2024-02-16T10:33:09.119719+0000","last_active":"2024-02-16T10:33:09.119660+0000","last_peered":"2024-02-16T10:33:09.119660+0000","last_clean":"2024-02-16T10:33:09.119660+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:33:09.119660+0000","last_undegraded":"2024-02-16T10:33:09.119660+0000","last_fullsized":"2024-02-16T10:33:09.119660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.119459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:05.115810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.781651+0000","last_change":"2024-02-16T10:32:13.781651+0000","last_active":"2024-02-16T10:32:13.781651+0000","last_peered":"2024-02-16T10:32:13.781651+0000","last_clean":"2024-02-16T10:32:13.781651+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:32:13.781651+0000","last_undegraded":"2024-02-16T10:32:13.781651+0000","last_fullsized":"2024-02-16T10:32:13.781651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.781400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:02:49.070840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.203087+0000","last_change":"2024-02-16T10:32:21.203087+0000","last_active":"2024-02-16T10:32:21.203087+0000","last_peered":"2024-02-16T10:32:21.203087+0000","last_clean":"2024-02-16T10:32:21.203087+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:21.203087+0000","last_undegraded":"2024-02-16T10:32:21.203087+0000","last_fullsized":"2024-02-16T10:32:21.203087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.202707+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:08.574336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.238385+0000","last_change":"2024-02-16T10:32:18.238385+0000","last_active":"2024-02-16T10:32:18.238385+0000","last_peered":"2024-02-16T10:32:18.238385+0000","last_clean":"2024-02-16T10:32:18.238385+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:32:18.238385+0000","last_undegraded":"2024-02-16T10:32:18.238385+0000","last_fullsized":"2024-02-16T10:32:18.238385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.238111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:31.457700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.136516+0000","last_change":"2024-02-16T10:32:34.136516+0000","last_active":"2024-02-16T10:32:34.136516+0000","last_peered":"2024-02-16T10:32:34.136516+0000","last_clean":"2024-02-16T10:32:34.136516+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:32:34.136516+0000","last_undegraded":"2024-02-16T10:32:34.136516+0000","last_fullsized":"2024-02-16T10:32:34.136516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.136238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:40.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.943470+0000","last_change":"2024-02-16T10:32:30.943470+0000","last_active":"2024-02-16T10:32:30.943470+0000","last_peered":"2024-02-16T10:32:30.943470+0000","last_clean":"2024-02-16T10:32:30.943470+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:32:30.943470+0000","last_undegraded":"2024-02-16T10:32:30.943470+0000","last_fullsized":"2024-02-16T10:32:30.943470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.943169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:44.988481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.240077+0000","last_change":"2024-02-16T10:33:00.240148+0000","last_active":"2024-02-16T10:33:00.240077+0000","last_peered":"2024-02-16T10:33:00.240077+0000","last_clean":"2024-02-16T10:33:00.240077+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:33:00.240077+0000","last_undegraded":"2024-02-16T10:33:00.240077+0000","last_fullsized":"2024-02-16T10:33:00.240077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.239869+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:01.731330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:24.993937+0000","last_change":"2024-02-16T10:33:24.993993+0000","last_active":"2024-02-16T10:33:24.993937+0000","last_peered":"2024-02-16T10:33:24.993937+0000","last_clean":"2024-02-16T10:33:24.993937+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:33:24.993937+0000","last_undegraded":"2024-02-16T10:33:24.993937+0000","last_fullsized":"2024-02-16T10:33:24.993937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:24.993740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:24.993740+0000","last_clean_scrub_stamp":"2024-02-16T10:33:24.993740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:54.973072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.608068+0000","last_change":"2024-02-16T10:30:26.087958+0000","last_active":"2024-02-16T10:32:13.608068+0000","last_peered":"2024-02-16T10:32:13.608068+0000","last_clean":"2024-02-16T10:32:13.608068+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:32:13.608068+0000","last_undegraded":"2024-02-16T10:32:13.608068+0000","last_fullsized":"2024-02-16T10:32:13.608068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:25.014972+0000","last_clean_scrub_stamp":"2024-02-16T10:30:25.014972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.279935+0000","last_change":"2024-02-16T10:32:27.279935+0000","last_active":"2024-02-16T10:32:27.279935+0000","last_peered":"2024-02-16T10:32:27.279935+0000","last_clean":"2024-02-16T10:32:27.279935+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:32:27.279935+0000","last_undegraded":"2024-02-16T10:32:27.279935+0000","last_fullsized":"2024-02-16T10:32:27.279935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.279691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:39:24.188579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.960833+0000","last_change":"2024-02-16T10:32:38.960833+0000","last_active":"2024-02-16T10:32:38.960833+0000","last_peered":"2024-02-16T10:32:38.960833+0000","last_clean":"2024-02-16T10:32:38.960833+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:38.960833+0000","last_undegraded":"2024-02-16T10:32:38.960833+0000","last_fullsized":"2024-02-16T10:32:38.960833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.960420+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:29:47.645317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.512594+0000","last_change":"2024-02-16T10:32:20.512594+0000","last_active":"2024-02-16T10:32:20.512594+0000","last_peered":"2024-02-16T10:32:20.512594+0000","last_clean":"2024-02-16T10:32:20.512594+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:32:20.512594+0000","last_undegraded":"2024-02-16T10:32:20.512594+0000","last_fullsized":"2024-02-16T10:32:20.512594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.512313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:57.090214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.430846+0000","last_change":"2024-02-16T10:33:02.430910+0000","last_active":"2024-02-16T10:33:02.430846+0000","last_peered":"2024-02-16T10:33:02.430846+0000","last_clean":"2024-02-16T10:33:02.430846+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:33:02.430846+0000","last_undegraded":"2024-02-16T10:33:02.430846+0000","last_fullsized":"2024-02-16T10:33:02.430846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.430646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:22.558915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.948837+0000","last_change":"2024-02-16T10:32:49.948909+0000","last_active":"2024-02-16T10:32:49.948837+0000","last_peered":"2024-02-16T10:32:49.948837+0000","last_clean":"2024-02-16T10:32:49.948837+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:32:49.948837+0000","last_undegraded":"2024-02-16T10:32:49.948837+0000","last_fullsized":"2024-02-16T10:32:49.948837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.948648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:05.258497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:24.032943+0000","last_change":"2024-02-16T10:33:24.032997+0000","last_active":"2024-02-16T10:33:24.032943+0000","last_peered":"2024-02-16T10:33:24.032943+0000","last_clean":"2024-02-16T10:33:24.032943+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:33:24.032943+0000","last_undegraded":"2024-02-16T10:33:24.032943+0000","last_fullsized":"2024-02-16T10:33:24.032943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:24.032722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:24.032722+0000","last_clean_scrub_stamp":"2024-02-16T10:33:24.032722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:20.191664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.571062+0000","last_change":"2024-02-16T10:32:47.571125+0000","last_active":"2024-02-16T10:32:47.571062+0000","last_peered":"2024-02-16T10:32:47.571062+0000","last_clean":"2024-02-16T10:32:47.571062+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:32:47.571062+0000","last_undegraded":"2024-02-16T10:32:47.571062+0000","last_fullsized":"2024-02-16T10:32:47.571062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.570876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:07:21.048590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.736135+0000","last_change":"2024-02-16T10:32:14.736135+0000","last_active":"2024-02-16T10:32:14.736135+0000","last_peered":"2024-02-16T10:32:14.736135+0000","last_clean":"2024-02-16T10:32:14.736135+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:32:14.736135+0000","last_undegraded":"2024-02-16T10:32:14.736135+0000","last_fullsized":"2024-02-16T10:32:14.736135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.735884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:40.928168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.273669+0000","last_change":"2024-02-16T10:32:19.273669+0000","last_active":"2024-02-16T10:32:19.273669+0000","last_peered":"2024-02-16T10:32:19.273669+0000","last_clean":"2024-02-16T10:32:19.273669+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:19.273669+0000","last_undegraded":"2024-02-16T10:32:19.273669+0000","last_fullsized":"2024-02-16T10:32:19.273669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.273406+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:49.900639+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.978134+0000","last_change":"2024-02-16T10:32:48.978193+0000","last_active":"2024-02-16T10:32:48.978134+0000","last_peered":"2024-02-16T10:32:48.978134+0000","last_clean":"2024-02-16T10:32:48.978134+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:32:48.978134+0000","last_undegraded":"2024-02-16T10:32:48.978134+0000","last_fullsized":"2024-02-16T10:32:48.978134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.977937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:51.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.174869+0000","last_change":"2024-02-16T10:32:38.174869+0000","last_active":"2024-02-16T10:32:38.174869+0000","last_peered":"2024-02-16T10:32:38.174869+0000","last_clean":"2024-02-16T10:32:38.174869+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:32:38.174869+0000","last_undegraded":"2024-02-16T10:32:38.174869+0000","last_fullsized":"2024-02-16T10:32:38.174869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.174629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:56.601626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.613284+0000","last_change":"2024-02-16T10:32:41.613350+0000","last_active":"2024-02-16T10:32:41.613284+0000","last_peered":"2024-02-16T10:32:41.613284+0000","last_clean":"2024-02-16T10:32:41.613284+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:41.613284+0000","last_undegraded":"2024-02-16T10:32:41.613284+0000","last_fullsized":"2024-02-16T10:32:41.613284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.613065+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:19.969376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.273965+0000","last_change":"2024-02-16T10:32:52.274043+0000","last_active":"2024-02-16T10:32:52.273965+0000","last_peered":"2024-02-16T10:32:52.273965+0000","last_clean":"2024-02-16T10:32:52.273965+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:32:52.273965+0000","last_undegraded":"2024-02-16T10:32:52.273965+0000","last_fullsized":"2024-02-16T10:32:52.273965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.273779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:11.755492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.628916+0000","last_change":"2024-02-16T10:32:51.629026+0000","last_active":"2024-02-16T10:32:51.628916+0000","last_peered":"2024-02-16T10:32:51.628916+0000","last_clean":"2024-02-16T10:32:51.628916+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:32:51.628916+0000","last_undegraded":"2024-02-16T10:32:51.628916+0000","last_fullsized":"2024-02-16T10:32:51.628916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.628708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:34.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.455727+0000","last_change":"2024-02-16T10:32:29.455727+0000","last_active":"2024-02-16T10:32:29.455727+0000","last_peered":"2024-02-16T10:32:29.455727+0000","last_clean":"2024-02-16T10:32:29.455727+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:32:29.455727+0000","last_undegraded":"2024-02-16T10:32:29.455727+0000","last_fullsized":"2024-02-16T10:32:29.455727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.455432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:16.827061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.278098+0000","last_change":"2024-02-16T10:32:20.278098+0000","last_active":"2024-02-16T10:32:20.278098+0000","last_peered":"2024-02-16T10:32:20.278098+0000","last_clean":"2024-02-16T10:32:20.278098+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:20.278098+0000","last_undegraded":"2024-02-16T10:32:20.278098+0000","last_fullsized":"2024-02-16T10:32:20.278098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.277804+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:57:46.102924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.694650+0000","last_change":"2024-02-16T10:32:36.694650+0000","last_active":"2024-02-16T10:32:36.694650+0000","last_peered":"2024-02-16T10:32:36.694650+0000","last_clean":"2024-02-16T10:32:36.694650+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:32:36.694650+0000","last_undegraded":"2024-02-16T10:32:36.694650+0000","last_fullsized":"2024-02-16T10:32:36.694650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.694397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:52.147451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.948881+0000","last_change":"2024-02-16T10:32:52.949022+0000","last_active":"2024-02-16T10:32:52.948881+0000","last_peered":"2024-02-16T10:32:52.948881+0000","last_clean":"2024-02-16T10:32:52.948881+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:32:52.948881+0000","last_undegraded":"2024-02-16T10:32:52.948881+0000","last_fullsized":"2024-02-16T10:32:52.948881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.948652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:15:00.595710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.539873+0000","last_change":"2024-02-16T10:32:56.539932+0000","last_active":"2024-02-16T10:32:56.539873+0000","last_peered":"2024-02-16T10:32:56.539873+0000","last_clean":"2024-02-16T10:32:56.539873+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:32:56.539873+0000","last_undegraded":"2024-02-16T10:32:56.539873+0000","last_fullsized":"2024-02-16T10:32:56.539873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.539683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:10.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:25.961973+0000","last_change":"2024-02-16T10:33:25.962105+0000","last_active":"2024-02-16T10:33:25.961973+0000","last_peered":"2024-02-16T10:33:25.961973+0000","last_clean":"2024-02-16T10:33:25.961973+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:33:25.961973+0000","last_undegraded":"2024-02-16T10:33:25.961973+0000","last_fullsized":"2024-02-16T10:33:25.961973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:25.961729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:25.961729+0000","last_clean_scrub_stamp":"2024-02-16T10:33:25.961729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:39:02.207805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.301659+0000","last_change":"2024-02-16T10:32:47.301721+0000","last_active":"2024-02-16T10:32:47.301659+0000","last_peered":"2024-02-16T10:32:47.301659+0000","last_clean":"2024-02-16T10:32:47.301659+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:32:47.301659+0000","last_undegraded":"2024-02-16T10:32:47.301659+0000","last_fullsized":"2024-02-16T10:32:47.301659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.301448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:25.616217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.751469+0000","last_change":"2024-02-16T10:32:34.751469+0000","last_active":"2024-02-16T10:32:34.751469+0000","last_peered":"2024-02-16T10:32:34.751469+0000","last_clean":"2024-02-16T10:32:34.751469+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:32:34.751469+0000","last_undegraded":"2024-02-16T10:32:34.751469+0000","last_fullsized":"2024-02-16T10:32:34.751469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.751222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:00.943506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.979895+0000","last_change":"2024-02-16T10:32:39.979895+0000","last_active":"2024-02-16T10:32:39.979895+0000","last_peered":"2024-02-16T10:32:39.979895+0000","last_clean":"2024-02-16T10:32:39.979895+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:32:39.979895+0000","last_undegraded":"2024-02-16T10:32:39.979895+0000","last_fullsized":"2024-02-16T10:32:39.979895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.979639+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:56:47.790005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.981922+0000","last_change":"2024-02-16T10:32:44.981922+0000","last_active":"2024-02-16T10:32:44.981922+0000","last_peered":"2024-02-16T10:32:44.981922+0000","last_clean":"2024-02-16T10:32:44.981922+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:32:44.981922+0000","last_undegraded":"2024-02-16T10:32:44.981922+0000","last_fullsized":"2024-02-16T10:32:44.981922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.981644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:40.009681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.188485+0000","last_change":"2024-02-16T10:33:10.188557+0000","last_active":"2024-02-16T10:33:10.188485+0000","last_peered":"2024-02-16T10:33:10.188485+0000","last_clean":"2024-02-16T10:33:10.188485+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:33:10.188485+0000","last_undegraded":"2024-02-16T10:33:10.188485+0000","last_fullsized":"2024-02-16T10:33:10.188485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.188305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:26.190288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.246559+0000","last_change":"2024-02-16T10:32:44.246622+0000","last_active":"2024-02-16T10:32:44.246559+0000","last_peered":"2024-02-16T10:32:44.246559+0000","last_clean":"2024-02-16T10:32:44.246559+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:32:44.246559+0000","last_undegraded":"2024-02-16T10:32:44.246559+0000","last_fullsized":"2024-02-16T10:32:44.246559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.246379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:22.602690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.242816+0000","last_change":"2024-02-16T10:32:41.242876+0000","last_active":"2024-02-16T10:32:41.242816+0000","last_peered":"2024-02-16T10:32:41.242816+0000","last_clean":"2024-02-16T10:32:41.242816+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:32:41.242816+0000","last_undegraded":"2024-02-16T10:32:41.242816+0000","last_fullsized":"2024-02-16T10:32:41.242816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.242620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:47.758750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.556651+0000","last_change":"2024-02-16T10:32:59.556711+0000","last_active":"2024-02-16T10:32:59.556651+0000","last_peered":"2024-02-16T10:32:59.556651+0000","last_clean":"2024-02-16T10:32:59.556651+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:32:59.556651+0000","last_undegraded":"2024-02-16T10:32:59.556651+0000","last_fullsized":"2024-02-16T10:32:59.556651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.556469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.723330+0000","last_change":"2024-02-16T10:32:35.723330+0000","last_active":"2024-02-16T10:32:35.723330+0000","last_peered":"2024-02-16T10:32:35.723330+0000","last_clean":"2024-02-16T10:32:35.723330+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:32:35.723330+0000","last_undegraded":"2024-02-16T10:32:35.723330+0000","last_fullsized":"2024-02-16T10:32:35.723330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.723078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:54.150076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'70","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.637878+0000","last_change":"2024-02-16T10:32:26.637878+0000","last_active":"2024-02-16T10:32:26.637878+0000","last_peered":"2024-02-16T10:32:26.637878+0000","last_clean":"2024-02-16T10:32:26.637878+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:26.637878+0000","last_undegraded":"2024-02-16T10:32:26.637878+0000","last_fullsized":"2024-02-16T10:32:26.637878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.637563+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:38.873163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.185179+0000","last_change":"2024-02-16T10:32:16.185179+0000","last_active":"2024-02-16T10:32:16.185179+0000","last_peered":"2024-02-16T10:32:16.185179+0000","last_clean":"2024-02-16T10:32:16.185179+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:32:16.185179+0000","last_undegraded":"2024-02-16T10:32:16.185179+0000","last_fullsized":"2024-02-16T10:32:16.185179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.184842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:49:06.247286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.647753+0000","last_change":"2024-02-16T10:32:40.647753+0000","last_active":"2024-02-16T10:32:40.647753+0000","last_peered":"2024-02-16T10:32:40.647753+0000","last_clean":"2024-02-16T10:32:40.647753+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:32:40.647753+0000","last_undegraded":"2024-02-16T10:32:40.647753+0000","last_fullsized":"2024-02-16T10:32:40.647753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.647500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:34.495274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.199955+0000","last_change":"2024-02-16T10:32:54.200020+0000","last_active":"2024-02-16T10:32:54.199955+0000","last_peered":"2024-02-16T10:32:54.199955+0000","last_clean":"2024-02-16T10:32:54.199955+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:32:54.199955+0000","last_undegraded":"2024-02-16T10:32:54.199955+0000","last_fullsized":"2024-02-16T10:32:54.199955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.199762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:52.799639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.622453+0000","last_change":"2024-02-16T10:33:02.622510+0000","last_active":"2024-02-16T10:33:02.622453+0000","last_peered":"2024-02-16T10:33:02.622453+0000","last_clean":"2024-02-16T10:33:02.622453+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:33:02.622453+0000","last_undegraded":"2024-02-16T10:33:02.622453+0000","last_fullsized":"2024-02-16T10:33:02.622453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.622254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:19.243588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:23.052241+0000","last_change":"2024-02-16T10:33:23.052384+0000","last_active":"2024-02-16T10:33:23.052241+0000","last_peered":"2024-02-16T10:33:23.052241+0000","last_clean":"2024-02-16T10:33:23.052241+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:33:23.052241+0000","last_undegraded":"2024-02-16T10:33:23.052241+0000","last_fullsized":"2024-02-16T10:33:23.052241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:23.052011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:23.052011+0000","last_clean_scrub_stamp":"2024-02-16T10:33:23.052011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:26.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.858645+0000","last_change":"2024-02-16T10:32:19.858645+0000","last_active":"2024-02-16T10:32:19.858645+0000","last_peered":"2024-02-16T10:32:19.858645+0000","last_clean":"2024-02-16T10:32:19.858645+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:32:19.858645+0000","last_undegraded":"2024-02-16T10:32:19.858645+0000","last_fullsized":"2024-02-16T10:32:19.858645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.858393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:55.403466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.357240+0000","last_change":"2024-02-16T10:32:15.357240+0000","last_active":"2024-02-16T10:32:15.357240+0000","last_peered":"2024-02-16T10:32:15.357240+0000","last_clean":"2024-02-16T10:32:15.357240+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:32:15.357240+0000","last_undegraded":"2024-02-16T10:32:15.357240+0000","last_fullsized":"2024-02-16T10:32:15.357240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.356955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:04:12.700846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.354389+0000","last_change":"2024-02-16T10:32:14.354389+0000","last_active":"2024-02-16T10:32:14.354389+0000","last_peered":"2024-02-16T10:32:14.354389+0000","last_clean":"2024-02-16T10:32:14.354389+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:14.354389+0000","last_undegraded":"2024-02-16T10:32:14.354389+0000","last_fullsized":"2024-02-16T10:32:14.354389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.353994+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:24.095058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610738+0000","last_change":"2024-02-16T10:30:36.157810+0000","last_active":"2024-02-16T10:32:13.610738+0000","last_peered":"2024-02-16T10:32:13.610738+0000","last_clean":"2024-02-16T10:32:13.610738+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:32:13.610738+0000","last_undegraded":"2024-02-16T10:32:13.610738+0000","last_fullsized":"2024-02-16T10:32:13.610738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.422614+0000","last_change":"2024-02-16T10:33:05.422614+0000","last_active":"2024-02-16T10:33:05.422614+0000","last_peered":"2024-02-16T10:33:05.422614+0000","last_clean":"2024-02-16T10:33:05.422614+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:33:05.422614+0000","last_undegraded":"2024-02-16T10:33:05.422614+0000","last_fullsized":"2024-02-16T10:33:05.422614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.422384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:31.765105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.091468+0000","last_change":"2024-02-16T10:33:04.091545+0000","last_active":"2024-02-16T10:33:04.091468+0000","last_peered":"2024-02-16T10:33:04.091468+0000","last_clean":"2024-02-16T10:33:04.091468+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:33:04.091468+0000","last_undegraded":"2024-02-16T10:33:04.091468+0000","last_fullsized":"2024-02-16T10:33:04.091468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.091251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:26.782432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.556147+0000","last_change":"2024-02-16T10:32:58.556204+0000","last_active":"2024-02-16T10:32:58.556147+0000","last_peered":"2024-02-16T10:32:58.556147+0000","last_clean":"2024-02-16T10:32:58.556147+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:32:58.556147+0000","last_undegraded":"2024-02-16T10:32:58.556147+0000","last_fullsized":"2024-02-16T10:32:58.556147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.555957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:30:07.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.913654+0000","last_change":"2024-02-16T10:32:21.913654+0000","last_active":"2024-02-16T10:32:21.913654+0000","last_peered":"2024-02-16T10:32:21.913654+0000","last_clean":"2024-02-16T10:32:21.913654+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:32:21.913654+0000","last_undegraded":"2024-02-16T10:32:21.913654+0000","last_fullsized":"2024-02-16T10:32:21.913654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.913396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:04.153154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.866581+0000","last_change":"2024-02-16T10:32:26.866581+0000","last_active":"2024-02-16T10:32:26.866581+0000","last_peered":"2024-02-16T10:32:26.866581+0000","last_clean":"2024-02-16T10:32:26.866581+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:32:26.866581+0000","last_undegraded":"2024-02-16T10:32:26.866581+0000","last_fullsized":"2024-02-16T10:32:26.866581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.866309+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:28.219357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.413073+0000","last_change":"2024-02-16T10:32:13.413073+0000","last_active":"2024-02-16T10:32:13.413073+0000","last_peered":"2024-02-16T10:32:13.413073+0000","last_clean":"2024-02-16T10:32:13.413073+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:13.413073+0000","last_undegraded":"2024-02-16T10:32:13.413073+0000","last_fullsized":"2024-02-16T10:32:13.413073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.412978+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:02.786844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.201818+0000","last_change":"2024-02-16T10:33:09.201889+0000","last_active":"2024-02-16T10:33:09.201818+0000","last_peered":"2024-02-16T10:33:09.201818+0000","last_clean":"2024-02-16T10:33:09.201818+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:33:09.201818+0000","last_undegraded":"2024-02-16T10:33:09.201818+0000","last_fullsized":"2024-02-16T10:33:09.201818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.201598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:24.357883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.364773+0000","last_change":"2024-02-16T10:32:37.364825+0000","last_active":"2024-02-16T10:32:37.364773+0000","last_peered":"2024-02-16T10:32:37.364773+0000","last_clean":"2024-02-16T10:32:37.364773+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:32:37.364773+0000","last_undegraded":"2024-02-16T10:32:37.364773+0000","last_fullsized":"2024-02-16T10:32:37.364773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.364585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:29.485895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.228992+0000","last_change":"2024-02-16T10:33:03.229054+0000","last_active":"2024-02-16T10:33:03.228992+0000","last_peered":"2024-02-16T10:33:03.228992+0000","last_clean":"2024-02-16T10:33:03.228992+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:33:03.228992+0000","last_undegraded":"2024-02-16T10:33:03.228992+0000","last_fullsized":"2024-02-16T10:33:03.228992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.228797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:11.039164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:26.959275+0000","last_change":"2024-02-16T10:33:26.959329+0000","last_active":"2024-02-16T10:33:26.959275+0000","last_peered":"2024-02-16T10:33:26.959275+0000","last_clean":"2024-02-16T10:33:26.959275+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:33:26.959275+0000","last_undegraded":"2024-02-16T10:33:26.959275+0000","last_fullsized":"2024-02-16T10:33:26.959275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:26.959076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:26.959076+0000","last_clean_scrub_stamp":"2024-02-16T10:33:26.959076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:52.601024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.894998+0000","last_change":"2024-02-16T10:32:23.894998+0000","last_active":"2024-02-16T10:32:23.894998+0000","last_peered":"2024-02-16T10:32:23.894998+0000","last_clean":"2024-02-16T10:32:23.894998+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:32:23.894998+0000","last_undegraded":"2024-02-16T10:32:23.894998+0000","last_fullsized":"2024-02-16T10:32:23.894998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.894738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:24.572023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.394537+0000","last_change":"2024-02-16T10:32:25.394537+0000","last_active":"2024-02-16T10:32:25.394537+0000","last_peered":"2024-02-16T10:32:25.394537+0000","last_clean":"2024-02-16T10:32:25.394537+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:25.394537+0000","last_undegraded":"2024-02-16T10:32:25.394537+0000","last_fullsized":"2024-02-16T10:32:25.394537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.394250+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:35.971596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.461912+0000","last_change":"2024-02-16T10:32:15.461912+0000","last_active":"2024-02-16T10:32:15.461912+0000","last_peered":"2024-02-16T10:32:15.461912+0000","last_clean":"2024-02-16T10:32:15.461912+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:32:15.461912+0000","last_undegraded":"2024-02-16T10:32:15.461912+0000","last_fullsized":"2024-02-16T10:32:15.461912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.461664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:26.039010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.422778+0000","last_change":"2024-02-16T10:32:30.422778+0000","last_active":"2024-02-16T10:32:30.422778+0000","last_peered":"2024-02-16T10:32:30.422778+0000","last_clean":"2024-02-16T10:32:30.422778+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:32:30.422778+0000","last_undegraded":"2024-02-16T10:32:30.422778+0000","last_fullsized":"2024-02-16T10:32:30.422778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.422534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:07.000435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.404761+0000","last_change":"2024-02-16T10:33:03.404813+0000","last_active":"2024-02-16T10:33:03.404761+0000","last_peered":"2024-02-16T10:33:03.404761+0000","last_clean":"2024-02-16T10:33:03.404761+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:33:03.404761+0000","last_undegraded":"2024-02-16T10:33:03.404761+0000","last_fullsized":"2024-02-16T10:33:03.404761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.404578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:37:06.320135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.236856+0000","last_change":"2024-02-16T10:32:42.236856+0000","last_active":"2024-02-16T10:32:42.236856+0000","last_peered":"2024-02-16T10:32:42.236856+0000","last_clean":"2024-02-16T10:32:42.236856+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:42.236856+0000","last_undegraded":"2024-02-16T10:32:42.236856+0000","last_fullsized":"2024-02-16T10:32:42.236856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.236564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.168661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:28.004559+0000","last_change":"2024-02-16T10:33:28.004619+0000","last_active":"2024-02-16T10:33:28.004559+0000","last_peered":"2024-02-16T10:33:28.004559+0000","last_clean":"2024-02-16T10:33:28.004559+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:33:28.004559+0000","last_undegraded":"2024-02-16T10:33:28.004559+0000","last_fullsized":"2024-02-16T10:33:28.004559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:28.004359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:28.004359+0000","last_clean_scrub_stamp":"2024-02-16T10:33:28.004359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:41.550878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.233102+0000","last_change":"2024-02-16T10:32:23.233102+0000","last_active":"2024-02-16T10:32:23.233102+0000","last_peered":"2024-02-16T10:32:23.233102+0000","last_clean":"2024-02-16T10:32:23.233102+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:32:23.233102+0000","last_undegraded":"2024-02-16T10:32:23.233102+0000","last_fullsized":"2024-02-16T10:32:23.233102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.232854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:06.883209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.871641+0000","last_change":"2024-02-16T10:32:18.871641+0000","last_active":"2024-02-16T10:32:18.871641+0000","last_peered":"2024-02-16T10:32:18.871641+0000","last_clean":"2024-02-16T10:32:18.871641+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:18.871641+0000","last_undegraded":"2024-02-16T10:32:18.871641+0000","last_fullsized":"2024-02-16T10:32:18.871641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.871268+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:47.245756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.003300+0000","last_change":"2024-02-16T10:32:38.003300+0000","last_active":"2024-02-16T10:32:38.003300+0000","last_peered":"2024-02-16T10:32:38.003300+0000","last_clean":"2024-02-16T10:32:38.003300+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:32:38.003300+0000","last_undegraded":"2024-02-16T10:32:38.003300+0000","last_fullsized":"2024-02-16T10:32:38.003300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.003041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:53.724413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.613781+0000","last_change":"2024-02-16T10:33:07.613834+0000","last_active":"2024-02-16T10:33:07.613781+0000","last_peered":"2024-02-16T10:33:07.613781+0000","last_clean":"2024-02-16T10:33:07.613781+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:33:07.613781+0000","last_undegraded":"2024-02-16T10:33:07.613781+0000","last_fullsized":"2024-02-16T10:33:07.613781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.613584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:59.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.211875+0000","last_change":"2024-02-16T10:32:47.211875+0000","last_active":"2024-02-16T10:32:47.211875+0000","last_peered":"2024-02-16T10:32:47.211875+0000","last_clean":"2024-02-16T10:32:47.211875+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:32:47.211875+0000","last_undegraded":"2024-02-16T10:32:47.211875+0000","last_fullsized":"2024-02-16T10:32:47.211875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.211625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:59.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.320864+0000","last_change":"2024-02-16T10:32:39.320864+0000","last_active":"2024-02-16T10:32:39.320864+0000","last_peered":"2024-02-16T10:32:39.320864+0000","last_clean":"2024-02-16T10:32:39.320864+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:32:39.320864+0000","last_undegraded":"2024-02-16T10:32:39.320864+0000","last_fullsized":"2024-02-16T10:32:39.320864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.320594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:32.821736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.839228+0000","last_change":"2024-02-16T10:32:17.839228+0000","last_active":"2024-02-16T10:32:17.839228+0000","last_peered":"2024-02-16T10:32:17.839228+0000","last_clean":"2024-02-16T10:32:17.839228+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:32:17.839228+0000","last_undegraded":"2024-02-16T10:32:17.839228+0000","last_fullsized":"2024-02-16T10:32:17.839228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.838982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:56.153751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.552580+0000","last_change":"2024-02-16T10:32:21.552580+0000","last_active":"2024-02-16T10:32:21.552580+0000","last_peered":"2024-02-16T10:32:21.552580+0000","last_clean":"2024-02-16T10:32:21.552580+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:32:21.552580+0000","last_undegraded":"2024-02-16T10:32:21.552580+0000","last_fullsized":"2024-02-16T10:32:21.552580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.552195+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.202550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.348211+0000","last_change":"2024-02-16T10:32:22.348211+0000","last_active":"2024-02-16T10:32:22.348211+0000","last_peered":"2024-02-16T10:32:22.348211+0000","last_clean":"2024-02-16T10:32:22.348211+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:32:22.348211+0000","last_undegraded":"2024-02-16T10:32:22.348211+0000","last_fullsized":"2024-02-16T10:32:22.348211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.347938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:32.089002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.656049+0000","last_change":"2024-02-16T10:33:12.656107+0000","last_active":"2024-02-16T10:33:12.656049+0000","last_peered":"2024-02-16T10:33:12.656049+0000","last_clean":"2024-02-16T10:33:12.656049+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:33:12.656049+0000","last_undegraded":"2024-02-16T10:33:12.656049+0000","last_fullsized":"2024-02-16T10:33:12.656049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:12.655862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:12.655862+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.655862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:15:20.302920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.596002+0000","last_change":"2024-02-16T10:32:42.596002+0000","last_active":"2024-02-16T10:32:42.596002+0000","last_peered":"2024-02-16T10:32:42.596002+0000","last_clean":"2024-02-16T10:32:42.596002+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:32:42.596002+0000","last_undegraded":"2024-02-16T10:32:42.596002+0000","last_fullsized":"2024-02-16T10:32:42.596002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.595633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:38.295504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.312391+0000","last_change":"2024-02-16T10:32:56.312453+0000","last_active":"2024-02-16T10:32:56.312391+0000","last_peered":"2024-02-16T10:32:56.312391+0000","last_clean":"2024-02-16T10:32:56.312391+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:32:56.312391+0000","last_undegraded":"2024-02-16T10:32:56.312391+0000","last_fullsized":"2024-02-16T10:32:56.312391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:57.665208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.431239+0000","last_change":"2024-02-16T10:32:28.431239+0000","last_active":"2024-02-16T10:32:28.431239+0000","last_peered":"2024-02-16T10:32:28.431239+0000","last_clean":"2024-02-16T10:32:28.431239+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:32:28.431239+0000","last_undegraded":"2024-02-16T10:32:28.431239+0000","last_fullsized":"2024-02-16T10:32:28.431239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.430925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:39.907197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.547169+0000","last_change":"2024-02-16T10:32:23.547169+0000","last_active":"2024-02-16T10:32:23.547169+0000","last_peered":"2024-02-16T10:32:23.547169+0000","last_clean":"2024-02-16T10:32:23.547169+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:23.547169+0000","last_undegraded":"2024-02-16T10:32:23.547169+0000","last_fullsized":"2024-02-16T10:32:23.547169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.546894+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:50.589838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.353181+0000","last_change":"2024-02-16T10:32:13.353181+0000","last_active":"2024-02-16T10:32:13.353181+0000","last_peered":"2024-02-16T10:32:13.353181+0000","last_clean":"2024-02-16T10:32:13.353181+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:32:13.353181+0000","last_undegraded":"2024-02-16T10:32:13.353181+0000","last_fullsized":"2024-02-16T10:32:13.353181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.352927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:59.430673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.611019+0000","last_change":"2024-02-16T10:30:36.152684+0000","last_active":"2024-02-16T10:32:13.611019+0000","last_peered":"2024-02-16T10:32:13.611019+0000","last_clean":"2024-02-16T10:32:13.611019+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:32:13.611019+0000","last_undegraded":"2024-02-16T10:32:13.611019+0000","last_fullsized":"2024-02-16T10:32:13.611019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.978151+0000","last_change":"2024-02-16T10:32:33.978151+0000","last_active":"2024-02-16T10:32:33.978151+0000","last_peered":"2024-02-16T10:32:33.978151+0000","last_clean":"2024-02-16T10:32:33.978151+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:33.978151+0000","last_undegraded":"2024-02-16T10:32:33.978151+0000","last_fullsized":"2024-02-16T10:32:33.978151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.977897+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:01.970621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.246513+0000","last_change":"2024-02-16T10:32:55.246576+0000","last_active":"2024-02-16T10:32:55.246513+0000","last_peered":"2024-02-16T10:32:55.246513+0000","last_clean":"2024-02-16T10:32:55.246513+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:32:55.246513+0000","last_undegraded":"2024-02-16T10:32:55.246513+0000","last_fullsized":"2024-02-16T10:32:55.246513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.246320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:15.374588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.892358+0000","last_change":"2024-02-16T10:32:22.892358+0000","last_active":"2024-02-16T10:32:22.892358+0000","last_peered":"2024-02-16T10:32:22.892358+0000","last_clean":"2024-02-16T10:32:22.892358+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:32:22.892358+0000","last_undegraded":"2024-02-16T10:32:22.892358+0000","last_fullsized":"2024-02-16T10:32:22.892358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.892090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:42.373803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.352194+0000","last_change":"2024-02-16T10:32:24.352194+0000","last_active":"2024-02-16T10:32:24.352194+0000","last_peered":"2024-02-16T10:32:24.352194+0000","last_clean":"2024-02-16T10:32:24.352194+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:24.352194+0000","last_undegraded":"2024-02-16T10:32:24.352194+0000","last_fullsized":"2024-02-16T10:32:24.352194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.351933+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:53.942303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.181591+0000","last_change":"2024-02-16T10:32:15.181591+0000","last_active":"2024-02-16T10:32:15.181591+0000","last_peered":"2024-02-16T10:32:15.181591+0000","last_clean":"2024-02-16T10:32:15.181591+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:32:15.181591+0000","last_undegraded":"2024-02-16T10:32:15.181591+0000","last_fullsized":"2024-02-16T10:32:15.181591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.181356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:14.859456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'24","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.001573+0000","last_change":"2024-02-16T10:32:54.001753+0000","last_active":"2024-02-16T10:32:54.001573+0000","last_peered":"2024-02-16T10:32:54.001573+0000","last_clean":"2024-02-16T10:32:54.001573+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:32:54.001573+0000","last_undegraded":"2024-02-16T10:32:54.001573+0000","last_fullsized":"2024-02-16T10:32:54.001573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.001338+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:49:45.427964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.109834+0000","last_change":"2024-02-16T10:33:10.109901+0000","last_active":"2024-02-16T10:33:10.109834+0000","last_peered":"2024-02-16T10:33:10.109834+0000","last_clean":"2024-02-16T10:33:10.109834+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:33:10.109834+0000","last_undegraded":"2024-02-16T10:33:10.109834+0000","last_fullsized":"2024-02-16T10:33:10.109834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.109636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:45:03.216850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.378170+0000","last_change":"2024-02-16T10:33:06.378170+0000","last_active":"2024-02-16T10:33:06.378170+0000","last_peered":"2024-02-16T10:33:06.378170+0000","last_clean":"2024-02-16T10:33:06.378170+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:33:06.378170+0000","last_undegraded":"2024-02-16T10:33:06.378170+0000","last_fullsized":"2024-02-16T10:33:06.378170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.377937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:52.202390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.580433+0000","last_change":"2024-02-16T10:32:22.580433+0000","last_active":"2024-02-16T10:32:22.580433+0000","last_peered":"2024-02-16T10:32:22.580433+0000","last_clean":"2024-02-16T10:32:22.580433+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:22.580433+0000","last_undegraded":"2024-02-16T10:32:22.580433+0000","last_fullsized":"2024-02-16T10:32:22.580433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.580047+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:28.539775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.183196+0000","last_change":"2024-02-16T10:32:13.183196+0000","last_active":"2024-02-16T10:32:13.183196+0000","last_peered":"2024-02-16T10:32:13.183196+0000","last_clean":"2024-02-16T10:32:13.183196+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:32:13.183196+0000","last_undegraded":"2024-02-16T10:32:13.183196+0000","last_fullsized":"2024-02-16T10:32:13.183196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.182934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:58:32.694869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.576093+0000","last_change":"2024-02-16T10:33:09.576156+0000","last_active":"2024-02-16T10:33:09.576093+0000","last_peered":"2024-02-16T10:33:09.576093+0000","last_clean":"2024-02-16T10:33:09.576093+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:33:09.576093+0000","last_undegraded":"2024-02-16T10:33:09.576093+0000","last_fullsized":"2024-02-16T10:33:09.576093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.575901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:24.885751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.615377+0000","last_change":"2024-02-16T10:33:06.615431+0000","last_active":"2024-02-16T10:33:06.615377+0000","last_peered":"2024-02-16T10:33:06.615377+0000","last_clean":"2024-02-16T10:33:06.615377+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:33:06.615377+0000","last_undegraded":"2024-02-16T10:33:06.615377+0000","last_fullsized":"2024-02-16T10:33:06.615377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.615187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:22.617170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.279087+0000","last_change":"2024-02-16T10:32:57.279157+0000","last_active":"2024-02-16T10:32:57.279087+0000","last_peered":"2024-02-16T10:32:57.279087+0000","last_clean":"2024-02-16T10:32:57.279087+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:32:57.279087+0000","last_undegraded":"2024-02-16T10:32:57.279087+0000","last_fullsized":"2024-02-16T10:32:57.279087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.278888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:25.271612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.440004+0000","last_change":"2024-02-16T10:32:32.440004+0000","last_active":"2024-02-16T10:32:32.440004+0000","last_peered":"2024-02-16T10:32:32.440004+0000","last_clean":"2024-02-16T10:32:32.440004+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:32:32.440004+0000","last_undegraded":"2024-02-16T10:32:32.440004+0000","last_fullsized":"2024-02-16T10:32:32.440004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.439721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:38.399449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.980131+0000","last_change":"2024-02-16T10:32:45.980131+0000","last_active":"2024-02-16T10:32:45.980131+0000","last_peered":"2024-02-16T10:32:45.980131+0000","last_clean":"2024-02-16T10:32:45.980131+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:45.980131+0000","last_undegraded":"2024-02-16T10:32:45.980131+0000","last_fullsized":"2024-02-16T10:32:45.980131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.979834+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:01.136119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.184210+0000","last_change":"2024-02-16T10:32:22.184210+0000","last_active":"2024-02-16T10:32:22.184210+0000","last_peered":"2024-02-16T10:32:22.184210+0000","last_clean":"2024-02-16T10:32:22.184210+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:32:22.184210+0000","last_undegraded":"2024-02-16T10:32:22.184210+0000","last_fullsized":"2024-02-16T10:32:22.184210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.183927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:58.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.985188+0000","last_change":"2024-02-16T10:32:56.985252+0000","last_active":"2024-02-16T10:32:56.985188+0000","last_peered":"2024-02-16T10:32:56.985188+0000","last_clean":"2024-02-16T10:32:56.985188+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:32:56.985188+0000","last_undegraded":"2024-02-16T10:32:56.985188+0000","last_fullsized":"2024-02-16T10:32:56.985188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.984974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:05:02.646087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.887571+0000","last_change":"2024-02-16T10:32:27.887571+0000","last_active":"2024-02-16T10:32:27.887571+0000","last_peered":"2024-02-16T10:32:27.887571+0000","last_clean":"2024-02-16T10:32:27.887571+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:32:27.887571+0000","last_undegraded":"2024-02-16T10:32:27.887571+0000","last_fullsized":"2024-02-16T10:32:27.887571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.887325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:24.904620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.216574+0000","last_change":"2024-02-16T10:33:06.216636+0000","last_active":"2024-02-16T10:33:06.216574+0000","last_peered":"2024-02-16T10:33:06.216574+0000","last_clean":"2024-02-16T10:33:06.216574+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:33:06.216574+0000","last_undegraded":"2024-02-16T10:33:06.216574+0000","last_fullsized":"2024-02-16T10:33:06.216574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.216374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:22.837708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.436035+0000","last_change":"2024-02-16T10:32:31.436035+0000","last_active":"2024-02-16T10:32:31.436035+0000","last_peered":"2024-02-16T10:32:31.436035+0000","last_clean":"2024-02-16T10:32:31.436035+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:32:31.436035+0000","last_undegraded":"2024-02-16T10:32:31.436035+0000","last_fullsized":"2024-02-16T10:32:31.436035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:15.086149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.510077+0000","last_change":"2024-02-16T10:32:19.510077+0000","last_active":"2024-02-16T10:32:19.510077+0000","last_peered":"2024-02-16T10:32:19.510077+0000","last_clean":"2024-02-16T10:32:19.510077+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:19.510077+0000","last_undegraded":"2024-02-16T10:32:19.510077+0000","last_fullsized":"2024-02-16T10:32:19.510077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.509815+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:06.881445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.449861+0000","last_change":"2024-02-16T10:32:12.449861+0000","last_active":"2024-02-16T10:32:12.449861+0000","last_peered":"2024-02-16T10:32:12.449861+0000","last_clean":"2024-02-16T10:32:12.449861+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:32:12.449861+0000","last_undegraded":"2024-02-16T10:32:12.449861+0000","last_fullsized":"2024-02-16T10:32:12.449861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_clean_scrub_stamp":"2024-02-16T10:32:12.449759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:28.024682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.014475+0000","last_change":"2024-02-16T10:33:01.014585+0000","last_active":"2024-02-16T10:33:01.014475+0000","last_peered":"2024-02-16T10:33:01.014475+0000","last_clean":"2024-02-16T10:33:01.014475+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:33:01.014475+0000","last_undegraded":"2024-02-16T10:33:01.014475+0000","last_fullsized":"2024-02-16T10:33:01.014475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.014232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:43:02.321815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.608039+0000","last_change":"2024-02-16T10:32:52.608039+0000","last_active":"2024-02-16T10:32:52.608039+0000","last_peered":"2024-02-16T10:32:52.608039+0000","last_clean":"2024-02-16T10:32:52.608039+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:32:52.608039+0000","last_undegraded":"2024-02-16T10:32:52.608039+0000","last_fullsized":"2024-02-16T10:32:52.608039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.607781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:26.752711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:20.024979+0000","last_change":"2024-02-16T10:33:20.025028+0000","last_active":"2024-02-16T10:33:20.024979+0000","last_peered":"2024-02-16T10:33:20.024979+0000","last_clean":"2024-02-16T10:33:20.024979+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:33:20.024979+0000","last_undegraded":"2024-02-16T10:33:20.024979+0000","last_fullsized":"2024-02-16T10:33:20.024979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:20.024832+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:20.024832+0000","last_clean_scrub_stamp":"2024-02-16T10:33:20.024832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:52:09.643261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.250844+0000","last_change":"2024-02-16T10:32:28.250844+0000","last_active":"2024-02-16T10:32:28.250844+0000","last_peered":"2024-02-16T10:32:28.250844+0000","last_clean":"2024-02-16T10:32:28.250844+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:32:28.250844+0000","last_undegraded":"2024-02-16T10:32:28.250844+0000","last_fullsized":"2024-02-16T10:32:28.250844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.250601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:40.734413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.941423+0000","last_change":"2024-02-16T10:32:42.941509+0000","last_active":"2024-02-16T10:32:42.941423+0000","last_peered":"2024-02-16T10:32:42.941423+0000","last_clean":"2024-02-16T10:32:42.941423+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:32:42.941423+0000","last_undegraded":"2024-02-16T10:32:42.941423+0000","last_fullsized":"2024-02-16T10:32:42.941423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.941156+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:58:59.562490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.416755+0000","last_change":"2024-02-16T10:32:26.416755+0000","last_active":"2024-02-16T10:32:26.416755+0000","last_peered":"2024-02-16T10:32:26.416755+0000","last_clean":"2024-02-16T10:32:26.416755+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:26.416755+0000","last_undegraded":"2024-02-16T10:32:26.416755+0000","last_fullsized":"2024-02-16T10:32:26.416755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.416475+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:59.606871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610753+0000","last_change":"2024-02-16T10:30:36.145646+0000","last_active":"2024-02-16T10:32:13.610753+0000","last_peered":"2024-02-16T10:32:13.610753+0000","last_clean":"2024-02-16T10:32:13.610753+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:32:13.610753+0000","last_undegraded":"2024-02-16T10:32:13.610753+0000","last_fullsized":"2024-02-16T10:32:13.610753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.312242+0000","last_change":"2024-02-16T10:32:48.312242+0000","last_active":"2024-02-16T10:32:48.312242+0000","last_peered":"2024-02-16T10:32:48.312242+0000","last_clean":"2024-02-16T10:32:48.312242+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:32:48.312242+0000","last_undegraded":"2024-02-16T10:32:48.312242+0000","last_fullsized":"2024-02-16T10:32:48.312242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.311977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:16.686464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.230708+0000","last_change":"2024-02-16T10:33:02.230789+0000","last_active":"2024-02-16T10:33:02.230708+0000","last_peered":"2024-02-16T10:33:02.230708+0000","last_clean":"2024-02-16T10:33:02.230708+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:33:02.230708+0000","last_undegraded":"2024-02-16T10:33:02.230708+0000","last_fullsized":"2024-02-16T10:33:02.230708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.230512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:41.751700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.296238+0000","last_change":"2024-02-16T10:32:25.296238+0000","last_active":"2024-02-16T10:32:25.296238+0000","last_peered":"2024-02-16T10:32:25.296238+0000","last_clean":"2024-02-16T10:32:25.296238+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:32:25.296238+0000","last_undegraded":"2024-02-16T10:32:25.296238+0000","last_fullsized":"2024-02-16T10:32:25.296238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.295850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:52.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.346391+0000","last_change":"2024-02-16T10:32:17.346391+0000","last_active":"2024-02-16T10:32:17.346391+0000","last_peered":"2024-02-16T10:32:17.346391+0000","last_clean":"2024-02-16T10:32:17.346391+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:17.346391+0000","last_undegraded":"2024-02-16T10:32:17.346391+0000","last_fullsized":"2024-02-16T10:32:17.346391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.346100+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:27.923447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.576651+0000","last_change":"2024-02-16T10:32:24.576651+0000","last_active":"2024-02-16T10:32:24.576651+0000","last_peered":"2024-02-16T10:32:24.576651+0000","last_clean":"2024-02-16T10:32:24.576651+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:32:24.576651+0000","last_undegraded":"2024-02-16T10:32:24.576651+0000","last_fullsized":"2024-02-16T10:32:24.576651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.576402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:39.040594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.231903+0000","last_change":"2024-02-16T10:33:11.231970+0000","last_active":"2024-02-16T10:33:11.231903+0000","last_peered":"2024-02-16T10:33:11.231903+0000","last_clean":"2024-02-16T10:33:11.231903+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:33:11.231903+0000","last_undegraded":"2024-02-16T10:33:11.231903+0000","last_fullsized":"2024-02-16T10:33:11.231903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:33:11.231704+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:33:11.231704+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.231704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:03.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.301320+0000","last_change":"2024-02-16T10:32:50.301320+0000","last_active":"2024-02-16T10:32:50.301320+0000","last_peered":"2024-02-16T10:32:50.301320+0000","last_clean":"2024-02-16T10:32:50.301320+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:50.301320+0000","last_undegraded":"2024-02-16T10:32:50.301320+0000","last_fullsized":"2024-02-16T10:32:50.301320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.301175+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:18.159316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.080022+0000","last_change":"2024-02-16T10:33:13.080084+0000","last_active":"2024-02-16T10:33:13.080022+0000","last_peered":"2024-02-16T10:33:13.080022+0000","last_clean":"2024-02-16T10:33:13.080022+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:33:13.080022+0000","last_undegraded":"2024-02-16T10:33:13.080022+0000","last_fullsized":"2024-02-16T10:33:13.080022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:13.079825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:13.079825+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.079825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:53.541711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.413364+0000","last_change":"2024-02-16T10:32:33.413364+0000","last_active":"2024-02-16T10:32:33.413364+0000","last_peered":"2024-02-16T10:32:33.413364+0000","last_clean":"2024-02-16T10:32:33.413364+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:32:33.413364+0000","last_undegraded":"2024-02-16T10:32:33.413364+0000","last_fullsized":"2024-02-16T10:32:33.413364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.413126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:45:00.456070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.600445+0000","last_change":"2024-02-16T10:32:25.600445+0000","last_active":"2024-02-16T10:32:25.600445+0000","last_peered":"2024-02-16T10:32:25.600445+0000","last_clean":"2024-02-16T10:32:25.600445+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:25.600445+0000","last_undegraded":"2024-02-16T10:32:25.600445+0000","last_fullsized":"2024-02-16T10:32:25.600445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.600171+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:50.787242+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.000355+0000","last_change":"2024-02-16T10:32:36.000355+0000","last_active":"2024-02-16T10:32:36.000355+0000","last_peered":"2024-02-16T10:32:36.000355+0000","last_clean":"2024-02-16T10:32:36.000355+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:32:36.000355+0000","last_undegraded":"2024-02-16T10:32:36.000355+0000","last_fullsized":"2024-02-16T10:32:36.000355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.000094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:36.814271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610949+0000","last_change":"2024-02-16T10:30:36.160344+0000","last_active":"2024-02-16T10:32:13.610949+0000","last_peered":"2024-02-16T10:32:13.610949+0000","last_clean":"2024-02-16T10:32:13.610949+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:32:13.610949+0000","last_undegraded":"2024-02-16T10:32:13.610949+0000","last_fullsized":"2024-02-16T10:32:13.610949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.991391+0000","last_change":"2024-02-16T10:32:50.991391+0000","last_active":"2024-02-16T10:32:50.991391+0000","last_peered":"2024-02-16T10:32:50.991391+0000","last_clean":"2024-02-16T10:32:50.991391+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:32:50.991391+0000","last_undegraded":"2024-02-16T10:32:50.991391+0000","last_fullsized":"2024-02-16T10:32:50.991391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.990977+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:14.412923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.548693+0000","last_change":"2024-02-16T10:33:00.548760+0000","last_active":"2024-02-16T10:33:00.548693+0000","last_peered":"2024-02-16T10:33:00.548693+0000","last_clean":"2024-02-16T10:33:00.548693+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:33:00.548693+0000","last_undegraded":"2024-02-16T10:33:00.548693+0000","last_fullsized":"2024-02-16T10:33:00.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.548502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:58.925451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.282549+0000","last_change":"2024-02-16T10:32:24.282549+0000","last_active":"2024-02-16T10:32:24.282549+0000","last_peered":"2024-02-16T10:32:24.282549+0000","last_clean":"2024-02-16T10:32:24.282549+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:32:24.282549+0000","last_undegraded":"2024-02-16T10:32:24.282549+0000","last_fullsized":"2024-02-16T10:32:24.282549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.282291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:30.242018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.877073+0000","last_change":"2024-02-16T10:32:20.877073+0000","last_active":"2024-02-16T10:32:20.877073+0000","last_peered":"2024-02-16T10:32:20.877073+0000","last_clean":"2024-02-16T10:32:20.877073+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:20.877073+0000","last_undegraded":"2024-02-16T10:32:20.877073+0000","last_fullsized":"2024-02-16T10:32:20.877073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.876820+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:18:48.734961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.959040+0000","last_change":"2024-02-16T10:32:34.959040+0000","last_active":"2024-02-16T10:32:34.959040+0000","last_peered":"2024-02-16T10:32:34.959040+0000","last_clean":"2024-02-16T10:32:34.959040+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:32:34.959040+0000","last_undegraded":"2024-02-16T10:32:34.959040+0000","last_fullsized":"2024-02-16T10:32:34.959040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.958764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:01.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610927+0000","last_change":"2024-02-16T10:30:36.160186+0000","last_active":"2024-02-16T10:32:13.610927+0000","last_peered":"2024-02-16T10:32:13.610927+0000","last_clean":"2024-02-16T10:32:13.610927+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:32:13.610927+0000","last_undegraded":"2024-02-16T10:32:13.610927+0000","last_fullsized":"2024-02-16T10:32:13.610927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.240998+0000","last_change":"2024-02-16T10:32:44.240998+0000","last_active":"2024-02-16T10:32:44.240998+0000","last_peered":"2024-02-16T10:32:44.240998+0000","last_clean":"2024-02-16T10:32:44.240998+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:44.240998+0000","last_undegraded":"2024-02-16T10:32:44.240998+0000","last_fullsized":"2024-02-16T10:32:44.240998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.240707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:10.432991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.198662+0000","last_change":"2024-02-16T10:32:53.198731+0000","last_active":"2024-02-16T10:32:53.198662+0000","last_peered":"2024-02-16T10:32:53.198662+0000","last_clean":"2024-02-16T10:32:53.198662+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:32:53.198662+0000","last_undegraded":"2024-02-16T10:32:53.198662+0000","last_fullsized":"2024-02-16T10:32:53.198662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.198470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:23.978649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.164334+0000","last_change":"2024-02-16T10:32:32.164334+0000","last_active":"2024-02-16T10:32:32.164334+0000","last_peered":"2024-02-16T10:32:32.164334+0000","last_clean":"2024-02-16T10:32:32.164334+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:32.164334+0000","last_undegraded":"2024-02-16T10:32:32.164334+0000","last_fullsized":"2024-02-16T10:32:32.164334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.164046+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:25.665188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.857295+0000","last_change":"2024-02-16T10:32:24.857295+0000","last_active":"2024-02-16T10:32:24.857295+0000","last_peered":"2024-02-16T10:32:24.857295+0000","last_clean":"2024-02-16T10:32:24.857295+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:24.857295+0000","last_undegraded":"2024-02-16T10:32:24.857295+0000","last_fullsized":"2024-02-16T10:32:24.857295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.857001+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:32.050416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.493966+0000","last_change":"2024-02-16T10:32:18.493966+0000","last_active":"2024-02-16T10:32:18.493966+0000","last_peered":"2024-02-16T10:32:18.493966+0000","last_clean":"2024-02-16T10:32:18.493966+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:32:18.493966+0000","last_undegraded":"2024-02-16T10:32:18.493966+0000","last_fullsized":"2024-02-16T10:32:18.493966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.493720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:29.969992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.610880+0000","last_change":"2024-02-16T10:30:36.154022+0000","last_active":"2024-02-16T10:32:13.610880+0000","last_peered":"2024-02-16T10:32:13.610880+0000","last_clean":"2024-02-16T10:32:13.610880+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:32:13.610880+0000","last_undegraded":"2024-02-16T10:32:13.610880+0000","last_fullsized":"2024-02-16T10:32:13.610880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:30:35.084217+0000","last_clean_scrub_stamp":"2024-02-16T10:30:35.084217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.185600+0000","last_change":"2024-02-16T10:32:33.185600+0000","last_active":"2024-02-16T10:32:33.185600+0000","last_peered":"2024-02-16T10:32:33.185600+0000","last_clean":"2024-02-16T10:32:33.185600+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:32:33.185600+0000","last_undegraded":"2024-02-16T10:32:33.185600+0000","last_fullsized":"2024-02-16T10:32:33.185600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.185313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:38.162727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.322881+0000","last_change":"2024-02-16T10:32:58.322937+0000","last_active":"2024-02-16T10:32:58.322881+0000","last_peered":"2024-02-16T10:32:58.322881+0000","last_clean":"2024-02-16T10:32:58.322881+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:32:58.322881+0000","last_undegraded":"2024-02-16T10:32:58.322881+0000","last_fullsized":"2024-02-16T10:32:58.322881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.322698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:34.132775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.540064+0000","last_change":"2024-02-16T10:32:48.540133+0000","last_active":"2024-02-16T10:32:48.540064+0000","last_peered":"2024-02-16T10:32:48.540064+0000","last_clean":"2024-02-16T10:32:48.540064+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:32:48.540064+0000","last_undegraded":"2024-02-16T10:32:48.540064+0000","last_fullsized":"2024-02-16T10:32:48.540064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.539875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:16.085207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.598643+0000","last_change":"2024-02-16T10:33:01.598701+0000","last_active":"2024-02-16T10:33:01.598643+0000","last_peered":"2024-02-16T10:33:01.598643+0000","last_clean":"2024-02-16T10:33:01.598643+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:33:01.598643+0000","last_undegraded":"2024-02-16T10:33:01.598643+0000","last_fullsized":"2024-02-16T10:33:01.598643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.598443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:35.785450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.000443+0000","last_change":"2024-02-16T10:32:56.000511+0000","last_active":"2024-02-16T10:32:56.000443+0000","last_peered":"2024-02-16T10:32:56.000443+0000","last_clean":"2024-02-16T10:32:56.000443+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:32:56.000443+0000","last_undegraded":"2024-02-16T10:32:56.000443+0000","last_fullsized":"2024-02-16T10:32:56.000443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.000250+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:26:36.211245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.145997+0000","last_change":"2024-02-16T10:33:08.146092+0000","last_active":"2024-02-16T10:33:08.145997+0000","last_peered":"2024-02-16T10:33:08.145997+0000","last_clean":"2024-02-16T10:33:08.145997+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:33:08.145997+0000","last_undegraded":"2024-02-16T10:33:08.145997+0000","last_fullsized":"2024-02-16T10:33:08.145997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.145748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:40:23.931103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.548252+0000","last_change":"2024-02-16T10:32:54.548318+0000","last_active":"2024-02-16T10:32:54.548252+0000","last_peered":"2024-02-16T10:32:54.548252+0000","last_clean":"2024-02-16T10:32:54.548252+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:32:54.548252+0000","last_undegraded":"2024-02-16T10:32:54.548252+0000","last_fullsized":"2024-02-16T10:32:54.548252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.548056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:20.890776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.566223+0000","last_change":"2024-02-16T10:32:57.566279+0000","last_active":"2024-02-16T10:32:57.566223+0000","last_peered":"2024-02-16T10:32:57.566223+0000","last_clean":"2024-02-16T10:32:57.566223+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:32:57.566223+0000","last_undegraded":"2024-02-16T10:32:57.566223+0000","last_fullsized":"2024-02-16T10:32:57.566223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.566031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:17:13.287403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.579220+0000","last_change":"2024-02-16T10:32:50.579281+0000","last_active":"2024-02-16T10:32:50.579220+0000","last_peered":"2024-02-16T10:32:50.579220+0000","last_clean":"2024-02-16T10:32:50.579220+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:50.579220+0000","last_undegraded":"2024-02-16T10:32:50.579220+0000","last_fullsized":"2024-02-16T10:32:50.579220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.579036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:33:04.624348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.576029+0000","last_change":"2024-02-16T10:32:55.576097+0000","last_active":"2024-02-16T10:32:55.576029+0000","last_peered":"2024-02-16T10:32:55.576029+0000","last_clean":"2024-02-16T10:32:55.576029+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:32:55.576029+0000","last_undegraded":"2024-02-16T10:32:55.576029+0000","last_fullsized":"2024-02-16T10:32:55.576029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.575824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:56.390001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.190748+0000","last_change":"2024-02-16T10:32:36.190802+0000","last_active":"2024-02-16T10:32:36.190748+0000","last_peered":"2024-02-16T10:32:36.190748+0000","last_clean":"2024-02-16T10:32:36.190748+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:32:36.190748+0000","last_undegraded":"2024-02-16T10:32:36.190748+0000","last_fullsized":"2024-02-16T10:32:36.190748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.190560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:11.479999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.205255+0000","last_change":"2024-02-16T10:33:05.205325+0000","last_active":"2024-02-16T10:33:05.205255+0000","last_peered":"2024-02-16T10:33:05.205255+0000","last_clean":"2024-02-16T10:33:05.205255+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:33:05.205255+0000","last_undegraded":"2024-02-16T10:33:05.205255+0000","last_fullsized":"2024-02-16T10:33:05.205255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:39.392051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.677808+0000","last_change":"2024-02-16T10:32:37.677881+0000","last_active":"2024-02-16T10:32:37.677808+0000","last_peered":"2024-02-16T10:32:37.677808+0000","last_clean":"2024-02-16T10:32:37.677808+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:32:37.677808+0000","last_undegraded":"2024-02-16T10:32:37.677808+0000","last_fullsized":"2024-02-16T10:32:37.677808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.677622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:43.521167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.315982+0000","last_change":"2024-02-16T10:32:59.316060+0000","last_active":"2024-02-16T10:32:59.315982+0000","last_peered":"2024-02-16T10:32:59.315982+0000","last_clean":"2024-02-16T10:32:59.315982+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:32:59.315982+0000","last_undegraded":"2024-02-16T10:32:59.315982+0000","last_fullsized":"2024-02-16T10:32:59.315982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.315796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:07.517582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.299862+0000","last_change":"2024-02-16T10:32:56.299931+0000","last_active":"2024-02-16T10:32:56.299862+0000","last_peered":"2024-02-16T10:32:56.299862+0000","last_clean":"2024-02-16T10:32:56.299862+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:32:56.299862+0000","last_undegraded":"2024-02-16T10:32:56.299862+0000","last_fullsized":"2024-02-16T10:32:56.299862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.299671+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:59.215228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.641025+0000","last_change":"2024-02-16T10:33:05.641087+0000","last_active":"2024-02-16T10:33:05.641025+0000","last_peered":"2024-02-16T10:33:05.641025+0000","last_clean":"2024-02-16T10:33:05.641025+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:33:05.641025+0000","last_undegraded":"2024-02-16T10:33:05.641025+0000","last_fullsized":"2024-02-16T10:33:05.641025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.640833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:20.797119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.246185+0000","last_change":"2024-02-16T10:32:41.246185+0000","last_active":"2024-02-16T10:32:41.246185+0000","last_peered":"2024-02-16T10:32:41.246185+0000","last_clean":"2024-02-16T10:32:41.246185+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:32:41.246185+0000","last_undegraded":"2024-02-16T10:32:41.246185+0000","last_fullsized":"2024-02-16T10:32:41.246185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.245938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:09.620425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:21.049562+0000","last_change":"2024-02-16T10:33:21.049628+0000","last_active":"2024-02-16T10:33:21.049562+0000","last_peered":"2024-02-16T10:33:21.049562+0000","last_clean":"2024-02-16T10:33:21.049562+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:33:21.049562+0000","last_undegraded":"2024-02-16T10:33:21.049562+0000","last_fullsized":"2024-02-16T10:33:21.049562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:21.049344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:21.049344+0000","last_clean_scrub_stamp":"2024-02-16T10:33:21.049344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:58:46.546048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.952981+0000","last_change":"2024-02-16T10:32:47.952981+0000","last_active":"2024-02-16T10:32:47.952981+0000","last_peered":"2024-02-16T10:32:47.952981+0000","last_clean":"2024-02-16T10:32:47.952981+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:47.952981+0000","last_undegraded":"2024-02-16T10:32:47.952981+0000","last_fullsized":"2024-02-16T10:32:47.952981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.952562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:39.742244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.575826+0000","last_change":"2024-02-16T10:32:45.575891+0000","last_active":"2024-02-16T10:32:45.575826+0000","last_peered":"2024-02-16T10:32:45.575826+0000","last_clean":"2024-02-16T10:32:45.575826+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:32:45.575826+0000","last_undegraded":"2024-02-16T10:32:45.575826+0000","last_fullsized":"2024-02-16T10:32:45.575826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.575628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:23:09.375444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.598992+0000","last_change":"2024-02-16T10:32:44.598992+0000","last_active":"2024-02-16T10:32:44.598992+0000","last_peered":"2024-02-16T10:32:44.598992+0000","last_clean":"2024-02-16T10:32:44.598992+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:32:44.598992+0000","last_undegraded":"2024-02-16T10:32:44.598992+0000","last_fullsized":"2024-02-16T10:32:44.598992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.598712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:57.295017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.202881+0000","last_change":"2024-02-16T10:32:59.202949+0000","last_active":"2024-02-16T10:32:59.202881+0000","last_peered":"2024-02-16T10:32:59.202881+0000","last_clean":"2024-02-16T10:32:59.202881+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:32:59.202881+0000","last_undegraded":"2024-02-16T10:32:59.202881+0000","last_fullsized":"2024-02-16T10:32:59.202881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.202685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:45.027138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.214931+0000","last_change":"2024-02-16T10:32:52.214993+0000","last_active":"2024-02-16T10:32:52.214931+0000","last_peered":"2024-02-16T10:32:52.214931+0000","last_clean":"2024-02-16T10:32:52.214931+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:32:52.214931+0000","last_undegraded":"2024-02-16T10:32:52.214931+0000","last_fullsized":"2024-02-16T10:32:52.214931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.214700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:00.416486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.225619+0000","last_change":"2024-02-16T10:33:04.225678+0000","last_active":"2024-02-16T10:33:04.225619+0000","last_peered":"2024-02-16T10:33:04.225619+0000","last_clean":"2024-02-16T10:33:04.225619+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:33:04.225619+0000","last_undegraded":"2024-02-16T10:33:04.225619+0000","last_fullsized":"2024-02-16T10:33:04.225619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.225415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:09.053096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.293261+0000","last_change":"2024-02-16T10:32:45.293261+0000","last_active":"2024-02-16T10:32:45.293261+0000","last_peered":"2024-02-16T10:32:45.293261+0000","last_clean":"2024-02-16T10:32:45.293261+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:32:45.293261+0000","last_undegraded":"2024-02-16T10:32:45.293261+0000","last_fullsized":"2024-02-16T10:32:45.293261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.293004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:04.774717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:14.111853+0000","last_change":"2024-02-16T10:33:14.111920+0000","last_active":"2024-02-16T10:33:14.111853+0000","last_peered":"2024-02-16T10:33:14.111853+0000","last_clean":"2024-02-16T10:33:14.111853+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:33:14.111853+0000","last_undegraded":"2024-02-16T10:33:14.111853+0000","last_fullsized":"2024-02-16T10:33:14.111853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:14.111629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:14.111629+0000","last_clean_scrub_stamp":"2024-02-16T10:33:14.111629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:11:29.896314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.239268+0000","last_change":"2024-02-16T10:32:58.239330+0000","last_active":"2024-02-16T10:32:58.239268+0000","last_peered":"2024-02-16T10:32:58.239268+0000","last_clean":"2024-02-16T10:32:58.239268+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:32:58.239268+0000","last_undegraded":"2024-02-16T10:32:58.239268+0000","last_fullsized":"2024-02-16T10:32:58.239268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.239053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:24.581773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:22.033134+0000","last_change":"2024-02-16T10:33:22.033199+0000","last_active":"2024-02-16T10:33:22.033134+0000","last_peered":"2024-02-16T10:33:22.033134+0000","last_clean":"2024-02-16T10:33:22.033134+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:33:22.033134+0000","last_undegraded":"2024-02-16T10:33:22.033134+0000","last_fullsized":"2024-02-16T10:33:22.033134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:22.032918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:22.032918+0000","last_clean_scrub_stamp":"2024-02-16T10:33:22.032918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:34:29.482490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.834500+0000","last_change":"2024-02-16T10:32:25.834500+0000","last_active":"2024-02-16T10:32:25.834500+0000","last_peered":"2024-02-16T10:32:25.834500+0000","last_clean":"2024-02-16T10:32:25.834500+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:25.834500+0000","last_undegraded":"2024-02-16T10:32:25.834500+0000","last_fullsized":"2024-02-16T10:32:25.834500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.834247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:24.022521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.284240+0000","last_change":"2024-02-16T10:32:49.284313+0000","last_active":"2024-02-16T10:32:49.284240+0000","last_peered":"2024-02-16T10:32:49.284240+0000","last_clean":"2024-02-16T10:32:49.284240+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:32:49.284240+0000","last_undegraded":"2024-02-16T10:32:49.284240+0000","last_fullsized":"2024-02-16T10:32:49.284240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.284010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:24.829083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.208137+0000","last_change":"2024-02-16T10:32:50.208221+0000","last_active":"2024-02-16T10:32:50.208137+0000","last_peered":"2024-02-16T10:32:50.208137+0000","last_clean":"2024-02-16T10:32:50.208137+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:32:50.208137+0000","last_undegraded":"2024-02-16T10:32:50.208137+0000","last_fullsized":"2024-02-16T10:32:50.208137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.207953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:47.225247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:18.108000+0000","last_change":"2024-02-16T10:33:18.108059+0000","last_active":"2024-02-16T10:33:18.108000+0000","last_peered":"2024-02-16T10:33:18.108000+0000","last_clean":"2024-02-16T10:33:18.108000+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:33:18.108000+0000","last_undegraded":"2024-02-16T10:33:18.108000+0000","last_fullsized":"2024-02-16T10:33:18.108000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:18.107832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:18.107832+0000","last_clean_scrub_stamp":"2024-02-16T10:33:18.107832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:14.091400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.177112+0000","last_change":"2024-02-16T10:33:07.177182+0000","last_active":"2024-02-16T10:33:07.177112+0000","last_peered":"2024-02-16T10:33:07.177112+0000","last_clean":"2024-02-16T10:33:07.177112+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:33:07.177112+0000","last_undegraded":"2024-02-16T10:33:07.177112+0000","last_fullsized":"2024-02-16T10:33:07.177112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.176913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:41.892085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.631778+0000","last_change":"2024-02-16T10:32:39.631778+0000","last_active":"2024-02-16T10:32:39.631778+0000","last_peered":"2024-02-16T10:32:39.631778+0000","last_clean":"2024-02-16T10:32:39.631778+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:32:39.631778+0000","last_undegraded":"2024-02-16T10:32:39.631778+0000","last_fullsized":"2024-02-16T10:32:39.631778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.631520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:18:00.127318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.564996+0000","last_change":"2024-02-16T10:32:43.564996+0000","last_active":"2024-02-16T10:32:43.564996+0000","last_peered":"2024-02-16T10:32:43.564996+0000","last_clean":"2024-02-16T10:32:43.564996+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:32:43.564996+0000","last_undegraded":"2024-02-16T10:32:43.564996+0000","last_fullsized":"2024-02-16T10:32:43.564996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.564745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:47.346981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:15.165007+0000","last_change":"2024-02-16T10:33:15.165078+0000","last_active":"2024-02-16T10:33:15.165007+0000","last_peered":"2024-02-16T10:33:15.165007+0000","last_clean":"2024-02-16T10:33:15.165007+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:33:15.165007+0000","last_undegraded":"2024-02-16T10:33:15.165007+0000","last_fullsized":"2024-02-16T10:33:15.165007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:15.164794+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:15.164794+0000","last_clean_scrub_stamp":"2024-02-16T10:33:15.164794+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:57.912596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705707,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.55700000000000005,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.60499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":1.268,"15min":1.268},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.74399999999999999,"5min":1.139,"15min":1.139},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.76700000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.53000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86499999999999999,"15min":0.95299999999999996},"min":{"1min":0.54400000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82699999999999996,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.61399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.212,"15min":1.4950000000000001},"min":{"1min":0.44600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.752,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.75900000000000001,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.74099999999999999,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":1.103,"15min":1.2949999999999999},"min":{"1min":0.52600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.81999999999999995,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.68100000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.622},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.77600000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.46200000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.74199999999999999,"5min":1.022,"15min":1.022},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.48999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.55400000000000005,"5min":0.251,"15min":0.251},"max":{"1min":0.81299999999999994,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67800000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.60799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.56200000000000006,"5min":0.378,"15min":0.378},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78500000000000003}]},{"osd":2,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89900000000000002,"5min":1.115,"15min":1.115},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.61399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.61599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95499999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.90400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:33:35.650 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-16T10:30:29.041869+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=29, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.651 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-16T10:30:25.014972+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.651 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.652 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.652 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.653 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.653 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.653 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-02-16T10:30:35.084217+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=30, tm_sec=35, tm_wday=4, tm_yday=47, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=16, tm_hour=10, tm_min=32, tm_sec=10, tm_wday=4, tm_yday=47, tm_isdst=0) 2024-02-16T10:33:35.654 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-16T10:33:55.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-16T10:33:55.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.781+0000 7fe63a5c1640 1 Processor -- start 2024-02-16T10:33:55.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.781+0000 7fe63a5c1640 1 -- start start 2024-02-16T10:33:55.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe63412af60 0x7fe63412b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe634071480 con 0x7fe6341274c0 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63409c000 con 0x7fe63412af60 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe633fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe63412af60 0x7fe63412b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe62b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe6341274c0 0x7fe634127940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59274/0 (socket says 172.21.15.107:59274) 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe62b7fe640 1 -- 172.21.15.107:0/437277841 learned_addr learned my addr 172.21.15.107:0/437277841 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe633fff640 1 -- 172.21.15.107:0/437277841 >> v1:172.21.15.107:6789/0 conn(0x7fe6341274c0 legacy=0x7fe634127940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:55.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe633fff640 1 -- 172.21.15.107:0/437277841 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63412ad40 con 0x7fe63412af60 2024-02-16T10:33:55.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe633fff640 1 --2- 172.21.15.107:0/437277841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe63412af60 0x7fe63412b340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe624009740 tx=0x7fe62401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaea2ee5bdcde38 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:55.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe6337fe640 1 -- 172.21.15.107:0/437277841 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6240ab530 con 0x7fe63412af60 2024-02-16T10:33:55.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe6337fe640 1 -- 172.21.15.107:0/437277841 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240a7050 con 0x7fe63412af60 2024-02-16T10:33:55.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe6337fe640 1 -- 172.21.15.107:0/437277841 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6240ab7e0 con 0x7fe63412af60 2024-02-16T10:33:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- 172.21.15.107:0/437277841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe63412af60 msgr2=0x7fe63412b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/437277841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe63412af60 0x7fe63412b340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe624009740 tx=0x7fe62401c370 comp rx=0 tx=0).stop 2024-02-16T10:33:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- 172.21.15.107:0/437277841 shutdown_connections 2024-02-16T10:33:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/437277841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe63412af60 0x7fe63412b340 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:55.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- 172.21.15.107:0/437277841 >> 172.21.15.107:0/437277841 conn(0x7fe63409a1c0 msgr2=0x7fe63409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:55.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- 172.21.15.107:0/437277841 shutdown_connections 2024-02-16T10:33:55.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.785+0000 7fe63a5c1640 1 -- 172.21.15.107:0/437277841 wait complete. 2024-02-16T10:33:55.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 Processor -- start 2024-02-16T10:33:55.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 -- start start 2024-02-16T10:33:55.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:55.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe634115010 con 0x7fe6341274c0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe633fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe633fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55216/0 (socket says 172.21.15.107:55216) 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe633fff640 1 -- 172.21.15.107:0/2441915718 learned_addr learned my addr 172.21.15.107:0/2441915718 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe633fff640 1 -- 172.21.15.107:0/2441915718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624009420 con 0x7fe6341274c0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe633fff640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae040 tx=0x7fe62401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6240b7450 con 0x7fe6341274c0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240b75b0 con 0x7fe6341274c0 2024-02-16T10:33:55.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6240b7890 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe634130970 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63412fcb0 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7fe6240b79f0 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe634115150 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 0x7fe614037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe6240e3140 con 0x7fe6341274c0 2024-02-16T10:33:55.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.789+0000 7fe62b7fe640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 0x7fe614037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.793+0000 7fe62b7fe640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 0x7fe614037ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001610 tx=0x7fe61c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:55.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.793+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6240c74e0 con 0x7fe6341274c0 2024-02-16T10:33:55.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.949+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 --> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe634113fc0 con 0x7fe614035a10 2024-02-16T10:33:56.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:55.997+0000 7fe6317fa640 1 -- 172.21.15.107:0/2441915718 <== mgr.4101 v2:172.21.15.138:6824/2589059759 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+674187 (secure 0 0 0) 0x7fe634113fc0 con 0x7fe614035a10 2024-02-16T10:33:56.008 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-02-16T10:33:56.014 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 msgr2=0x7fe614037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 0x7fe614037ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe61c001610 tx=0x7fe61c007ad0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 msgr2=0x7fe634120920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae040 tx=0x7fe62401abb0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 shutdown_connections 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7fe614035a10 0x7fe614037ed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 --2- 172.21.15.107:0/2441915718 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6341274c0 0x7fe634120920 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 >> 172.21.15.107:0/2441915718 conn(0x7fe63409a1c0 msgr2=0x7fe63406d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:56.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 shutdown_connections 2024-02-16T10:33:56.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.005+0000 7fe63a5c1640 1 -- 172.21.15.107:0/2441915718 wait complete. 2024-02-16T10:33:56.027 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-02-16T10:33:55.917006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600110,"num_objects":213,"num_object_clones":0,"num_object_copies":428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4009,"num_read_kb":3655,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2054,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1785180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005801"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.286924+0000","last_change":"2024-02-16T10:32:51.287001+0000","last_active":"2024-02-16T10:32:51.286924+0000","last_peered":"2024-02-16T10:32:51.286924+0000","last_clean":"2024-02-16T10:32:51.286924+0000","last_became_active":"2024-02-16T10:30:26.082274+0000","last_became_peered":"2024-02-16T10:30:26.082274+0000","last_unstale":"2024-02-16T10:32:51.286924+0000","last_undegraded":"2024-02-16T10:32:51.286924+0000","last_fullsized":"2024-02-16T10:32:51.286924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:51.286736+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.286736+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:29.643046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.252936+0000","last_change":"2024-02-16T10:32:46.252936+0000","last_active":"2024-02-16T10:32:46.252936+0000","last_peered":"2024-02-16T10:32:46.252936+0000","last_clean":"2024-02-16T10:32:46.252936+0000","last_became_active":"2024-02-16T10:30:28.072054+0000","last_became_peered":"2024-02-16T10:30:28.072054+0000","last_unstale":"2024-02-16T10:32:46.252936+0000","last_undegraded":"2024-02-16T10:32:46.252936+0000","last_fullsized":"2024-02-16T10:32:46.252936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.252657+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.252657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:46.929942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.621221+0000","last_change":"2024-02-16T10:33:03.621303+0000","last_active":"2024-02-16T10:33:03.621221+0000","last_peered":"2024-02-16T10:33:03.621221+0000","last_clean":"2024-02-16T10:33:03.621221+0000","last_became_active":"2024-02-16T10:30:26.086017+0000","last_became_peered":"2024-02-16T10:30:26.086017+0000","last_unstale":"2024-02-16T10:33:03.621221+0000","last_undegraded":"2024-02-16T10:33:03.621221+0000","last_fullsized":"2024-02-16T10:33:03.621221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.621029+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.621029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:54.673180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.055307+0000","last_change":"2024-02-16T10:33:02.055365+0000","last_active":"2024-02-16T10:33:02.055307+0000","last_peered":"2024-02-16T10:33:02.055307+0000","last_clean":"2024-02-16T10:33:02.055307+0000","last_became_active":"2024-02-16T10:30:28.059886+0000","last_became_peered":"2024-02-16T10:30:28.059886+0000","last_unstale":"2024-02-16T10:33:02.055307+0000","last_undegraded":"2024-02-16T10:33:02.055307+0000","last_fullsized":"2024-02-16T10:33:02.055307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.055114+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.055114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:47:50.528621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:16.116215+0000","last_change":"2024-02-16T10:33:16.116374+0000","last_active":"2024-02-16T10:33:16.116215+0000","last_peered":"2024-02-16T10:33:16.116215+0000","last_clean":"2024-02-16T10:33:16.116215+0000","last_became_active":"2024-02-16T10:30:26.068621+0000","last_became_peered":"2024-02-16T10:30:26.068621+0000","last_unstale":"2024-02-16T10:33:16.116215+0000","last_undegraded":"2024-02-16T10:33:16.116215+0000","last_fullsized":"2024-02-16T10:33:16.116215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:16.115973+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:16.115973+0000","last_clean_scrub_stamp":"2024-02-16T10:33:16.115973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:06:41.769581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.003805+0000","last_change":"2024-02-16T10:32:59.003805+0000","last_active":"2024-02-16T10:32:59.003805+0000","last_peered":"2024-02-16T10:32:59.003805+0000","last_clean":"2024-02-16T10:32:59.003805+0000","last_became_active":"2024-02-16T10:30:28.061526+0000","last_became_peered":"2024-02-16T10:30:28.061526+0000","last_unstale":"2024-02-16T10:32:59.003805+0000","last_undegraded":"2024-02-16T10:32:59.003805+0000","last_fullsized":"2024-02-16T10:32:59.003805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.003421+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.003421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:59.223960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.297606+0000","last_change":"2024-02-16T10:32:53.297683+0000","last_active":"2024-02-16T10:32:53.297606+0000","last_peered":"2024-02-16T10:32:53.297606+0000","last_clean":"2024-02-16T10:32:53.297606+0000","last_became_active":"2024-02-16T10:30:26.077886+0000","last_became_peered":"2024-02-16T10:30:26.077886+0000","last_unstale":"2024-02-16T10:32:53.297606+0000","last_undegraded":"2024-02-16T10:32:53.297606+0000","last_fullsized":"2024-02-16T10:32:53.297606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:53.297394+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.297394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:53.974678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.986589+0000","last_change":"2024-02-16T10:32:57.986589+0000","last_active":"2024-02-16T10:32:57.986589+0000","last_peered":"2024-02-16T10:32:57.986589+0000","last_clean":"2024-02-16T10:32:57.986589+0000","last_became_active":"2024-02-16T10:30:28.066545+0000","last_became_peered":"2024-02-16T10:30:28.066545+0000","last_unstale":"2024-02-16T10:32:57.986589+0000","last_undegraded":"2024-02-16T10:32:57.986589+0000","last_fullsized":"2024-02-16T10:32:57.986589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.986335+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.986335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:27:45.120448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:29.998372+0000","last_change":"2024-02-16T10:33:29.998539+0000","last_active":"2024-02-16T10:33:29.998372+0000","last_peered":"2024-02-16T10:33:29.998372+0000","last_clean":"2024-02-16T10:33:29.998372+0000","last_became_active":"2024-02-16T10:30:26.066950+0000","last_became_peered":"2024-02-16T10:30:26.066950+0000","last_unstale":"2024-02-16T10:33:29.998372+0000","last_undegraded":"2024-02-16T10:33:29.998372+0000","last_fullsized":"2024-02-16T10:33:29.998372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:33:29.998096+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:33:29.998096+0000","last_clean_scrub_stamp":"2024-02-16T10:33:29.998096+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:18:59.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":8,"num_write":15,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.266000+0000","last_change":"2024-02-16T10:32:43.266072+0000","last_active":"2024-02-16T10:32:43.266000+0000","last_peered":"2024-02-16T10:32:43.266000+0000","last_clean":"2024-02-16T10:32:43.266000+0000","last_became_active":"2024-02-16T10:30:28.080244+0000","last_became_peered":"2024-02-16T10:30:28.080244+0000","last_unstale":"2024-02-16T10:32:43.266000+0000","last_undegraded":"2024-02-16T10:32:43.266000+0000","last_fullsized":"2024-02-16T10:32:43.266000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:43.265822+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.265822+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:11.123964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.300998+0000","last_change":"2024-02-16T10:32:54.300998+0000","last_active":"2024-02-16T10:32:54.300998+0000","last_peered":"2024-02-16T10:32:54.300998+0000","last_clean":"2024-02-16T10:32:54.300998+0000","last_became_active":"2024-02-16T10:30:26.077190+0000","last_became_peered":"2024-02-16T10:30:26.077190+0000","last_unstale":"2024-02-16T10:32:54.300998+0000","last_undegraded":"2024-02-16T10:32:54.300998+0000","last_fullsized":"2024-02-16T10:32:54.300998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:54.300740+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.300740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:06.997045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.953068+0000","last_change":"2024-02-16T10:32:31.953068+0000","last_active":"2024-02-16T10:32:31.953068+0000","last_peered":"2024-02-16T10:32:31.953068+0000","last_clean":"2024-02-16T10:32:31.953068+0000","last_became_active":"2024-02-16T10:30:28.083360+0000","last_became_peered":"2024-02-16T10:30:28.083360+0000","last_unstale":"2024-02-16T10:32:31.953068+0000","last_undegraded":"2024-02-16T10:32:31.953068+0000","last_fullsized":"2024-02-16T10:32:31.953068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:31.952772+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.952772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:14.372551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.091844+0000","last_change":"2024-02-16T10:33:03.091915+0000","last_active":"2024-02-16T10:33:03.091844+0000","last_peered":"2024-02-16T10:33:03.091844+0000","last_clean":"2024-02-16T10:33:03.091844+0000","last_became_active":"2024-02-16T10:30:26.092195+0000","last_became_peered":"2024-02-16T10:30:26.092195+0000","last_unstale":"2024-02-16T10:33:03.091844+0000","last_undegraded":"2024-02-16T10:33:03.091844+0000","last_fullsized":"2024-02-16T10:33:03.091844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.091594+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.091594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:02.360828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.337640+0000","last_change":"2024-02-16T10:32:35.337640+0000","last_active":"2024-02-16T10:32:35.337640+0000","last_peered":"2024-02-16T10:32:35.337640+0000","last_clean":"2024-02-16T10:32:35.337640+0000","last_became_active":"2024-02-16T10:30:28.078386+0000","last_became_peered":"2024-02-16T10:30:28.078386+0000","last_unstale":"2024-02-16T10:32:35.337640+0000","last_undegraded":"2024-02-16T10:32:35.337640+0000","last_fullsized":"2024-02-16T10:32:35.337640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.337391+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.337391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:00:00.524461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.625149+0000","last_change":"2024-02-16T10:33:04.625313+0000","last_active":"2024-02-16T10:33:04.625149+0000","last_peered":"2024-02-16T10:33:04.625149+0000","last_clean":"2024-02-16T10:33:04.625149+0000","last_became_active":"2024-02-16T10:30:26.086568+0000","last_became_peered":"2024-02-16T10:30:26.086568+0000","last_unstale":"2024-02-16T10:33:04.625149+0000","last_undegraded":"2024-02-16T10:33:04.625149+0000","last_fullsized":"2024-02-16T10:33:04.625149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.624916+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.624916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:59.652953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.340659+0000","last_change":"2024-02-16T10:32:38.340723+0000","last_active":"2024-02-16T10:32:38.340659+0000","last_peered":"2024-02-16T10:32:38.340659+0000","last_clean":"2024-02-16T10:32:38.340659+0000","last_became_active":"2024-02-16T10:30:28.062161+0000","last_became_peered":"2024-02-16T10:30:28.062161+0000","last_unstale":"2024-02-16T10:32:38.340659+0000","last_undegraded":"2024-02-16T10:32:38.340659+0000","last_fullsized":"2024-02-16T10:32:38.340659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:38.340456+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.340456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:20.043427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.032266+0000","last_change":"2024-02-16T10:33:00.032324+0000","last_active":"2024-02-16T10:33:00.032266+0000","last_peered":"2024-02-16T10:33:00.032266+0000","last_clean":"2024-02-16T10:33:00.032266+0000","last_became_active":"2024-02-16T10:30:28.060160+0000","last_became_peered":"2024-02-16T10:30:28.060160+0000","last_unstale":"2024-02-16T10:33:00.032266+0000","last_undegraded":"2024-02-16T10:33:00.032266+0000","last_fullsized":"2024-02-16T10:33:00.032266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:00.031986+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.031986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:22:09.549907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.250297+0000","last_change":"2024-02-16T10:32:49.250297+0000","last_active":"2024-02-16T10:32:49.250297+0000","last_peered":"2024-02-16T10:32:49.250297+0000","last_clean":"2024-02-16T10:32:49.250297+0000","last_became_active":"2024-02-16T10:30:26.097043+0000","last_became_peered":"2024-02-16T10:30:26.097043+0000","last_unstale":"2024-02-16T10:32:49.250297+0000","last_undegraded":"2024-02-16T10:32:49.250297+0000","last_fullsized":"2024-02-16T10:32:49.250297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.250012+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:50.603059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.176433+0000","last_change":"2024-02-16T10:32:37.176433+0000","last_active":"2024-02-16T10:32:37.176433+0000","last_peered":"2024-02-16T10:32:37.176433+0000","last_clean":"2024-02-16T10:32:37.176433+0000","last_became_active":"2024-02-16T10:30:28.073007+0000","last_became_peered":"2024-02-16T10:30:28.073007+0000","last_unstale":"2024-02-16T10:32:37.176433+0000","last_undegraded":"2024-02-16T10:32:37.176433+0000","last_fullsized":"2024-02-16T10:32:37.176433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.176164+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.176164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:03.368447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.273865+0000","last_change":"2024-02-16T10:32:43.273865+0000","last_active":"2024-02-16T10:32:43.273865+0000","last_peered":"2024-02-16T10:32:43.273865+0000","last_clean":"2024-02-16T10:32:43.273865+0000","last_became_active":"2024-02-16T10:30:26.082974+0000","last_became_peered":"2024-02-16T10:30:26.082974+0000","last_unstale":"2024-02-16T10:32:43.273865+0000","last_undegraded":"2024-02-16T10:32:43.273865+0000","last_fullsized":"2024-02-16T10:32:43.273865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:43.273587+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.273587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:18.563027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'10","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.240319+0000","last_change":"2024-02-16T10:32:40.240319+0000","last_active":"2024-02-16T10:32:40.240319+0000","last_peered":"2024-02-16T10:32:40.240319+0000","last_clean":"2024-02-16T10:32:40.240319+0000","last_became_active":"2024-02-16T10:30:28.075315+0000","last_became_peered":"2024-02-16T10:30:28.075315+0000","last_unstale":"2024-02-16T10:32:40.240319+0000","last_undegraded":"2024-02-16T10:32:40.240319+0000","last_fullsized":"2024-02-16T10:32:40.240319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.239977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.239977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:18.554745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.263487+0000","last_change":"2024-02-16T10:33:07.263547+0000","last_active":"2024-02-16T10:33:07.263487+0000","last_peered":"2024-02-16T10:33:07.263487+0000","last_clean":"2024-02-16T10:33:07.263487+0000","last_became_active":"2024-02-16T10:30:26.091197+0000","last_became_peered":"2024-02-16T10:30:26.091197+0000","last_unstale":"2024-02-16T10:33:07.263487+0000","last_undegraded":"2024-02-16T10:33:07.263487+0000","last_fullsized":"2024-02-16T10:33:07.263487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.263284+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.263284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:58.315436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.593305+0000","last_change":"2024-02-16T10:32:46.593305+0000","last_active":"2024-02-16T10:32:46.593305+0000","last_peered":"2024-02-16T10:32:46.593305+0000","last_clean":"2024-02-16T10:32:46.593305+0000","last_became_active":"2024-02-16T10:30:28.065694+0000","last_became_peered":"2024-02-16T10:30:28.065694+0000","last_unstale":"2024-02-16T10:32:46.593305+0000","last_undegraded":"2024-02-16T10:32:46.593305+0000","last_fullsized":"2024-02-16T10:32:46.593305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:46.593037+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.593037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:59:45.718528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.193382+0000","last_change":"2024-02-16T10:32:51.193449+0000","last_active":"2024-02-16T10:32:51.193382+0000","last_peered":"2024-02-16T10:32:51.193382+0000","last_clean":"2024-02-16T10:32:51.193382+0000","last_became_active":"2024-02-16T10:30:26.097227+0000","last_became_peered":"2024-02-16T10:30:26.097227+0000","last_unstale":"2024-02-16T10:32:51.193382+0000","last_undegraded":"2024-02-16T10:32:51.193382+0000","last_fullsized":"2024-02-16T10:32:51.193382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.193190+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.193190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:27.003267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.354961+0000","last_change":"2024-02-16T10:33:00.355034+0000","last_active":"2024-02-16T10:33:00.354961+0000","last_peered":"2024-02-16T10:33:00.354961+0000","last_clean":"2024-02-16T10:33:00.354961+0000","last_became_active":"2024-02-16T10:30:28.068703+0000","last_became_peered":"2024-02-16T10:30:28.068703+0000","last_unstale":"2024-02-16T10:33:00.354961+0000","last_undegraded":"2024-02-16T10:33:00.354961+0000","last_fullsized":"2024-02-16T10:33:00.354961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:00.354775+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.354775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:31.134954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.595681+0000","last_change":"2024-02-16T10:32:53.595817+0000","last_active":"2024-02-16T10:32:53.595681+0000","last_peered":"2024-02-16T10:32:53.595681+0000","last_clean":"2024-02-16T10:32:53.595681+0000","last_became_active":"2024-02-16T10:30:26.095554+0000","last_became_peered":"2024-02-16T10:30:26.095554+0000","last_unstale":"2024-02-16T10:32:53.595681+0000","last_undegraded":"2024-02-16T10:32:53.595681+0000","last_fullsized":"2024-02-16T10:32:53.595681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.595459+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.595459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:21.588183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.224650+0000","last_change":"2024-02-16T10:32:39.224650+0000","last_active":"2024-02-16T10:32:39.224650+0000","last_peered":"2024-02-16T10:32:39.224650+0000","last_clean":"2024-02-16T10:32:39.224650+0000","last_became_active":"2024-02-16T10:30:28.082474+0000","last_became_peered":"2024-02-16T10:30:28.082474+0000","last_unstale":"2024-02-16T10:32:39.224650+0000","last_undegraded":"2024-02-16T10:32:39.224650+0000","last_fullsized":"2024-02-16T10:32:39.224650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:39.224377+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.224377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:54.677431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:28.981765+0000","last_change":"2024-02-16T10:33:28.981830+0000","last_active":"2024-02-16T10:33:28.981765+0000","last_peered":"2024-02-16T10:33:28.981765+0000","last_clean":"2024-02-16T10:33:28.981765+0000","last_became_active":"2024-02-16T10:30:26.067124+0000","last_became_peered":"2024-02-16T10:30:26.067124+0000","last_unstale":"2024-02-16T10:33:28.981765+0000","last_undegraded":"2024-02-16T10:33:28.981765+0000","last_fullsized":"2024-02-16T10:33:28.981765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:28.981556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:28.981556+0000","last_clean_scrub_stamp":"2024-02-16T10:33:28.981556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:02:16.551230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'21","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.249451+0000","last_change":"2024-02-16T10:32:42.249451+0000","last_active":"2024-02-16T10:32:42.249451+0000","last_peered":"2024-02-16T10:32:42.249451+0000","last_clean":"2024-02-16T10:32:42.249451+0000","last_became_active":"2024-02-16T10:30:36.141899+0000","last_became_peered":"2024-02-16T10:30:36.141899+0000","last_unstale":"2024-02-16T10:32:42.249451+0000","last_undegraded":"2024-02-16T10:32:42.249451+0000","last_fullsized":"2024-02-16T10:32:42.249451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:42.249133+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.249133+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:17.794206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":55,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.013994+0000","last_change":"2024-02-16T10:32:55.014055+0000","last_active":"2024-02-16T10:32:55.013994+0000","last_peered":"2024-02-16T10:32:55.013994+0000","last_clean":"2024-02-16T10:32:55.013994+0000","last_became_active":"2024-02-16T10:30:28.067716+0000","last_became_peered":"2024-02-16T10:30:28.067716+0000","last_unstale":"2024-02-16T10:32:55.013994+0000","last_undegraded":"2024-02-16T10:32:55.013994+0000","last_fullsized":"2024-02-16T10:32:55.013994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:55.013774+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.013774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:43:39.758624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.115174+0000","last_change":"2024-02-16T10:33:12.115247+0000","last_active":"2024-02-16T10:33:12.115174+0000","last_peered":"2024-02-16T10:33:12.115174+0000","last_clean":"2024-02-16T10:33:12.115174+0000","last_became_active":"2024-02-16T10:30:26.080227+0000","last_became_peered":"2024-02-16T10:30:26.080227+0000","last_unstale":"2024-02-16T10:33:12.115174+0000","last_undegraded":"2024-02-16T10:33:12.115174+0000","last_fullsized":"2024-02-16T10:33:12.115174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:12.114964+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:12.114964+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.114964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:13:14.461557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:38.038065+0000","last_change":"2024-02-16T10:33:38.038120+0000","last_active":"2024-02-16T10:33:38.038065+0000","last_peered":"2024-02-16T10:33:38.038065+0000","last_clean":"2024-02-16T10:33:38.038065+0000","last_became_active":"2024-02-16T10:31:06.937444+0000","last_became_peered":"2024-02-16T10:31:06.937444+0000","last_unstale":"2024-02-16T10:33:38.038065+0000","last_undegraded":"2024-02-16T10:33:38.038065+0000","last_fullsized":"2024-02-16T10:33:38.038065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:38.037886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:38.037886+0000","last_clean_scrub_stamp":"2024-02-16T10:33:38.037886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:26:36.937299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.978713+0000","last_change":"2024-02-16T10:32:32.978713+0000","last_active":"2024-02-16T10:32:32.978713+0000","last_peered":"2024-02-16T10:32:32.978713+0000","last_clean":"2024-02-16T10:32:32.978713+0000","last_became_active":"2024-02-16T10:30:32.120304+0000","last_became_peered":"2024-02-16T10:30:32.120304+0000","last_unstale":"2024-02-16T10:32:32.978713+0000","last_undegraded":"2024-02-16T10:32:32.978713+0000","last_fullsized":"2024-02-16T10:32:32.978713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:32.978443+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.978443+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:07.123372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.263617+0000","last_change":"2024-02-16T10:32:26.263617+0000","last_active":"2024-02-16T10:32:26.263617+0000","last_peered":"2024-02-16T10:32:26.263617+0000","last_clean":"2024-02-16T10:32:26.263617+0000","last_became_active":"2024-02-16T10:30:34.124842+0000","last_became_peered":"2024-02-16T10:30:34.124842+0000","last_unstale":"2024-02-16T10:32:26.263617+0000","last_undegraded":"2024-02-16T10:32:26.263617+0000","last_fullsized":"2024-02-16T10:32:26.263617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:26.263353+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.263353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:40.727544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.203597+0000","last_change":"2024-02-16T10:33:12.203657+0000","last_active":"2024-02-16T10:33:12.203597+0000","last_peered":"2024-02-16T10:33:12.203597+0000","last_clean":"2024-02-16T10:33:12.203597+0000","last_became_active":"2024-02-16T10:30:36.150806+0000","last_became_peered":"2024-02-16T10:30:36.150806+0000","last_unstale":"2024-02-16T10:33:12.203597+0000","last_undegraded":"2024-02-16T10:33:12.203597+0000","last_fullsized":"2024-02-16T10:33:12.203597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:12.203402+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:12.203402+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.203402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:19:41.688818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.341484+0000","last_change":"2024-02-16T10:33:07.341484+0000","last_active":"2024-02-16T10:33:07.341484+0000","last_peered":"2024-02-16T10:33:07.341484+0000","last_clean":"2024-02-16T10:33:07.341484+0000","last_became_active":"2024-02-16T10:31:06.925825+0000","last_became_peered":"2024-02-16T10:31:06.925825+0000","last_unstale":"2024-02-16T10:33:07.341484+0000","last_undegraded":"2024-02-16T10:33:07.341484+0000","last_fullsized":"2024-02-16T10:33:07.341484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:07.341236+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.341236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:08.832698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.337168+0000","last_change":"2024-02-16T10:32:55.337229+0000","last_active":"2024-02-16T10:32:55.337168+0000","last_peered":"2024-02-16T10:32:55.337168+0000","last_clean":"2024-02-16T10:32:55.337168+0000","last_became_active":"2024-02-16T10:30:26.077812+0000","last_became_peered":"2024-02-16T10:30:26.077812+0000","last_unstale":"2024-02-16T10:32:55.337168+0000","last_undegraded":"2024-02-16T10:32:55.337168+0000","last_fullsized":"2024-02-16T10:32:55.337168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.336944+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.336944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:53.525218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:14.173480+0000","last_change":"2024-02-16T10:33:14.173480+0000","last_active":"2024-02-16T10:33:14.173480+0000","last_peered":"2024-02-16T10:33:14.173480+0000","last_clean":"2024-02-16T10:33:14.173480+0000","last_became_active":"2024-02-16T10:31:06.924389+0000","last_became_peered":"2024-02-16T10:31:06.924389+0000","last_unstale":"2024-02-16T10:33:14.173480+0000","last_undegraded":"2024-02-16T10:33:14.173480+0000","last_fullsized":"2024-02-16T10:33:14.173480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:14.173244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:14.173244+0000","last_clean_scrub_stamp":"2024-02-16T10:33:14.173244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:37.595191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.304935+0000","last_change":"2024-02-16T10:32:16.304935+0000","last_active":"2024-02-16T10:32:16.304935+0000","last_peered":"2024-02-16T10:32:16.304935+0000","last_clean":"2024-02-16T10:32:16.304935+0000","last_became_active":"2024-02-16T10:30:32.094685+0000","last_became_peered":"2024-02-16T10:30:32.094685+0000","last_unstale":"2024-02-16T10:32:16.304935+0000","last_undegraded":"2024-02-16T10:32:16.304935+0000","last_fullsized":"2024-02-16T10:32:16.304935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-02-16T10:32:16.304645+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.304645+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:45.895015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.217226+0000","last_change":"2024-02-16T10:32:30.217226+0000","last_active":"2024-02-16T10:32:30.217226+0000","last_peered":"2024-02-16T10:32:30.217226+0000","last_clean":"2024-02-16T10:32:30.217226+0000","last_became_active":"2024-02-16T10:30:34.131780+0000","last_became_peered":"2024-02-16T10:30:34.131780+0000","last_unstale":"2024-02-16T10:32:30.217226+0000","last_undegraded":"2024-02-16T10:32:30.217226+0000","last_fullsized":"2024-02-16T10:32:30.217226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.216971+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.216971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:22.338282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.648137+0000","last_change":"2024-02-16T10:33:11.648303+0000","last_active":"2024-02-16T10:33:11.648137+0000","last_peered":"2024-02-16T10:33:11.648137+0000","last_clean":"2024-02-16T10:33:11.648137+0000","last_became_active":"2024-02-16T10:30:36.140216+0000","last_became_peered":"2024-02-16T10:30:36.140216+0000","last_unstale":"2024-02-16T10:33:11.648137+0000","last_undegraded":"2024-02-16T10:33:11.648137+0000","last_fullsized":"2024-02-16T10:33:11.648137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:11.647914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:11.647914+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.647914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:43.754736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.975475+0000","last_change":"2024-02-16T10:32:51.975475+0000","last_active":"2024-02-16T10:32:51.975475+0000","last_peered":"2024-02-16T10:32:51.975475+0000","last_clean":"2024-02-16T10:32:51.975475+0000","last_became_active":"2024-02-16T10:30:28.067648+0000","last_became_peered":"2024-02-16T10:30:28.067648+0000","last_unstale":"2024-02-16T10:32:51.975475+0000","last_undegraded":"2024-02-16T10:32:51.975475+0000","last_fullsized":"2024-02-16T10:32:51.975475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:51.975220+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.975220+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:10:24.082042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:19.063296+0000","last_change":"2024-02-16T10:33:19.063363+0000","last_active":"2024-02-16T10:33:19.063296+0000","last_peered":"2024-02-16T10:33:19.063296+0000","last_clean":"2024-02-16T10:33:19.063296+0000","last_became_active":"2024-02-16T10:30:26.082820+0000","last_became_peered":"2024-02-16T10:30:26.082820+0000","last_unstale":"2024-02-16T10:33:19.063296+0000","last_undegraded":"2024-02-16T10:33:19.063296+0000","last_fullsized":"2024-02-16T10:33:19.063296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:19.063078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:19.063078+0000","last_clean_scrub_stamp":"2024-02-16T10:33:19.063078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:29:00.965928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.731408+0000","last_change":"2024-02-16T10:32:31.731408+0000","last_active":"2024-02-16T10:32:31.731408+0000","last_peered":"2024-02-16T10:32:31.731408+0000","last_clean":"2024-02-16T10:32:31.731408+0000","last_became_active":"2024-02-16T10:30:30.079578+0000","last_became_peered":"2024-02-16T10:30:30.079578+0000","last_unstale":"2024-02-16T10:32:31.731408+0000","last_undegraded":"2024-02-16T10:32:31.731408+0000","last_fullsized":"2024-02-16T10:32:31.731408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.731089+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.731089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:38.247219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.284906+0000","last_change":"2024-02-16T10:32:19.284906+0000","last_active":"2024-02-16T10:32:19.284906+0000","last_peered":"2024-02-16T10:32:19.284906+0000","last_clean":"2024-02-16T10:32:19.284906+0000","last_became_active":"2024-02-16T10:30:32.095653+0000","last_became_peered":"2024-02-16T10:30:32.095653+0000","last_unstale":"2024-02-16T10:32:19.284906+0000","last_undegraded":"2024-02-16T10:32:19.284906+0000","last_fullsized":"2024-02-16T10:32:19.284906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:19.284625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.284625+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:21:24.273342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'244","reported_seq":316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.940256+0000","last_change":"2024-02-16T10:32:40.940256+0000","last_active":"2024-02-16T10:32:40.940256+0000","last_peered":"2024-02-16T10:32:40.940256+0000","last_clean":"2024-02-16T10:32:40.940256+0000","last_became_active":"2024-02-16T10:30:34.141314+0000","last_became_peered":"2024-02-16T10:30:34.141314+0000","last_unstale":"2024-02-16T10:32:40.940256+0000","last_undegraded":"2024-02-16T10:32:40.940256+0000","last_fullsized":"2024-02-16T10:32:40.940256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'244","last_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_deep_scrub":"33'244","last_deep_scrub_stamp":"2024-02-16T10:32:40.939974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.939974+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:39.316923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.379056+0000","last_change":"2024-02-16T10:32:34.379056+0000","last_active":"2024-02-16T10:32:34.379056+0000","last_peered":"2024-02-16T10:32:34.379056+0000","last_clean":"2024-02-16T10:32:34.379056+0000","last_became_active":"2024-02-16T10:30:36.134946+0000","last_became_peered":"2024-02-16T10:30:36.134946+0000","last_unstale":"2024-02-16T10:32:34.379056+0000","last_undegraded":"2024-02-16T10:32:34.379056+0000","last_fullsized":"2024-02-16T10:32:34.379056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.378676+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.378676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:48.842868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'6","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.644457+0000","last_change":"2024-02-16T10:32:38.644457+0000","last_active":"2024-02-16T10:32:38.644457+0000","last_peered":"2024-02-16T10:32:38.644457+0000","last_clean":"2024-02-16T10:32:38.644457+0000","last_became_active":"2024-02-16T10:30:28.087889+0000","last_became_peered":"2024-02-16T10:30:28.087889+0000","last_unstale":"2024-02-16T10:32:38.644457+0000","last_undegraded":"2024-02-16T10:32:38.644457+0000","last_fullsized":"2024-02-16T10:32:38.644457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:38.644187+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.644187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:07.018674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.216949+0000","last_change":"2024-02-16T10:33:01.217013+0000","last_active":"2024-02-16T10:33:01.216949+0000","last_peered":"2024-02-16T10:33:01.216949+0000","last_clean":"2024-02-16T10:33:01.216949+0000","last_became_active":"2024-02-16T10:30:26.084472+0000","last_became_peered":"2024-02-16T10:30:26.084472+0000","last_unstale":"2024-02-16T10:33:01.216949+0000","last_undegraded":"2024-02-16T10:33:01.216949+0000","last_fullsized":"2024-02-16T10:33:01.216949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.216732+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.216732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:21:27.927734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.781557+0000","last_change":"2024-02-16T10:32:15.781557+0000","last_active":"2024-02-16T10:32:15.781557+0000","last_peered":"2024-02-16T10:32:15.781557+0000","last_clean":"2024-02-16T10:32:15.781557+0000","last_became_active":"2024-02-16T10:30:30.100955+0000","last_became_peered":"2024-02-16T10:30:30.100955+0000","last_unstale":"2024-02-16T10:32:15.781557+0000","last_undegraded":"2024-02-16T10:32:15.781557+0000","last_fullsized":"2024-02-16T10:32:15.781557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.781303+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.781303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:34.208301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.238141+0000","last_change":"2024-02-16T10:32:17.238141+0000","last_active":"2024-02-16T10:32:17.238141+0000","last_peered":"2024-02-16T10:32:17.238141+0000","last_clean":"2024-02-16T10:32:17.238141+0000","last_became_active":"2024-02-16T10:30:32.097546+0000","last_became_peered":"2024-02-16T10:30:32.097546+0000","last_unstale":"2024-02-16T10:32:17.238141+0000","last_undegraded":"2024-02-16T10:32:17.238141+0000","last_fullsized":"2024-02-16T10:32:17.238141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:17.237729+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.237729+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:01.114959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":343,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.449321+0000","last_change":"2024-02-16T10:32:14.449321+0000","last_active":"2024-02-16T10:32:14.449321+0000","last_peered":"2024-02-16T10:32:14.449321+0000","last_clean":"2024-02-16T10:32:14.449321+0000","last_became_active":"2024-02-16T10:30:34.122604+0000","last_became_peered":"2024-02-16T10:30:34.122604+0000","last_unstale":"2024-02-16T10:32:14.449321+0000","last_undegraded":"2024-02-16T10:32:14.449321+0000","last_fullsized":"2024-02-16T10:32:14.449321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.449055+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.449055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:44.039424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.921754+0000","last_change":"2024-02-16T10:32:46.921910+0000","last_active":"2024-02-16T10:32:46.921754+0000","last_peered":"2024-02-16T10:32:46.921754+0000","last_clean":"2024-02-16T10:32:46.921754+0000","last_became_active":"2024-02-16T10:30:28.075970+0000","last_became_peered":"2024-02-16T10:30:28.075970+0000","last_unstale":"2024-02-16T10:32:46.921754+0000","last_undegraded":"2024-02-16T10:32:46.921754+0000","last_fullsized":"2024-02-16T10:32:46.921754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.921537+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.921537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:02.923520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.268360+0000","last_change":"2024-02-16T10:32:45.268426+0000","last_active":"2024-02-16T10:32:45.268360+0000","last_peered":"2024-02-16T10:32:45.268360+0000","last_clean":"2024-02-16T10:32:45.268360+0000","last_became_active":"2024-02-16T10:30:26.084689+0000","last_became_peered":"2024-02-16T10:30:26.084689+0000","last_unstale":"2024-02-16T10:32:45.268360+0000","last_undegraded":"2024-02-16T10:32:45.268360+0000","last_fullsized":"2024-02-16T10:32:45.268360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.268134+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.268134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:13:03.695131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.167563+0000","last_change":"2024-02-16T10:32:31.167563+0000","last_active":"2024-02-16T10:32:31.167563+0000","last_peered":"2024-02-16T10:32:31.167563+0000","last_clean":"2024-02-16T10:32:31.167563+0000","last_became_active":"2024-02-16T10:30:30.089670+0000","last_became_peered":"2024-02-16T10:30:30.089670+0000","last_unstale":"2024-02-16T10:32:31.167563+0000","last_undegraded":"2024-02-16T10:32:31.167563+0000","last_fullsized":"2024-02-16T10:32:31.167563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.167309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.167309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:12.870280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.399916+0000","last_change":"2024-02-16T10:32:23.399916+0000","last_active":"2024-02-16T10:32:23.399916+0000","last_peered":"2024-02-16T10:32:23.399916+0000","last_clean":"2024-02-16T10:32:23.399916+0000","last_became_active":"2024-02-16T10:30:32.090226+0000","last_became_peered":"2024-02-16T10:30:32.090226+0000","last_unstale":"2024-02-16T10:32:23.399916+0000","last_undegraded":"2024-02-16T10:32:23.399916+0000","last_fullsized":"2024-02-16T10:32:23.399916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-02-16T10:32:23.399643+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.399643+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:12.773508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.465612+0000","last_change":"2024-02-16T10:32:16.465612+0000","last_active":"2024-02-16T10:32:16.465612+0000","last_peered":"2024-02-16T10:32:16.465612+0000","last_clean":"2024-02-16T10:32:16.465612+0000","last_became_active":"2024-02-16T10:30:34.129727+0000","last_became_peered":"2024-02-16T10:30:34.129727+0000","last_unstale":"2024-02-16T10:32:16.465612+0000","last_undegraded":"2024-02-16T10:32:16.465612+0000","last_fullsized":"2024-02-16T10:32:16.465612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.465378+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.465378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:49.655775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.393059+0000","last_change":"2024-02-16T10:33:04.393116+0000","last_active":"2024-02-16T10:33:04.393059+0000","last_peered":"2024-02-16T10:33:04.393059+0000","last_clean":"2024-02-16T10:33:04.393059+0000","last_became_active":"2024-02-16T10:30:36.157293+0000","last_became_peered":"2024-02-16T10:30:36.157293+0000","last_unstale":"2024-02-16T10:33:04.393059+0000","last_undegraded":"2024-02-16T10:33:04.393059+0000","last_fullsized":"2024-02-16T10:33:04.393059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-02-16T10:33:04.392874+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.392874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:32.385598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.232956+0000","last_change":"2024-02-16T10:32:48.233019+0000","last_active":"2024-02-16T10:32:48.232956+0000","last_peered":"2024-02-16T10:32:48.232956+0000","last_clean":"2024-02-16T10:32:48.232956+0000","last_became_active":"2024-02-16T10:30:28.072269+0000","last_became_peered":"2024-02-16T10:30:28.072269+0000","last_unstale":"2024-02-16T10:32:48.232956+0000","last_undegraded":"2024-02-16T10:32:48.232956+0000","last_fullsized":"2024-02-16T10:32:48.232956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:48.232778+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.232778+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:46.421052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.274224+0000","last_change":"2024-02-16T10:32:57.274286+0000","last_active":"2024-02-16T10:32:57.274224+0000","last_peered":"2024-02-16T10:32:57.274224+0000","last_clean":"2024-02-16T10:32:57.274224+0000","last_became_active":"2024-02-16T10:30:26.081025+0000","last_became_peered":"2024-02-16T10:30:26.081025+0000","last_unstale":"2024-02-16T10:32:57.274224+0000","last_undegraded":"2024-02-16T10:32:57.274224+0000","last_fullsized":"2024-02-16T10:32:57.274224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.274014+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.274014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:54.291309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.647776+0000","last_change":"2024-02-16T10:32:27.647776+0000","last_active":"2024-02-16T10:32:27.647776+0000","last_peered":"2024-02-16T10:32:27.647776+0000","last_clean":"2024-02-16T10:32:27.647776+0000","last_became_active":"2024-02-16T10:30:30.091781+0000","last_became_peered":"2024-02-16T10:30:30.091781+0000","last_unstale":"2024-02-16T10:32:27.647776+0000","last_undegraded":"2024-02-16T10:32:27.647776+0000","last_fullsized":"2024-02-16T10:32:27.647776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.647521+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.647521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:04.955314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.933959+0000","last_change":"2024-02-16T10:32:28.933959+0000","last_active":"2024-02-16T10:32:28.933959+0000","last_peered":"2024-02-16T10:32:28.933959+0000","last_clean":"2024-02-16T10:32:28.933959+0000","last_became_active":"2024-02-16T10:30:32.120069+0000","last_became_peered":"2024-02-16T10:30:32.120069+0000","last_unstale":"2024-02-16T10:32:28.933959+0000","last_undegraded":"2024-02-16T10:32:28.933959+0000","last_fullsized":"2024-02-16T10:32:28.933959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:28.933703+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.933703+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:04.743780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.755709+0000","last_change":"2024-02-16T10:32:32.755709+0000","last_active":"2024-02-16T10:32:32.755709+0000","last_peered":"2024-02-16T10:32:32.755709+0000","last_clean":"2024-02-16T10:32:32.755709+0000","last_became_active":"2024-02-16T10:30:34.135114+0000","last_became_peered":"2024-02-16T10:30:34.135114+0000","last_unstale":"2024-02-16T10:32:32.755709+0000","last_undegraded":"2024-02-16T10:32:32.755709+0000","last_fullsized":"2024-02-16T10:32:32.755709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.755469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.755469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:24.687565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.201544+0000","last_change":"2024-02-16T10:33:13.201613+0000","last_active":"2024-02-16T10:33:13.201544+0000","last_peered":"2024-02-16T10:33:13.201544+0000","last_clean":"2024-02-16T10:33:13.201544+0000","last_became_active":"2024-02-16T10:30:36.153480+0000","last_became_peered":"2024-02-16T10:30:36.153480+0000","last_unstale":"2024-02-16T10:33:13.201544+0000","last_undegraded":"2024-02-16T10:33:13.201544+0000","last_fullsized":"2024-02-16T10:33:13.201544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:13.201355+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:13.201355+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.201355+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:28.511204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'10","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.286011+0000","last_change":"2024-02-16T10:32:40.286011+0000","last_active":"2024-02-16T10:32:40.286011+0000","last_peered":"2024-02-16T10:32:40.286011+0000","last_clean":"2024-02-16T10:32:40.286011+0000","last_became_active":"2024-02-16T10:30:28.063689+0000","last_became_peered":"2024-02-16T10:30:28.063689+0000","last_unstale":"2024-02-16T10:32:40.286011+0000","last_undegraded":"2024-02-16T10:32:40.286011+0000","last_fullsized":"2024-02-16T10:32:40.286011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:40.285731+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.285731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:45.263145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.135108+0000","last_change":"2024-02-16T10:33:11.135166+0000","last_active":"2024-02-16T10:33:11.135108+0000","last_peered":"2024-02-16T10:33:11.135108+0000","last_clean":"2024-02-16T10:33:11.135108+0000","last_became_active":"2024-02-16T10:30:26.084781+0000","last_became_peered":"2024-02-16T10:30:26.084781+0000","last_unstale":"2024-02-16T10:33:11.135108+0000","last_undegraded":"2024-02-16T10:33:11.135108+0000","last_fullsized":"2024-02-16T10:33:11.135108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:11.134916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:11.134916+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.134916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:46:31.680717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.768452+0000","last_change":"2024-02-16T10:32:33.768452+0000","last_active":"2024-02-16T10:32:33.768452+0000","last_peered":"2024-02-16T10:32:33.768452+0000","last_clean":"2024-02-16T10:32:33.768452+0000","last_became_active":"2024-02-16T10:30:30.079475+0000","last_became_peered":"2024-02-16T10:30:30.079475+0000","last_unstale":"2024-02-16T10:32:33.768452+0000","last_undegraded":"2024-02-16T10:32:33.768452+0000","last_fullsized":"2024-02-16T10:32:33.768452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.768198+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.768198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:09.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.803505+0000","last_change":"2024-02-16T10:32:16.803505+0000","last_active":"2024-02-16T10:32:16.803505+0000","last_peered":"2024-02-16T10:32:16.803505+0000","last_clean":"2024-02-16T10:32:16.803505+0000","last_became_active":"2024-02-16T10:30:32.115622+0000","last_became_peered":"2024-02-16T10:30:32.115622+0000","last_unstale":"2024-02-16T10:32:16.803505+0000","last_undegraded":"2024-02-16T10:32:16.803505+0000","last_fullsized":"2024-02-16T10:32:16.803505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:16.803212+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.803212+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:32.256266+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.644180+0000","last_change":"2024-02-16T10:32:28.644180+0000","last_active":"2024-02-16T10:32:28.644180+0000","last_peered":"2024-02-16T10:32:28.644180+0000","last_clean":"2024-02-16T10:32:28.644180+0000","last_became_active":"2024-02-16T10:30:34.134969+0000","last_became_peered":"2024-02-16T10:30:34.134969+0000","last_unstale":"2024-02-16T10:32:28.644180+0000","last_undegraded":"2024-02-16T10:32:28.644180+0000","last_fullsized":"2024-02-16T10:32:28.644180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:28.643929+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.643929+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:32:10.346900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.658716+0000","last_change":"2024-02-16T10:33:13.658776+0000","last_active":"2024-02-16T10:33:13.658716+0000","last_peered":"2024-02-16T10:33:13.658716+0000","last_clean":"2024-02-16T10:33:13.658716+0000","last_became_active":"2024-02-16T10:30:36.159222+0000","last_became_peered":"2024-02-16T10:30:36.159222+0000","last_unstale":"2024-02-16T10:33:13.658716+0000","last_undegraded":"2024-02-16T10:33:13.658716+0000","last_fullsized":"2024-02-16T10:33:13.658716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:13.658522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:13.658522+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.658522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:50:05.085148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:46.286063+0000","last_change":"2024-02-16T10:32:46.286129+0000","last_active":"2024-02-16T10:32:46.286063+0000","last_peered":"2024-02-16T10:32:46.286063+0000","last_clean":"2024-02-16T10:32:46.286063+0000","last_became_active":"2024-02-16T10:30:28.068310+0000","last_became_peered":"2024-02-16T10:30:28.068310+0000","last_unstale":"2024-02-16T10:32:46.286063+0000","last_undegraded":"2024-02-16T10:32:46.286063+0000","last_fullsized":"2024-02-16T10:32:46.286063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:46.285887+0000","last_clean_scrub_stamp":"2024-02-16T10:32:46.285887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:01.738941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:17.089264+0000","last_change":"2024-02-16T10:33:17.089325+0000","last_active":"2024-02-16T10:33:17.089264+0000","last_peered":"2024-02-16T10:33:17.089264+0000","last_clean":"2024-02-16T10:33:17.089264+0000","last_became_active":"2024-02-16T10:30:26.085568+0000","last_became_peered":"2024-02-16T10:30:26.085568+0000","last_unstale":"2024-02-16T10:33:17.089264+0000","last_undegraded":"2024-02-16T10:33:17.089264+0000","last_fullsized":"2024-02-16T10:33:17.089264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:17.089057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:17.089057+0000","last_clean_scrub_stamp":"2024-02-16T10:33:17.089057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:22:50.381445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.695562+0000","last_change":"2024-02-16T10:32:30.695562+0000","last_active":"2024-02-16T10:32:30.695562+0000","last_peered":"2024-02-16T10:32:30.695562+0000","last_clean":"2024-02-16T10:32:30.695562+0000","last_became_active":"2024-02-16T10:30:30.079107+0000","last_became_peered":"2024-02-16T10:30:30.079107+0000","last_unstale":"2024-02-16T10:32:30.695562+0000","last_undegraded":"2024-02-16T10:32:30.695562+0000","last_fullsized":"2024-02-16T10:32:30.695562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.695316+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.695316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:35.672730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.964066+0000","last_change":"2024-02-16T10:32:43.964066+0000","last_active":"2024-02-16T10:32:43.964066+0000","last_peered":"2024-02-16T10:32:43.964066+0000","last_clean":"2024-02-16T10:32:43.964066+0000","last_became_active":"2024-02-16T10:30:32.120000+0000","last_became_peered":"2024-02-16T10:30:32.120000+0000","last_unstale":"2024-02-16T10:32:43.964066+0000","last_undegraded":"2024-02-16T10:32:43.964066+0000","last_fullsized":"2024-02-16T10:32:43.964066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-02-16T10:32:43.963784+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.963784+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:35.015936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.497295+0000","last_change":"2024-02-16T10:32:17.497295+0000","last_active":"2024-02-16T10:32:17.497295+0000","last_peered":"2024-02-16T10:32:17.497295+0000","last_clean":"2024-02-16T10:32:17.497295+0000","last_became_active":"2024-02-16T10:30:34.118032+0000","last_became_peered":"2024-02-16T10:30:34.118032+0000","last_unstale":"2024-02-16T10:32:17.497295+0000","last_undegraded":"2024-02-16T10:32:17.497295+0000","last_fullsized":"2024-02-16T10:32:17.497295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.496921+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.496921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:48.124154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.620154+0000","last_change":"2024-02-16T10:33:10.620322+0000","last_active":"2024-02-16T10:33:10.620154+0000","last_peered":"2024-02-16T10:33:10.620154+0000","last_clean":"2024-02-16T10:33:10.620154+0000","last_became_active":"2024-02-16T10:30:36.139661+0000","last_became_peered":"2024-02-16T10:30:36.139661+0000","last_unstale":"2024-02-16T10:33:10.620154+0000","last_undegraded":"2024-02-16T10:33:10.620154+0000","last_fullsized":"2024-02-16T10:33:10.620154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:10.619902+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.619902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:34.041848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.229630+0000","last_change":"2024-02-16T10:33:08.229696+0000","last_active":"2024-02-16T10:33:08.229630+0000","last_peered":"2024-02-16T10:33:08.229630+0000","last_clean":"2024-02-16T10:33:08.229630+0000","last_became_active":"2024-02-16T10:30:28.079980+0000","last_became_peered":"2024-02-16T10:30:28.079980+0000","last_unstale":"2024-02-16T10:33:08.229630+0000","last_undegraded":"2024-02-16T10:33:08.229630+0000","last_fullsized":"2024-02-16T10:33:08.229630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.229415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.229415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:08:03.257453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.532455+0000","last_change":"2024-02-16T10:32:49.532517+0000","last_active":"2024-02-16T10:32:49.532455+0000","last_peered":"2024-02-16T10:32:49.532455+0000","last_clean":"2024-02-16T10:32:49.532455+0000","last_became_active":"2024-02-16T10:30:26.097339+0000","last_became_peered":"2024-02-16T10:30:26.097339+0000","last_unstale":"2024-02-16T10:32:49.532455+0000","last_undegraded":"2024-02-16T10:32:49.532455+0000","last_fullsized":"2024-02-16T10:32:49.532455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.532266+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.532266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:57.734052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"33'2","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.451331+0000","last_change":"2024-02-16T10:32:27.451331+0000","last_active":"2024-02-16T10:32:27.451331+0000","last_peered":"2024-02-16T10:32:27.451331+0000","last_clean":"2024-02-16T10:32:27.451331+0000","last_became_active":"2024-02-16T10:30:30.079653+0000","last_became_peered":"2024-02-16T10:30:30.079653+0000","last_unstale":"2024-02-16T10:32:27.451331+0000","last_undegraded":"2024-02-16T10:32:27.451331+0000","last_fullsized":"2024-02-16T10:32:27.451331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:27.451069+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.451069+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:58.078302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.240843+0000","last_change":"2024-02-16T10:32:20.240843+0000","last_active":"2024-02-16T10:32:20.240843+0000","last_peered":"2024-02-16T10:32:20.240843+0000","last_clean":"2024-02-16T10:32:20.240843+0000","last_became_active":"2024-02-16T10:30:32.093792+0000","last_became_peered":"2024-02-16T10:30:32.093792+0000","last_unstale":"2024-02-16T10:32:20.240843+0000","last_undegraded":"2024-02-16T10:32:20.240843+0000","last_fullsized":"2024-02-16T10:32:20.240843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:20.240570+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.240570+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:31.716842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.017811+0000","last_change":"2024-02-16T10:32:37.017811+0000","last_active":"2024-02-16T10:32:37.017811+0000","last_peered":"2024-02-16T10:32:37.017811+0000","last_clean":"2024-02-16T10:32:37.017811+0000","last_became_active":"2024-02-16T10:30:34.141221+0000","last_became_peered":"2024-02-16T10:30:34.141221+0000","last_unstale":"2024-02-16T10:32:37.017811+0000","last_undegraded":"2024-02-16T10:32:37.017811+0000","last_fullsized":"2024-02-16T10:32:37.017811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.017556+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.017556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:51.032253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.115773+0000","last_change":"2024-02-16T10:33:05.115828+0000","last_active":"2024-02-16T10:33:05.115773+0000","last_peered":"2024-02-16T10:33:05.115773+0000","last_clean":"2024-02-16T10:33:05.115773+0000","last_became_active":"2024-02-16T10:30:36.142727+0000","last_became_peered":"2024-02-16T10:30:36.142727+0000","last_unstale":"2024-02-16T10:33:05.115773+0000","last_undegraded":"2024-02-16T10:33:05.115773+0000","last_fullsized":"2024-02-16T10:33:05.115773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.115560+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.115560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:07.229889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.929301+0000","last_change":"2024-02-16T10:32:29.929301+0000","last_active":"2024-02-16T10:32:29.929301+0000","last_peered":"2024-02-16T10:32:29.929301+0000","last_clean":"2024-02-16T10:32:29.929301+0000","last_became_active":"2024-02-16T10:30:28.086500+0000","last_became_peered":"2024-02-16T10:30:28.086500+0000","last_unstale":"2024-02-16T10:32:29.929301+0000","last_undegraded":"2024-02-16T10:32:29.929301+0000","last_fullsized":"2024-02-16T10:32:29.929301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:29.929048+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.929048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:13:38.130834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:15.074587+0000","last_change":"2024-02-16T10:33:15.074657+0000","last_active":"2024-02-16T10:33:15.074587+0000","last_peered":"2024-02-16T10:33:15.074587+0000","last_clean":"2024-02-16T10:33:15.074587+0000","last_became_active":"2024-02-16T10:30:26.082237+0000","last_became_peered":"2024-02-16T10:30:26.082237+0000","last_unstale":"2024-02-16T10:33:15.074587+0000","last_undegraded":"2024-02-16T10:33:15.074587+0000","last_fullsized":"2024-02-16T10:33:15.074587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:15.074371+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:15.074371+0000","last_clean_scrub_stamp":"2024-02-16T10:33:15.074371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:21:32.166640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.646038+0000","last_change":"2024-02-16T10:32:29.646038+0000","last_active":"2024-02-16T10:32:29.646038+0000","last_peered":"2024-02-16T10:32:29.646038+0000","last_clean":"2024-02-16T10:32:29.646038+0000","last_became_active":"2024-02-16T10:30:30.079379+0000","last_became_peered":"2024-02-16T10:30:30.079379+0000","last_unstale":"2024-02-16T10:32:29.646038+0000","last_undegraded":"2024-02-16T10:32:29.646038+0000","last_fullsized":"2024-02-16T10:32:29.646038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:29.645785+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.645785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:23.146927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.309318+0000","last_change":"2024-02-16T10:32:21.309318+0000","last_active":"2024-02-16T10:32:21.309318+0000","last_peered":"2024-02-16T10:32:21.309318+0000","last_clean":"2024-02-16T10:32:21.309318+0000","last_became_active":"2024-02-16T10:30:32.089869+0000","last_became_peered":"2024-02-16T10:30:32.089869+0000","last_unstale":"2024-02-16T10:32:21.309318+0000","last_undegraded":"2024-02-16T10:32:21.309318+0000","last_fullsized":"2024-02-16T10:32:21.309318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:21.309051+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.309051+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:16:57.682746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":345,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.163489+0000","last_change":"2024-02-16T10:32:14.163489+0000","last_active":"2024-02-16T10:32:14.163489+0000","last_peered":"2024-02-16T10:32:14.163489+0000","last_clean":"2024-02-16T10:32:14.163489+0000","last_became_active":"2024-02-16T10:30:34.127674+0000","last_became_peered":"2024-02-16T10:30:34.127674+0000","last_unstale":"2024-02-16T10:32:14.163489+0000","last_undegraded":"2024-02-16T10:32:14.163489+0000","last_fullsized":"2024-02-16T10:32:14.163489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.163228+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.163228+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:26:11.600065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.620194+0000","last_change":"2024-02-16T10:33:08.620253+0000","last_active":"2024-02-16T10:33:08.620194+0000","last_peered":"2024-02-16T10:33:08.620194+0000","last_clean":"2024-02-16T10:33:08.620194+0000","last_became_active":"2024-02-16T10:30:36.137950+0000","last_became_peered":"2024-02-16T10:30:36.137950+0000","last_unstale":"2024-02-16T10:33:08.620194+0000","last_undegraded":"2024-02-16T10:33:08.620194+0000","last_fullsized":"2024-02-16T10:33:08.620194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:33:08.620010+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.620010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:48:10.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.368195+0000","last_change":"2024-02-16T10:32:36.368195+0000","last_active":"2024-02-16T10:32:36.368195+0000","last_peered":"2024-02-16T10:32:36.368195+0000","last_clean":"2024-02-16T10:32:36.368195+0000","last_became_active":"2024-02-16T10:30:28.062702+0000","last_became_peered":"2024-02-16T10:30:28.062702+0000","last_unstale":"2024-02-16T10:32:36.368195+0000","last_undegraded":"2024-02-16T10:32:36.368195+0000","last_fullsized":"2024-02-16T10:32:36.368195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.367915+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.367915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:48.603515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.161223+0000","last_change":"2024-02-16T10:33:06.161296+0000","last_active":"2024-02-16T10:33:06.161223+0000","last_peered":"2024-02-16T10:33:06.161223+0000","last_clean":"2024-02-16T10:33:06.161223+0000","last_became_active":"2024-02-16T10:30:26.085451+0000","last_became_peered":"2024-02-16T10:30:26.085451+0000","last_unstale":"2024-02-16T10:33:06.161223+0000","last_undegraded":"2024-02-16T10:33:06.161223+0000","last_fullsized":"2024-02-16T10:33:06.161223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:06.161008+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.161008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:57:51.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'4","reported_seq":374,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.227428+0000","last_change":"2024-02-16T10:32:29.227428+0000","last_active":"2024-02-16T10:32:29.227428+0000","last_peered":"2024-02-16T10:32:29.227428+0000","last_clean":"2024-02-16T10:32:29.227428+0000","last_became_active":"2024-02-16T10:30:30.090503+0000","last_became_peered":"2024-02-16T10:30:30.090503+0000","last_unstale":"2024-02-16T10:32:29.227428+0000","last_undegraded":"2024-02-16T10:32:29.227428+0000","last_fullsized":"2024-02-16T10:32:29.227428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:29.227174+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.227174+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:41.462774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.984249+0000","last_change":"2024-02-16T10:32:41.984249+0000","last_active":"2024-02-16T10:32:41.984249+0000","last_peered":"2024-02-16T10:32:41.984249+0000","last_clean":"2024-02-16T10:32:41.984249+0000","last_became_active":"2024-02-16T10:30:32.120874+0000","last_became_peered":"2024-02-16T10:30:32.120874+0000","last_unstale":"2024-02-16T10:32:41.984249+0000","last_undegraded":"2024-02-16T10:32:41.984249+0000","last_fullsized":"2024-02-16T10:32:41.984249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.983908+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.983908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:16.170915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":388,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.304415+0000","last_change":"2024-02-16T10:32:18.304415+0000","last_active":"2024-02-16T10:32:18.304415+0000","last_peered":"2024-02-16T10:32:18.304415+0000","last_clean":"2024-02-16T10:32:18.304415+0000","last_became_active":"2024-02-16T10:30:34.116352+0000","last_became_peered":"2024-02-16T10:30:34.116352+0000","last_unstale":"2024-02-16T10:32:18.304415+0000","last_undegraded":"2024-02-16T10:32:18.304415+0000","last_fullsized":"2024-02-16T10:32:18.304415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:18.304138+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.304138+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:51.494534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.397338+0000","last_change":"2024-02-16T10:33:01.397402+0000","last_active":"2024-02-16T10:33:01.397338+0000","last_peered":"2024-02-16T10:33:01.397338+0000","last_clean":"2024-02-16T10:33:01.397338+0000","last_became_active":"2024-02-16T10:30:36.137916+0000","last_became_peered":"2024-02-16T10:30:36.137916+0000","last_unstale":"2024-02-16T10:33:01.397338+0000","last_undegraded":"2024-02-16T10:33:01.397338+0000","last_fullsized":"2024-02-16T10:33:01.397338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:01.397137+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.397137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:59.997013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.143875+0000","last_change":"2024-02-16T10:32:35.143875+0000","last_active":"2024-02-16T10:32:35.143875+0000","last_peered":"2024-02-16T10:32:35.143875+0000","last_clean":"2024-02-16T10:32:35.143875+0000","last_became_active":"2024-02-16T10:30:28.079870+0000","last_became_peered":"2024-02-16T10:30:28.079870+0000","last_unstale":"2024-02-16T10:32:35.143875+0000","last_undegraded":"2024-02-16T10:32:35.143875+0000","last_fullsized":"2024-02-16T10:32:35.143875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:35.143615+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.143615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:27.075711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.119660+0000","last_change":"2024-02-16T10:33:09.119719+0000","last_active":"2024-02-16T10:33:09.119660+0000","last_peered":"2024-02-16T10:33:09.119660+0000","last_clean":"2024-02-16T10:33:09.119660+0000","last_became_active":"2024-02-16T10:30:26.082674+0000","last_became_peered":"2024-02-16T10:30:26.082674+0000","last_unstale":"2024-02-16T10:33:09.119660+0000","last_undegraded":"2024-02-16T10:33:09.119660+0000","last_fullsized":"2024-02-16T10:33:09.119660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:09.119459+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.119459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:34:05.115810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.781651+0000","last_change":"2024-02-16T10:32:13.781651+0000","last_active":"2024-02-16T10:32:13.781651+0000","last_peered":"2024-02-16T10:32:13.781651+0000","last_clean":"2024-02-16T10:32:13.781651+0000","last_became_active":"2024-02-16T10:30:30.102483+0000","last_became_peered":"2024-02-16T10:30:30.102483+0000","last_unstale":"2024-02-16T10:32:13.781651+0000","last_undegraded":"2024-02-16T10:32:13.781651+0000","last_fullsized":"2024-02-16T10:32:13.781651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.781400+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.781400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:02:49.070840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.203087+0000","last_change":"2024-02-16T10:32:21.203087+0000","last_active":"2024-02-16T10:32:21.203087+0000","last_peered":"2024-02-16T10:32:21.203087+0000","last_clean":"2024-02-16T10:32:21.203087+0000","last_became_active":"2024-02-16T10:30:32.093163+0000","last_became_peered":"2024-02-16T10:30:32.093163+0000","last_unstale":"2024-02-16T10:32:21.203087+0000","last_undegraded":"2024-02-16T10:32:21.203087+0000","last_fullsized":"2024-02-16T10:32:21.203087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-02-16T10:32:21.202707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.202707+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:08.574336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.238385+0000","last_change":"2024-02-16T10:32:18.238385+0000","last_active":"2024-02-16T10:32:18.238385+0000","last_peered":"2024-02-16T10:32:18.238385+0000","last_clean":"2024-02-16T10:32:18.238385+0000","last_became_active":"2024-02-16T10:30:34.142658+0000","last_became_peered":"2024-02-16T10:30:34.142658+0000","last_unstale":"2024-02-16T10:32:18.238385+0000","last_undegraded":"2024-02-16T10:32:18.238385+0000","last_fullsized":"2024-02-16T10:32:18.238385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.238111+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.238111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:09:31.457700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.136516+0000","last_change":"2024-02-16T10:32:34.136516+0000","last_active":"2024-02-16T10:32:34.136516+0000","last_peered":"2024-02-16T10:32:34.136516+0000","last_clean":"2024-02-16T10:32:34.136516+0000","last_became_active":"2024-02-16T10:30:36.123654+0000","last_became_peered":"2024-02-16T10:30:36.123654+0000","last_unstale":"2024-02-16T10:32:34.136516+0000","last_undegraded":"2024-02-16T10:32:34.136516+0000","last_fullsized":"2024-02-16T10:32:34.136516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:34.136238+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.136238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:40.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.943470+0000","last_change":"2024-02-16T10:32:30.943470+0000","last_active":"2024-02-16T10:32:30.943470+0000","last_peered":"2024-02-16T10:32:30.943470+0000","last_clean":"2024-02-16T10:32:30.943470+0000","last_became_active":"2024-02-16T10:30:28.083914+0000","last_became_peered":"2024-02-16T10:30:28.083914+0000","last_unstale":"2024-02-16T10:32:30.943470+0000","last_undegraded":"2024-02-16T10:32:30.943470+0000","last_fullsized":"2024-02-16T10:32:30.943470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:32:30.943169+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.943169+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:32:44.988481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.240077+0000","last_change":"2024-02-16T10:33:00.240148+0000","last_active":"2024-02-16T10:33:00.240077+0000","last_peered":"2024-02-16T10:33:00.240077+0000","last_clean":"2024-02-16T10:33:00.240077+0000","last_became_active":"2024-02-16T10:30:13.037383+0000","last_became_peered":"2024-02-16T10:30:13.037383+0000","last_unstale":"2024-02-16T10:33:00.240077+0000","last_undegraded":"2024-02-16T10:33:00.240077+0000","last_fullsized":"2024-02-16T10:33:00.240077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-02-16T10:33:00.239869+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.239869+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:55:01.731330+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:24.993937+0000","last_change":"2024-02-16T10:33:24.993993+0000","last_active":"2024-02-16T10:33:24.993937+0000","last_peered":"2024-02-16T10:33:24.993937+0000","last_clean":"2024-02-16T10:33:24.993937+0000","last_became_active":"2024-02-16T10:30:18.009481+0000","last_became_peered":"2024-02-16T10:30:18.009481+0000","last_unstale":"2024-02-16T10:33:24.993937+0000","last_undegraded":"2024-02-16T10:33:24.993937+0000","last_fullsized":"2024-02-16T10:33:24.993937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:24.993740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:24.993740+0000","last_clean_scrub_stamp":"2024-02-16T10:33:24.993740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:54.973072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:30.972767+0000","last_change":"2024-02-16T10:33:30.972825+0000","last_active":"2024-02-16T10:33:30.972767+0000","last_peered":"2024-02-16T10:33:30.972767+0000","last_clean":"2024-02-16T10:33:30.972767+0000","last_became_active":"2024-02-16T10:30:26.083007+0000","last_became_peered":"2024-02-16T10:30:26.083007+0000","last_unstale":"2024-02-16T10:33:30.972767+0000","last_undegraded":"2024-02-16T10:33:30.972767+0000","last_fullsized":"2024-02-16T10:33:30.972767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:30.972569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:30.972569+0000","last_clean_scrub_stamp":"2024-02-16T10:33:30.972569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:58:40.306075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.279935+0000","last_change":"2024-02-16T10:32:27.279935+0000","last_active":"2024-02-16T10:32:27.279935+0000","last_peered":"2024-02-16T10:32:27.279935+0000","last_clean":"2024-02-16T10:32:27.279935+0000","last_became_active":"2024-02-16T10:30:30.090434+0000","last_became_peered":"2024-02-16T10:30:30.090434+0000","last_unstale":"2024-02-16T10:32:27.279935+0000","last_undegraded":"2024-02-16T10:32:27.279935+0000","last_fullsized":"2024-02-16T10:32:27.279935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:27.279691+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.279691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:39:24.188579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.960833+0000","last_change":"2024-02-16T10:32:38.960833+0000","last_active":"2024-02-16T10:32:38.960833+0000","last_peered":"2024-02-16T10:32:38.960833+0000","last_clean":"2024-02-16T10:32:38.960833+0000","last_became_active":"2024-02-16T10:30:32.125033+0000","last_became_peered":"2024-02-16T10:30:32.125033+0000","last_unstale":"2024-02-16T10:32:38.960833+0000","last_undegraded":"2024-02-16T10:32:38.960833+0000","last_fullsized":"2024-02-16T10:32:38.960833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-02-16T10:32:38.960420+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.960420+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:29:47.645317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":97,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.512594+0000","last_change":"2024-02-16T10:32:20.512594+0000","last_active":"2024-02-16T10:32:20.512594+0000","last_peered":"2024-02-16T10:32:20.512594+0000","last_clean":"2024-02-16T10:32:20.512594+0000","last_became_active":"2024-02-16T10:30:34.134917+0000","last_became_peered":"2024-02-16T10:30:34.134917+0000","last_unstale":"2024-02-16T10:32:20.512594+0000","last_undegraded":"2024-02-16T10:32:20.512594+0000","last_fullsized":"2024-02-16T10:32:20.512594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:20.512313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.512313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:57.090214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'51","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.430846+0000","last_change":"2024-02-16T10:33:02.430910+0000","last_active":"2024-02-16T10:33:02.430846+0000","last_peered":"2024-02-16T10:33:02.430846+0000","last_clean":"2024-02-16T10:33:02.430846+0000","last_became_active":"2024-02-16T10:30:36.135446+0000","last_became_peered":"2024-02-16T10:30:36.135446+0000","last_unstale":"2024-02-16T10:33:02.430846+0000","last_undegraded":"2024-02-16T10:33:02.430846+0000","last_fullsized":"2024-02-16T10:33:02.430846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-02-16T10:33:02.430646+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.430646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:22.558915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":100,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.948837+0000","last_change":"2024-02-16T10:32:49.948909+0000","last_active":"2024-02-16T10:32:49.948837+0000","last_peered":"2024-02-16T10:32:49.948837+0000","last_clean":"2024-02-16T10:32:49.948837+0000","last_became_active":"2024-02-16T10:30:28.069140+0000","last_became_peered":"2024-02-16T10:30:28.069140+0000","last_unstale":"2024-02-16T10:32:49.948837+0000","last_undegraded":"2024-02-16T10:32:49.948837+0000","last_fullsized":"2024-02-16T10:32:49.948837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:49.948648+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.948648+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:05.258497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:24.032943+0000","last_change":"2024-02-16T10:33:24.032997+0000","last_active":"2024-02-16T10:33:24.032943+0000","last_peered":"2024-02-16T10:33:24.032943+0000","last_clean":"2024-02-16T10:33:24.032943+0000","last_became_active":"2024-02-16T10:30:18.008638+0000","last_became_peered":"2024-02-16T10:30:18.008638+0000","last_unstale":"2024-02-16T10:33:24.032943+0000","last_undegraded":"2024-02-16T10:33:24.032943+0000","last_fullsized":"2024-02-16T10:33:24.032943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:24.032722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:24.032722+0000","last_clean_scrub_stamp":"2024-02-16T10:33:24.032722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:29:20.191664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.571062+0000","last_change":"2024-02-16T10:32:47.571125+0000","last_active":"2024-02-16T10:32:47.571062+0000","last_peered":"2024-02-16T10:32:47.571062+0000","last_clean":"2024-02-16T10:32:47.571062+0000","last_became_active":"2024-02-16T10:30:26.094683+0000","last_became_peered":"2024-02-16T10:30:26.094683+0000","last_unstale":"2024-02-16T10:32:47.571062+0000","last_undegraded":"2024-02-16T10:32:47.571062+0000","last_fullsized":"2024-02-16T10:32:47.571062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.570876+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.570876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:07:21.048590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.736135+0000","last_change":"2024-02-16T10:32:14.736135+0000","last_active":"2024-02-16T10:32:14.736135+0000","last_peered":"2024-02-16T10:32:14.736135+0000","last_clean":"2024-02-16T10:32:14.736135+0000","last_became_active":"2024-02-16T10:30:30.101922+0000","last_became_peered":"2024-02-16T10:30:30.101922+0000","last_unstale":"2024-02-16T10:32:14.736135+0000","last_undegraded":"2024-02-16T10:32:14.736135+0000","last_fullsized":"2024-02-16T10:32:14.736135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:14.735884+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.735884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:00:40.928168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'256","reported_seq":448,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.273669+0000","last_change":"2024-02-16T10:32:19.273669+0000","last_active":"2024-02-16T10:32:19.273669+0000","last_peered":"2024-02-16T10:32:19.273669+0000","last_clean":"2024-02-16T10:32:19.273669+0000","last_became_active":"2024-02-16T10:30:32.095674+0000","last_became_peered":"2024-02-16T10:30:32.095674+0000","last_unstale":"2024-02-16T10:32:19.273669+0000","last_undegraded":"2024-02-16T10:32:19.273669+0000","last_fullsized":"2024-02-16T10:32:19.273669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'256","last_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_deep_scrub":"33'256","last_deep_scrub_stamp":"2024-02-16T10:32:19.273406+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.273406+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:49.900639+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.978134+0000","last_change":"2024-02-16T10:32:48.978193+0000","last_active":"2024-02-16T10:32:48.978134+0000","last_peered":"2024-02-16T10:32:48.978134+0000","last_clean":"2024-02-16T10:32:48.978134+0000","last_became_active":"2024-02-16T10:30:34.141246+0000","last_became_peered":"2024-02-16T10:30:34.141246+0000","last_unstale":"2024-02-16T10:32:48.978134+0000","last_undegraded":"2024-02-16T10:32:48.978134+0000","last_fullsized":"2024-02-16T10:32:48.978134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.977937+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.977937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:47:51.000080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.174869+0000","last_change":"2024-02-16T10:32:38.174869+0000","last_active":"2024-02-16T10:32:38.174869+0000","last_peered":"2024-02-16T10:32:38.174869+0000","last_clean":"2024-02-16T10:32:38.174869+0000","last_became_active":"2024-02-16T10:30:36.138755+0000","last_became_peered":"2024-02-16T10:30:36.138755+0000","last_unstale":"2024-02-16T10:32:38.174869+0000","last_undegraded":"2024-02-16T10:32:38.174869+0000","last_fullsized":"2024-02-16T10:32:38.174869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-02-16T10:32:38.174629+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.174629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:56.601626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.613284+0000","last_change":"2024-02-16T10:32:41.613350+0000","last_active":"2024-02-16T10:32:41.613284+0000","last_peered":"2024-02-16T10:32:41.613284+0000","last_clean":"2024-02-16T10:32:41.613284+0000","last_became_active":"2024-02-16T10:30:28.078378+0000","last_became_peered":"2024-02-16T10:30:28.078378+0000","last_unstale":"2024-02-16T10:32:41.613284+0000","last_undegraded":"2024-02-16T10:32:41.613284+0000","last_fullsized":"2024-02-16T10:32:41.613284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:32:41.613065+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.613065+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:19.969376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.273965+0000","last_change":"2024-02-16T10:32:52.274043+0000","last_active":"2024-02-16T10:32:52.273965+0000","last_peered":"2024-02-16T10:32:52.273965+0000","last_clean":"2024-02-16T10:32:52.273965+0000","last_became_active":"2024-02-16T10:30:18.005538+0000","last_became_peered":"2024-02-16T10:30:18.005538+0000","last_unstale":"2024-02-16T10:32:52.273965+0000","last_undegraded":"2024-02-16T10:32:52.273965+0000","last_fullsized":"2024-02-16T10:32:52.273965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.273779+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.273779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:11.755492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:51.628916+0000","last_change":"2024-02-16T10:32:51.629026+0000","last_active":"2024-02-16T10:32:51.628916+0000","last_peered":"2024-02-16T10:32:51.628916+0000","last_clean":"2024-02-16T10:32:51.628916+0000","last_became_active":"2024-02-16T10:30:26.095292+0000","last_became_peered":"2024-02-16T10:30:26.095292+0000","last_unstale":"2024-02-16T10:32:51.628916+0000","last_undegraded":"2024-02-16T10:32:51.628916+0000","last_fullsized":"2024-02-16T10:32:51.628916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:51.628708+0000","last_clean_scrub_stamp":"2024-02-16T10:32:51.628708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:51:34.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:29.455727+0000","last_change":"2024-02-16T10:32:29.455727+0000","last_active":"2024-02-16T10:32:29.455727+0000","last_peered":"2024-02-16T10:32:29.455727+0000","last_clean":"2024-02-16T10:32:29.455727+0000","last_became_active":"2024-02-16T10:30:30.077107+0000","last_became_peered":"2024-02-16T10:30:30.077107+0000","last_unstale":"2024-02-16T10:32:29.455727+0000","last_undegraded":"2024-02-16T10:32:29.455727+0000","last_fullsized":"2024-02-16T10:32:29.455727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:29.455432+0000","last_clean_scrub_stamp":"2024-02-16T10:32:29.455432+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:16.827061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'23","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.278098+0000","last_change":"2024-02-16T10:32:20.278098+0000","last_active":"2024-02-16T10:32:20.278098+0000","last_peered":"2024-02-16T10:32:20.278098+0000","last_clean":"2024-02-16T10:32:20.278098+0000","last_became_active":"2024-02-16T10:30:32.089813+0000","last_became_peered":"2024-02-16T10:30:32.089813+0000","last_unstale":"2024-02-16T10:32:20.278098+0000","last_undegraded":"2024-02-16T10:32:20.278098+0000","last_fullsized":"2024-02-16T10:32:20.278098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-02-16T10:32:20.277804+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.277804+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:57:46.102924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.694650+0000","last_change":"2024-02-16T10:32:36.694650+0000","last_active":"2024-02-16T10:32:36.694650+0000","last_peered":"2024-02-16T10:32:36.694650+0000","last_clean":"2024-02-16T10:32:36.694650+0000","last_became_active":"2024-02-16T10:30:34.137342+0000","last_became_peered":"2024-02-16T10:30:34.137342+0000","last_unstale":"2024-02-16T10:32:36.694650+0000","last_undegraded":"2024-02-16T10:32:36.694650+0000","last_fullsized":"2024-02-16T10:32:36.694650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.694397+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.694397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:08:52.147451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.948881+0000","last_change":"2024-02-16T10:32:52.949022+0000","last_active":"2024-02-16T10:32:52.948881+0000","last_peered":"2024-02-16T10:32:52.948881+0000","last_clean":"2024-02-16T10:32:52.948881+0000","last_became_active":"2024-02-16T10:30:36.130995+0000","last_became_peered":"2024-02-16T10:30:36.130995+0000","last_unstale":"2024-02-16T10:32:52.948881+0000","last_undegraded":"2024-02-16T10:32:52.948881+0000","last_fullsized":"2024-02-16T10:32:52.948881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:52.948652+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.948652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:15:00.595710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.539873+0000","last_change":"2024-02-16T10:32:56.539932+0000","last_active":"2024-02-16T10:32:56.539873+0000","last_peered":"2024-02-16T10:32:56.539873+0000","last_clean":"2024-02-16T10:32:56.539873+0000","last_became_active":"2024-02-16T10:30:28.073308+0000","last_became_peered":"2024-02-16T10:30:28.073308+0000","last_unstale":"2024-02-16T10:32:56.539873+0000","last_undegraded":"2024-02-16T10:32:56.539873+0000","last_fullsized":"2024-02-16T10:32:56.539873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.539683+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.539683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:10.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:25.961973+0000","last_change":"2024-02-16T10:33:25.962105+0000","last_active":"2024-02-16T10:33:25.961973+0000","last_peered":"2024-02-16T10:33:25.961973+0000","last_clean":"2024-02-16T10:33:25.961973+0000","last_became_active":"2024-02-16T10:30:18.009532+0000","last_became_peered":"2024-02-16T10:30:18.009532+0000","last_unstale":"2024-02-16T10:33:25.961973+0000","last_undegraded":"2024-02-16T10:33:25.961973+0000","last_fullsized":"2024-02-16T10:33:25.961973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:25.961729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:25.961729+0000","last_clean_scrub_stamp":"2024-02-16T10:33:25.961729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:39:02.207805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.301659+0000","last_change":"2024-02-16T10:32:47.301721+0000","last_active":"2024-02-16T10:32:47.301659+0000","last_peered":"2024-02-16T10:32:47.301659+0000","last_clean":"2024-02-16T10:32:47.301659+0000","last_became_active":"2024-02-16T10:30:26.081264+0000","last_became_peered":"2024-02-16T10:30:26.081264+0000","last_unstale":"2024-02-16T10:32:47.301659+0000","last_undegraded":"2024-02-16T10:32:47.301659+0000","last_fullsized":"2024-02-16T10:32:47.301659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:47.301448+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.301448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:35:25.616217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.751469+0000","last_change":"2024-02-16T10:32:34.751469+0000","last_active":"2024-02-16T10:32:34.751469+0000","last_peered":"2024-02-16T10:32:34.751469+0000","last_clean":"2024-02-16T10:32:34.751469+0000","last_became_active":"2024-02-16T10:30:30.078470+0000","last_became_peered":"2024-02-16T10:30:30.078470+0000","last_unstale":"2024-02-16T10:32:34.751469+0000","last_undegraded":"2024-02-16T10:32:34.751469+0000","last_fullsized":"2024-02-16T10:32:34.751469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.751222+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.751222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:00.943506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.979895+0000","last_change":"2024-02-16T10:32:39.979895+0000","last_active":"2024-02-16T10:32:39.979895+0000","last_peered":"2024-02-16T10:32:39.979895+0000","last_clean":"2024-02-16T10:32:39.979895+0000","last_became_active":"2024-02-16T10:30:32.124521+0000","last_became_peered":"2024-02-16T10:30:32.124521+0000","last_unstale":"2024-02-16T10:32:39.979895+0000","last_undegraded":"2024-02-16T10:32:39.979895+0000","last_fullsized":"2024-02-16T10:32:39.979895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-02-16T10:32:39.979639+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.979639+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:56:47.790005+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.981922+0000","last_change":"2024-02-16T10:32:44.981922+0000","last_active":"2024-02-16T10:32:44.981922+0000","last_peered":"2024-02-16T10:32:44.981922+0000","last_clean":"2024-02-16T10:32:44.981922+0000","last_became_active":"2024-02-16T10:30:34.141365+0000","last_became_peered":"2024-02-16T10:30:34.141365+0000","last_unstale":"2024-02-16T10:32:44.981922+0000","last_undegraded":"2024-02-16T10:32:44.981922+0000","last_fullsized":"2024-02-16T10:32:44.981922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:44.981644+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.981644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:07:40.009681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.188485+0000","last_change":"2024-02-16T10:33:10.188557+0000","last_active":"2024-02-16T10:33:10.188485+0000","last_peered":"2024-02-16T10:33:10.188485+0000","last_clean":"2024-02-16T10:33:10.188485+0000","last_became_active":"2024-02-16T10:30:36.147698+0000","last_became_peered":"2024-02-16T10:30:36.147698+0000","last_unstale":"2024-02-16T10:33:10.188485+0000","last_undegraded":"2024-02-16T10:33:10.188485+0000","last_fullsized":"2024-02-16T10:33:10.188485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:33:10.188305+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.188305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:26.190288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.246559+0000","last_change":"2024-02-16T10:32:44.246622+0000","last_active":"2024-02-16T10:32:44.246559+0000","last_peered":"2024-02-16T10:32:44.246559+0000","last_clean":"2024-02-16T10:32:44.246559+0000","last_became_active":"2024-02-16T10:30:28.065134+0000","last_became_peered":"2024-02-16T10:30:28.065134+0000","last_unstale":"2024-02-16T10:32:44.246559+0000","last_undegraded":"2024-02-16T10:32:44.246559+0000","last_fullsized":"2024-02-16T10:32:44.246559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.246379+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.246379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:46:22.602690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.242816+0000","last_change":"2024-02-16T10:32:41.242876+0000","last_active":"2024-02-16T10:32:41.242816+0000","last_peered":"2024-02-16T10:32:41.242816+0000","last_clean":"2024-02-16T10:32:41.242816+0000","last_became_active":"2024-02-16T10:30:26.086917+0000","last_became_peered":"2024-02-16T10:30:26.086917+0000","last_unstale":"2024-02-16T10:32:41.242816+0000","last_undegraded":"2024-02-16T10:32:41.242816+0000","last_fullsized":"2024-02-16T10:32:41.242816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:41.242620+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.242620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:25:47.758750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.556651+0000","last_change":"2024-02-16T10:32:59.556711+0000","last_active":"2024-02-16T10:32:59.556651+0000","last_peered":"2024-02-16T10:32:59.556651+0000","last_clean":"2024-02-16T10:32:59.556651+0000","last_became_active":"2024-02-16T10:30:18.011531+0000","last_became_peered":"2024-02-16T10:30:18.011531+0000","last_unstale":"2024-02-16T10:32:59.556651+0000","last_undegraded":"2024-02-16T10:32:59.556651+0000","last_fullsized":"2024-02-16T10:32:59.556651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.556469+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.556469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:07.366835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:35.723330+0000","last_change":"2024-02-16T10:32:35.723330+0000","last_active":"2024-02-16T10:32:35.723330+0000","last_peered":"2024-02-16T10:32:35.723330+0000","last_clean":"2024-02-16T10:32:35.723330+0000","last_became_active":"2024-02-16T10:30:30.078800+0000","last_became_peered":"2024-02-16T10:30:30.078800+0000","last_unstale":"2024-02-16T10:32:35.723330+0000","last_undegraded":"2024-02-16T10:32:35.723330+0000","last_fullsized":"2024-02-16T10:32:35.723330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:35.723078+0000","last_clean_scrub_stamp":"2024-02-16T10:32:35.723078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:12:54.150076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'70","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.637878+0000","last_change":"2024-02-16T10:32:26.637878+0000","last_active":"2024-02-16T10:32:26.637878+0000","last_peered":"2024-02-16T10:32:26.637878+0000","last_clean":"2024-02-16T10:32:26.637878+0000","last_became_active":"2024-02-16T10:30:32.085993+0000","last_became_peered":"2024-02-16T10:30:32.085993+0000","last_unstale":"2024-02-16T10:32:26.637878+0000","last_undegraded":"2024-02-16T10:32:26.637878+0000","last_fullsized":"2024-02-16T10:32:26.637878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'70","last_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_deep_scrub":"33'70","last_deep_scrub_stamp":"2024-02-16T10:32:26.637563+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.637563+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:01:38.873163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:16.185179+0000","last_change":"2024-02-16T10:32:16.185179+0000","last_active":"2024-02-16T10:32:16.185179+0000","last_peered":"2024-02-16T10:32:16.185179+0000","last_clean":"2024-02-16T10:32:16.185179+0000","last_became_active":"2024-02-16T10:30:34.118853+0000","last_became_peered":"2024-02-16T10:30:34.118853+0000","last_unstale":"2024-02-16T10:32:16.185179+0000","last_undegraded":"2024-02-16T10:32:16.185179+0000","last_fullsized":"2024-02-16T10:32:16.185179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:16.184842+0000","last_clean_scrub_stamp":"2024-02-16T10:32:16.184842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:49:06.247286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'7","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:40.647753+0000","last_change":"2024-02-16T10:32:40.647753+0000","last_active":"2024-02-16T10:32:40.647753+0000","last_peered":"2024-02-16T10:32:40.647753+0000","last_clean":"2024-02-16T10:32:40.647753+0000","last_became_active":"2024-02-16T10:30:36.121190+0000","last_became_peered":"2024-02-16T10:30:36.121190+0000","last_unstale":"2024-02-16T10:32:40.647753+0000","last_undegraded":"2024-02-16T10:32:40.647753+0000","last_fullsized":"2024-02-16T10:32:40.647753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-02-16T10:32:40.647500+0000","last_clean_scrub_stamp":"2024-02-16T10:32:40.647500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:30:34.495274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.199955+0000","last_change":"2024-02-16T10:32:54.200020+0000","last_active":"2024-02-16T10:32:54.199955+0000","last_peered":"2024-02-16T10:32:54.199955+0000","last_clean":"2024-02-16T10:32:54.199955+0000","last_became_active":"2024-02-16T10:30:28.075046+0000","last_became_peered":"2024-02-16T10:30:28.075046+0000","last_unstale":"2024-02-16T10:32:54.199955+0000","last_undegraded":"2024-02-16T10:32:54.199955+0000","last_fullsized":"2024-02-16T10:32:54.199955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:54.199762+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.199762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:49:52.799639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.622453+0000","last_change":"2024-02-16T10:33:02.622510+0000","last_active":"2024-02-16T10:33:02.622453+0000","last_peered":"2024-02-16T10:33:02.622453+0000","last_clean":"2024-02-16T10:33:02.622453+0000","last_became_active":"2024-02-16T10:30:26.085992+0000","last_became_peered":"2024-02-16T10:30:26.085992+0000","last_unstale":"2024-02-16T10:33:02.622453+0000","last_undegraded":"2024-02-16T10:33:02.622453+0000","last_fullsized":"2024-02-16T10:33:02.622453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:02.622254+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.622254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:19.243588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:23.052241+0000","last_change":"2024-02-16T10:33:23.052384+0000","last_active":"2024-02-16T10:33:23.052241+0000","last_peered":"2024-02-16T10:33:23.052241+0000","last_clean":"2024-02-16T10:33:23.052241+0000","last_became_active":"2024-02-16T10:30:18.008829+0000","last_became_peered":"2024-02-16T10:30:18.008829+0000","last_unstale":"2024-02-16T10:33:23.052241+0000","last_undegraded":"2024-02-16T10:33:23.052241+0000","last_fullsized":"2024-02-16T10:33:23.052241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:23.052011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:23.052011+0000","last_clean_scrub_stamp":"2024-02-16T10:33:23.052011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:17:26.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.858645+0000","last_change":"2024-02-16T10:32:19.858645+0000","last_active":"2024-02-16T10:32:19.858645+0000","last_peered":"2024-02-16T10:32:19.858645+0000","last_clean":"2024-02-16T10:32:19.858645+0000","last_became_active":"2024-02-16T10:30:30.099282+0000","last_became_peered":"2024-02-16T10:30:30.099282+0000","last_unstale":"2024-02-16T10:32:19.858645+0000","last_undegraded":"2024-02-16T10:32:19.858645+0000","last_fullsized":"2024-02-16T10:32:19.858645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:19.858393+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.858393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:55.403466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.357240+0000","last_change":"2024-02-16T10:32:15.357240+0000","last_active":"2024-02-16T10:32:15.357240+0000","last_peered":"2024-02-16T10:32:15.357240+0000","last_clean":"2024-02-16T10:32:15.357240+0000","last_became_active":"2024-02-16T10:30:32.101045+0000","last_became_peered":"2024-02-16T10:30:32.101045+0000","last_unstale":"2024-02-16T10:32:15.357240+0000","last_undegraded":"2024-02-16T10:32:15.357240+0000","last_fullsized":"2024-02-16T10:32:15.357240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-02-16T10:32:15.356955+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.356955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:04:12.700846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:14.354389+0000","last_change":"2024-02-16T10:32:14.354389+0000","last_active":"2024-02-16T10:32:14.354389+0000","last_peered":"2024-02-16T10:32:14.354389+0000","last_clean":"2024-02-16T10:32:14.354389+0000","last_became_active":"2024-02-16T10:30:34.109545+0000","last_became_peered":"2024-02-16T10:30:34.109545+0000","last_unstale":"2024-02-16T10:32:14.354389+0000","last_undegraded":"2024-02-16T10:32:14.354389+0000","last_fullsized":"2024-02-16T10:32:14.354389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:14.353994+0000","last_clean_scrub_stamp":"2024-02-16T10:32:14.353994+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:24.095058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:34.986381+0000","last_change":"2024-02-16T10:33:34.986441+0000","last_active":"2024-02-16T10:33:34.986381+0000","last_peered":"2024-02-16T10:33:34.986381+0000","last_clean":"2024-02-16T10:33:34.986381+0000","last_became_active":"2024-02-16T10:30:36.157225+0000","last_became_peered":"2024-02-16T10:30:36.157225+0000","last_unstale":"2024-02-16T10:33:34.986381+0000","last_undegraded":"2024-02-16T10:33:34.986381+0000","last_fullsized":"2024-02-16T10:33:34.986381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:34.986187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:34.986187+0000","last_clean_scrub_stamp":"2024-02-16T10:33:34.986187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:49:25.336332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.422614+0000","last_change":"2024-02-16T10:33:05.422614+0000","last_active":"2024-02-16T10:33:05.422614+0000","last_peered":"2024-02-16T10:33:05.422614+0000","last_clean":"2024-02-16T10:33:05.422614+0000","last_became_active":"2024-02-16T10:31:06.918435+0000","last_became_peered":"2024-02-16T10:31:06.918435+0000","last_unstale":"2024-02-16T10:33:05.422614+0000","last_undegraded":"2024-02-16T10:33:05.422614+0000","last_fullsized":"2024-02-16T10:33:05.422614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.422384+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.422384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:31.765105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.091468+0000","last_change":"2024-02-16T10:33:04.091545+0000","last_active":"2024-02-16T10:33:04.091468+0000","last_peered":"2024-02-16T10:33:04.091468+0000","last_clean":"2024-02-16T10:33:04.091468+0000","last_became_active":"2024-02-16T10:30:26.081707+0000","last_became_peered":"2024-02-16T10:30:26.081707+0000","last_unstale":"2024-02-16T10:33:04.091468+0000","last_undegraded":"2024-02-16T10:33:04.091468+0000","last_fullsized":"2024-02-16T10:33:04.091468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:04.091251+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.091251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:39:26.782432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.556147+0000","last_change":"2024-02-16T10:32:58.556204+0000","last_active":"2024-02-16T10:32:58.556147+0000","last_peered":"2024-02-16T10:32:58.556147+0000","last_clean":"2024-02-16T10:32:58.556147+0000","last_became_active":"2024-02-16T10:30:18.009463+0000","last_became_peered":"2024-02-16T10:30:18.009463+0000","last_unstale":"2024-02-16T10:32:58.556147+0000","last_undegraded":"2024-02-16T10:32:58.556147+0000","last_fullsized":"2024-02-16T10:32:58.556147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.555957+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.555957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:30:07.240853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.913654+0000","last_change":"2024-02-16T10:32:21.913654+0000","last_active":"2024-02-16T10:32:21.913654+0000","last_peered":"2024-02-16T10:32:21.913654+0000","last_clean":"2024-02-16T10:32:21.913654+0000","last_became_active":"2024-02-16T10:30:30.097098+0000","last_became_peered":"2024-02-16T10:30:30.097098+0000","last_unstale":"2024-02-16T10:32:21.913654+0000","last_undegraded":"2024-02-16T10:32:21.913654+0000","last_fullsized":"2024-02-16T10:32:21.913654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:21.913396+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.913396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:04.153154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.866581+0000","last_change":"2024-02-16T10:32:26.866581+0000","last_active":"2024-02-16T10:32:26.866581+0000","last_peered":"2024-02-16T10:32:26.866581+0000","last_clean":"2024-02-16T10:32:26.866581+0000","last_became_active":"2024-02-16T10:30:32.120581+0000","last_became_peered":"2024-02-16T10:30:32.120581+0000","last_unstale":"2024-02-16T10:32:26.866581+0000","last_undegraded":"2024-02-16T10:32:26.866581+0000","last_fullsized":"2024-02-16T10:32:26.866581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:26.866309+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.866309+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:28.219357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.413073+0000","last_change":"2024-02-16T10:32:13.413073+0000","last_active":"2024-02-16T10:32:13.413073+0000","last_peered":"2024-02-16T10:32:13.413073+0000","last_clean":"2024-02-16T10:32:13.413073+0000","last_became_active":"2024-02-16T10:30:34.122789+0000","last_became_peered":"2024-02-16T10:30:34.122789+0000","last_unstale":"2024-02-16T10:32:13.413073+0000","last_undegraded":"2024-02-16T10:32:13.413073+0000","last_fullsized":"2024-02-16T10:32:13.413073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:13.412978+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.412978+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:35:02.786844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.201818+0000","last_change":"2024-02-16T10:33:09.201889+0000","last_active":"2024-02-16T10:33:09.201818+0000","last_peered":"2024-02-16T10:33:09.201818+0000","last_clean":"2024-02-16T10:33:09.201818+0000","last_became_active":"2024-02-16T10:30:36.142594+0000","last_became_peered":"2024-02-16T10:30:36.142594+0000","last_unstale":"2024-02-16T10:33:09.201818+0000","last_undegraded":"2024-02-16T10:33:09.201818+0000","last_fullsized":"2024-02-16T10:33:09.201818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-02-16T10:33:09.201598+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.201598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:24.357883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.364773+0000","last_change":"2024-02-16T10:32:37.364825+0000","last_active":"2024-02-16T10:32:37.364773+0000","last_peered":"2024-02-16T10:32:37.364773+0000","last_clean":"2024-02-16T10:32:37.364773+0000","last_became_active":"2024-02-16T10:30:28.058213+0000","last_became_peered":"2024-02-16T10:30:28.058213+0000","last_unstale":"2024-02-16T10:32:37.364773+0000","last_undegraded":"2024-02-16T10:32:37.364773+0000","last_fullsized":"2024-02-16T10:32:37.364773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:37.364585+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.364585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:29.485895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.228992+0000","last_change":"2024-02-16T10:33:03.229054+0000","last_active":"2024-02-16T10:33:03.228992+0000","last_peered":"2024-02-16T10:33:03.228992+0000","last_clean":"2024-02-16T10:33:03.228992+0000","last_became_active":"2024-02-16T10:30:26.085253+0000","last_became_peered":"2024-02-16T10:30:26.085253+0000","last_unstale":"2024-02-16T10:33:03.228992+0000","last_undegraded":"2024-02-16T10:33:03.228992+0000","last_fullsized":"2024-02-16T10:33:03.228992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.228797+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.228797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:57:11.039164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:26.959275+0000","last_change":"2024-02-16T10:33:26.959329+0000","last_active":"2024-02-16T10:33:26.959275+0000","last_peered":"2024-02-16T10:33:26.959275+0000","last_clean":"2024-02-16T10:33:26.959275+0000","last_became_active":"2024-02-16T10:30:18.412221+0000","last_became_peered":"2024-02-16T10:30:18.412221+0000","last_unstale":"2024-02-16T10:33:26.959275+0000","last_undegraded":"2024-02-16T10:33:26.959275+0000","last_fullsized":"2024-02-16T10:33:26.959275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:26.959076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:26.959076+0000","last_clean_scrub_stamp":"2024-02-16T10:33:26.959076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:52.601024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.894998+0000","last_change":"2024-02-16T10:32:23.894998+0000","last_active":"2024-02-16T10:32:23.894998+0000","last_peered":"2024-02-16T10:32:23.894998+0000","last_clean":"2024-02-16T10:32:23.894998+0000","last_became_active":"2024-02-16T10:30:30.085470+0000","last_became_peered":"2024-02-16T10:30:30.085470+0000","last_unstale":"2024-02-16T10:32:23.894998+0000","last_undegraded":"2024-02-16T10:32:23.894998+0000","last_fullsized":"2024-02-16T10:32:23.894998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.894738+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.894738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:14:24.572023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'90","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.394537+0000","last_change":"2024-02-16T10:32:25.394537+0000","last_active":"2024-02-16T10:32:25.394537+0000","last_peered":"2024-02-16T10:32:25.394537+0000","last_clean":"2024-02-16T10:32:25.394537+0000","last_became_active":"2024-02-16T10:30:32.085028+0000","last_became_peered":"2024-02-16T10:30:32.085028+0000","last_unstale":"2024-02-16T10:32:25.394537+0000","last_undegraded":"2024-02-16T10:32:25.394537+0000","last_fullsized":"2024-02-16T10:32:25.394537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-02-16T10:32:25.394250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.394250+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:35.971596+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.461912+0000","last_change":"2024-02-16T10:32:15.461912+0000","last_active":"2024-02-16T10:32:15.461912+0000","last_peered":"2024-02-16T10:32:15.461912+0000","last_clean":"2024-02-16T10:32:15.461912+0000","last_became_active":"2024-02-16T10:30:34.118041+0000","last_became_peered":"2024-02-16T10:30:34.118041+0000","last_unstale":"2024-02-16T10:32:15.461912+0000","last_undegraded":"2024-02-16T10:32:15.461912+0000","last_fullsized":"2024-02-16T10:32:15.461912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.461664+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.461664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:26.039010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:30.422778+0000","last_change":"2024-02-16T10:32:30.422778+0000","last_active":"2024-02-16T10:32:30.422778+0000","last_peered":"2024-02-16T10:32:30.422778+0000","last_clean":"2024-02-16T10:32:30.422778+0000","last_became_active":"2024-02-16T10:30:36.133351+0000","last_became_peered":"2024-02-16T10:30:36.133351+0000","last_unstale":"2024-02-16T10:32:30.422778+0000","last_undegraded":"2024-02-16T10:32:30.422778+0000","last_fullsized":"2024-02-16T10:32:30.422778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:30.422534+0000","last_clean_scrub_stamp":"2024-02-16T10:32:30.422534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:24:07.000435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:03.404761+0000","last_change":"2024-02-16T10:33:03.404813+0000","last_active":"2024-02-16T10:33:03.404761+0000","last_peered":"2024-02-16T10:33:03.404761+0000","last_clean":"2024-02-16T10:33:03.404761+0000","last_became_active":"2024-02-16T10:30:36.151195+0000","last_became_peered":"2024-02-16T10:30:36.151195+0000","last_unstale":"2024-02-16T10:33:03.404761+0000","last_undegraded":"2024-02-16T10:33:03.404761+0000","last_fullsized":"2024-02-16T10:33:03.404761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:03.404578+0000","last_clean_scrub_stamp":"2024-02-16T10:33:03.404578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:37:06.320135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.236856+0000","last_change":"2024-02-16T10:32:42.236856+0000","last_active":"2024-02-16T10:32:42.236856+0000","last_peered":"2024-02-16T10:32:42.236856+0000","last_clean":"2024-02-16T10:32:42.236856+0000","last_became_active":"2024-02-16T10:30:28.063067+0000","last_became_peered":"2024-02-16T10:30:28.063067+0000","last_unstale":"2024-02-16T10:32:42.236856+0000","last_undegraded":"2024-02-16T10:32:42.236856+0000","last_fullsized":"2024-02-16T10:32:42.236856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:42.236564+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.236564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:24:34.168661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:28.004559+0000","last_change":"2024-02-16T10:33:28.004619+0000","last_active":"2024-02-16T10:33:28.004559+0000","last_peered":"2024-02-16T10:33:28.004559+0000","last_clean":"2024-02-16T10:33:28.004559+0000","last_became_active":"2024-02-16T10:30:26.062327+0000","last_became_peered":"2024-02-16T10:30:26.062327+0000","last_unstale":"2024-02-16T10:33:28.004559+0000","last_undegraded":"2024-02-16T10:33:28.004559+0000","last_fullsized":"2024-02-16T10:33:28.004559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:28.004359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:28.004359+0000","last_clean_scrub_stamp":"2024-02-16T10:33:28.004359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:38:41.550878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.233102+0000","last_change":"2024-02-16T10:32:23.233102+0000","last_active":"2024-02-16T10:32:23.233102+0000","last_peered":"2024-02-16T10:32:23.233102+0000","last_clean":"2024-02-16T10:32:23.233102+0000","last_became_active":"2024-02-16T10:30:30.096524+0000","last_became_peered":"2024-02-16T10:30:30.096524+0000","last_unstale":"2024-02-16T10:32:23.233102+0000","last_undegraded":"2024-02-16T10:32:23.233102+0000","last_fullsized":"2024-02-16T10:32:23.233102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:23.232854+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.232854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:06.883209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.871641+0000","last_change":"2024-02-16T10:32:18.871641+0000","last_active":"2024-02-16T10:32:18.871641+0000","last_peered":"2024-02-16T10:32:18.871641+0000","last_clean":"2024-02-16T10:32:18.871641+0000","last_became_active":"2024-02-16T10:30:32.116438+0000","last_became_peered":"2024-02-16T10:30:32.116438+0000","last_unstale":"2024-02-16T10:32:18.871641+0000","last_undegraded":"2024-02-16T10:32:18.871641+0000","last_fullsized":"2024-02-16T10:32:18.871641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:18.871268+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.871268+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:47.245756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:38.003300+0000","last_change":"2024-02-16T10:32:38.003300+0000","last_active":"2024-02-16T10:32:38.003300+0000","last_peered":"2024-02-16T10:32:38.003300+0000","last_clean":"2024-02-16T10:32:38.003300+0000","last_became_active":"2024-02-16T10:30:34.136048+0000","last_became_peered":"2024-02-16T10:30:34.136048+0000","last_unstale":"2024-02-16T10:32:38.003300+0000","last_undegraded":"2024-02-16T10:32:38.003300+0000","last_fullsized":"2024-02-16T10:32:38.003300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:38.003041+0000","last_clean_scrub_stamp":"2024-02-16T10:32:38.003041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:16:53.724413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.613781+0000","last_change":"2024-02-16T10:33:07.613834+0000","last_active":"2024-02-16T10:33:07.613781+0000","last_peered":"2024-02-16T10:33:07.613781+0000","last_clean":"2024-02-16T10:33:07.613781+0000","last_became_active":"2024-02-16T10:30:36.131689+0000","last_became_peered":"2024-02-16T10:30:36.131689+0000","last_unstale":"2024-02-16T10:33:07.613781+0000","last_undegraded":"2024-02-16T10:33:07.613781+0000","last_fullsized":"2024-02-16T10:33:07.613781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:07.613584+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.613584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:59.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.211875+0000","last_change":"2024-02-16T10:32:47.211875+0000","last_active":"2024-02-16T10:32:47.211875+0000","last_peered":"2024-02-16T10:32:47.211875+0000","last_clean":"2024-02-16T10:32:47.211875+0000","last_became_active":"2024-02-16T10:30:28.062521+0000","last_became_peered":"2024-02-16T10:30:28.062521+0000","last_unstale":"2024-02-16T10:32:47.211875+0000","last_undegraded":"2024-02-16T10:32:47.211875+0000","last_fullsized":"2024-02-16T10:32:47.211875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:47.211625+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.211625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:59.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.320864+0000","last_change":"2024-02-16T10:32:39.320864+0000","last_active":"2024-02-16T10:32:39.320864+0000","last_peered":"2024-02-16T10:32:39.320864+0000","last_clean":"2024-02-16T10:32:39.320864+0000","last_became_active":"2024-02-16T10:30:26.089138+0000","last_became_peered":"2024-02-16T10:30:26.089138+0000","last_unstale":"2024-02-16T10:32:39.320864+0000","last_undegraded":"2024-02-16T10:32:39.320864+0000","last_fullsized":"2024-02-16T10:32:39.320864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.320594+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.320594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:32.821736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.839228+0000","last_change":"2024-02-16T10:32:17.839228+0000","last_active":"2024-02-16T10:32:17.839228+0000","last_peered":"2024-02-16T10:32:17.839228+0000","last_clean":"2024-02-16T10:32:17.839228+0000","last_became_active":"2024-02-16T10:30:30.100835+0000","last_became_peered":"2024-02-16T10:30:30.100835+0000","last_unstale":"2024-02-16T10:32:17.839228+0000","last_undegraded":"2024-02-16T10:32:17.839228+0000","last_fullsized":"2024-02-16T10:32:17.839228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:17.838982+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.838982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:34:56.153751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:21.552580+0000","last_change":"2024-02-16T10:32:21.552580+0000","last_active":"2024-02-16T10:32:21.552580+0000","last_peered":"2024-02-16T10:32:21.552580+0000","last_clean":"2024-02-16T10:32:21.552580+0000","last_became_active":"2024-02-16T10:30:32.095814+0000","last_became_peered":"2024-02-16T10:30:32.095814+0000","last_unstale":"2024-02-16T10:32:21.552580+0000","last_undegraded":"2024-02-16T10:32:21.552580+0000","last_fullsized":"2024-02-16T10:32:21.552580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:21.552195+0000","last_clean_scrub_stamp":"2024-02-16T10:32:21.552195+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:05.202550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.348211+0000","last_change":"2024-02-16T10:32:22.348211+0000","last_active":"2024-02-16T10:32:22.348211+0000","last_peered":"2024-02-16T10:32:22.348211+0000","last_clean":"2024-02-16T10:32:22.348211+0000","last_became_active":"2024-02-16T10:30:34.142688+0000","last_became_peered":"2024-02-16T10:30:34.142688+0000","last_unstale":"2024-02-16T10:32:22.348211+0000","last_undegraded":"2024-02-16T10:32:22.348211+0000","last_fullsized":"2024-02-16T10:32:22.348211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.347938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.347938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:05:32.089002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:12.656049+0000","last_change":"2024-02-16T10:33:12.656107+0000","last_active":"2024-02-16T10:33:12.656049+0000","last_peered":"2024-02-16T10:33:12.656049+0000","last_clean":"2024-02-16T10:33:12.656049+0000","last_became_active":"2024-02-16T10:30:36.154720+0000","last_became_peered":"2024-02-16T10:30:36.154720+0000","last_unstale":"2024-02-16T10:33:12.656049+0000","last_undegraded":"2024-02-16T10:33:12.656049+0000","last_fullsized":"2024-02-16T10:33:12.656049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:12.655862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:12.655862+0000","last_clean_scrub_stamp":"2024-02-16T10:33:12.655862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:15:20.302920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.596002+0000","last_change":"2024-02-16T10:32:42.596002+0000","last_active":"2024-02-16T10:32:42.596002+0000","last_peered":"2024-02-16T10:32:42.596002+0000","last_clean":"2024-02-16T10:32:42.596002+0000","last_became_active":"2024-02-16T10:30:28.062963+0000","last_became_peered":"2024-02-16T10:30:28.062963+0000","last_unstale":"2024-02-16T10:32:42.596002+0000","last_undegraded":"2024-02-16T10:32:42.596002+0000","last_fullsized":"2024-02-16T10:32:42.596002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:42.595633+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.595633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:23:38.295504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.312391+0000","last_change":"2024-02-16T10:32:56.312453+0000","last_active":"2024-02-16T10:32:56.312391+0000","last_peered":"2024-02-16T10:32:56.312391+0000","last_clean":"2024-02-16T10:32:56.312391+0000","last_became_active":"2024-02-16T10:30:26.077938+0000","last_became_peered":"2024-02-16T10:30:26.077938+0000","last_unstale":"2024-02-16T10:32:56.312391+0000","last_undegraded":"2024-02-16T10:32:56.312391+0000","last_fullsized":"2024-02-16T10:32:56.312391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:56.312160+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:53:57.665208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.431239+0000","last_change":"2024-02-16T10:32:28.431239+0000","last_active":"2024-02-16T10:32:28.431239+0000","last_peered":"2024-02-16T10:32:28.431239+0000","last_clean":"2024-02-16T10:32:28.431239+0000","last_became_active":"2024-02-16T10:30:30.079380+0000","last_became_peered":"2024-02-16T10:30:30.079380+0000","last_unstale":"2024-02-16T10:32:28.431239+0000","last_undegraded":"2024-02-16T10:32:28.431239+0000","last_fullsized":"2024-02-16T10:32:28.431239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.430925+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.430925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:39.907197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:23.547169+0000","last_change":"2024-02-16T10:32:23.547169+0000","last_active":"2024-02-16T10:32:23.547169+0000","last_peered":"2024-02-16T10:32:23.547169+0000","last_clean":"2024-02-16T10:32:23.547169+0000","last_became_active":"2024-02-16T10:30:32.092133+0000","last_became_peered":"2024-02-16T10:30:32.092133+0000","last_unstale":"2024-02-16T10:32:23.547169+0000","last_undegraded":"2024-02-16T10:32:23.547169+0000","last_fullsized":"2024-02-16T10:32:23.547169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2024-02-16T10:32:23.546894+0000","last_clean_scrub_stamp":"2024-02-16T10:32:23.546894+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:50.589838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.353181+0000","last_change":"2024-02-16T10:32:13.353181+0000","last_active":"2024-02-16T10:32:13.353181+0000","last_peered":"2024-02-16T10:32:13.353181+0000","last_clean":"2024-02-16T10:32:13.353181+0000","last_became_active":"2024-02-16T10:30:34.109307+0000","last_became_peered":"2024-02-16T10:30:34.109307+0000","last_unstale":"2024-02-16T10:32:13.353181+0000","last_undegraded":"2024-02-16T10:32:13.353181+0000","last_fullsized":"2024-02-16T10:32:13.353181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.352927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.352927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:12:59.430673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:33.027446+0000","last_change":"2024-02-16T10:33:33.027506+0000","last_active":"2024-02-16T10:33:33.027446+0000","last_peered":"2024-02-16T10:33:33.027446+0000","last_clean":"2024-02-16T10:33:33.027446+0000","last_became_active":"2024-02-16T10:30:36.151945+0000","last_became_peered":"2024-02-16T10:30:36.151945+0000","last_unstale":"2024-02-16T10:33:33.027446+0000","last_undegraded":"2024-02-16T10:33:33.027446+0000","last_fullsized":"2024-02-16T10:33:33.027446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:33:33.027243+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:33:33.027243+0000","last_clean_scrub_stamp":"2024-02-16T10:33:33.027243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:27:40.654426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.978151+0000","last_change":"2024-02-16T10:32:33.978151+0000","last_active":"2024-02-16T10:32:33.978151+0000","last_peered":"2024-02-16T10:32:33.978151+0000","last_clean":"2024-02-16T10:32:33.978151+0000","last_became_active":"2024-02-16T10:30:28.083334+0000","last_became_peered":"2024-02-16T10:30:28.083334+0000","last_unstale":"2024-02-16T10:32:33.978151+0000","last_undegraded":"2024-02-16T10:32:33.978151+0000","last_fullsized":"2024-02-16T10:32:33.978151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.977897+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.977897+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:01.970621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.246513+0000","last_change":"2024-02-16T10:32:55.246576+0000","last_active":"2024-02-16T10:32:55.246513+0000","last_peered":"2024-02-16T10:32:55.246513+0000","last_clean":"2024-02-16T10:32:55.246513+0000","last_became_active":"2024-02-16T10:30:26.091024+0000","last_became_peered":"2024-02-16T10:30:26.091024+0000","last_unstale":"2024-02-16T10:32:55.246513+0000","last_undegraded":"2024-02-16T10:32:55.246513+0000","last_fullsized":"2024-02-16T10:32:55.246513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:55.246320+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.246320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:01:15.374588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.892358+0000","last_change":"2024-02-16T10:32:22.892358+0000","last_active":"2024-02-16T10:32:22.892358+0000","last_peered":"2024-02-16T10:32:22.892358+0000","last_clean":"2024-02-16T10:32:22.892358+0000","last_became_active":"2024-02-16T10:30:30.091120+0000","last_became_peered":"2024-02-16T10:30:30.091120+0000","last_unstale":"2024-02-16T10:32:22.892358+0000","last_undegraded":"2024-02-16T10:32:22.892358+0000","last_fullsized":"2024-02-16T10:32:22.892358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.892090+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.892090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:19:42.373803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.352194+0000","last_change":"2024-02-16T10:32:24.352194+0000","last_active":"2024-02-16T10:32:24.352194+0000","last_peered":"2024-02-16T10:32:24.352194+0000","last_clean":"2024-02-16T10:32:24.352194+0000","last_became_active":"2024-02-16T10:30:32.084164+0000","last_became_peered":"2024-02-16T10:30:32.084164+0000","last_unstale":"2024-02-16T10:32:24.352194+0000","last_undegraded":"2024-02-16T10:32:24.352194+0000","last_fullsized":"2024-02-16T10:32:24.352194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-02-16T10:32:24.351933+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.351933+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T10:59:53.942303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:15.181591+0000","last_change":"2024-02-16T10:32:15.181591+0000","last_active":"2024-02-16T10:32:15.181591+0000","last_peered":"2024-02-16T10:32:15.181591+0000","last_clean":"2024-02-16T10:32:15.181591+0000","last_became_active":"2024-02-16T10:30:34.118875+0000","last_became_peered":"2024-02-16T10:30:34.118875+0000","last_unstale":"2024-02-16T10:32:15.181591+0000","last_undegraded":"2024-02-16T10:32:15.181591+0000","last_fullsized":"2024-02-16T10:32:15.181591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:15.181356+0000","last_clean_scrub_stamp":"2024-02-16T10:32:15.181356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:11:14.859456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'24","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.001573+0000","last_change":"2024-02-16T10:32:54.001753+0000","last_active":"2024-02-16T10:32:54.001573+0000","last_peered":"2024-02-16T10:32:54.001573+0000","last_clean":"2024-02-16T10:32:54.001573+0000","last_became_active":"2024-02-16T10:30:28.067884+0000","last_became_peered":"2024-02-16T10:30:28.067884+0000","last_unstale":"2024-02-16T10:32:54.001573+0000","last_undegraded":"2024-02-16T10:32:54.001573+0000","last_fullsized":"2024-02-16T10:32:54.001573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-02-16T10:32:54.001338+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.001338+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:49:45.427964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":75,"num_read_kb":59,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:10.109834+0000","last_change":"2024-02-16T10:33:10.109901+0000","last_active":"2024-02-16T10:33:10.109834+0000","last_peered":"2024-02-16T10:33:10.109834+0000","last_clean":"2024-02-16T10:33:10.109834+0000","last_became_active":"2024-02-16T10:30:26.079928+0000","last_became_peered":"2024-02-16T10:30:26.079928+0000","last_unstale":"2024-02-16T10:33:10.109834+0000","last_undegraded":"2024-02-16T10:33:10.109834+0000","last_fullsized":"2024-02-16T10:33:10.109834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:10.109636+0000","last_clean_scrub_stamp":"2024-02-16T10:33:10.109636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:45:03.216850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.378170+0000","last_change":"2024-02-16T10:33:06.378170+0000","last_active":"2024-02-16T10:33:06.378170+0000","last_peered":"2024-02-16T10:33:06.378170+0000","last_clean":"2024-02-16T10:33:06.378170+0000","last_became_active":"2024-02-16T10:31:06.933201+0000","last_became_peered":"2024-02-16T10:31:06.933201+0000","last_unstale":"2024-02-16T10:33:06.378170+0000","last_undegraded":"2024-02-16T10:33:06.378170+0000","last_fullsized":"2024-02-16T10:33:06.378170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.377937+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.377937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:52.202390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.580433+0000","last_change":"2024-02-16T10:32:22.580433+0000","last_active":"2024-02-16T10:32:22.580433+0000","last_peered":"2024-02-16T10:32:22.580433+0000","last_clean":"2024-02-16T10:32:22.580433+0000","last_became_active":"2024-02-16T10:30:32.091402+0000","last_became_peered":"2024-02-16T10:30:32.091402+0000","last_unstale":"2024-02-16T10:32:22.580433+0000","last_undegraded":"2024-02-16T10:32:22.580433+0000","last_fullsized":"2024-02-16T10:32:22.580433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-02-16T10:32:22.580047+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.580047+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:28.539775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:13.183196+0000","last_change":"2024-02-16T10:32:13.183196+0000","last_active":"2024-02-16T10:32:13.183196+0000","last_peered":"2024-02-16T10:32:13.183196+0000","last_clean":"2024-02-16T10:32:13.183196+0000","last_became_active":"2024-02-16T10:30:34.118992+0000","last_became_peered":"2024-02-16T10:30:34.118992+0000","last_unstale":"2024-02-16T10:32:13.183196+0000","last_undegraded":"2024-02-16T10:32:13.183196+0000","last_fullsized":"2024-02-16T10:32:13.183196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:13.182934+0000","last_clean_scrub_stamp":"2024-02-16T10:32:13.182934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:58:32.694869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:09.576093+0000","last_change":"2024-02-16T10:33:09.576156+0000","last_active":"2024-02-16T10:33:09.576093+0000","last_peered":"2024-02-16T10:33:09.576093+0000","last_clean":"2024-02-16T10:33:09.576093+0000","last_became_active":"2024-02-16T10:30:36.137894+0000","last_became_peered":"2024-02-16T10:30:36.137894+0000","last_unstale":"2024-02-16T10:33:09.576093+0000","last_undegraded":"2024-02-16T10:33:09.576093+0000","last_fullsized":"2024-02-16T10:33:09.576093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-02-16T10:33:09.575901+0000","last_clean_scrub_stamp":"2024-02-16T10:33:09.575901+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:35:24.885751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.615377+0000","last_change":"2024-02-16T10:33:06.615431+0000","last_active":"2024-02-16T10:33:06.615377+0000","last_peered":"2024-02-16T10:33:06.615377+0000","last_clean":"2024-02-16T10:33:06.615377+0000","last_became_active":"2024-02-16T10:30:28.077843+0000","last_became_peered":"2024-02-16T10:30:28.077843+0000","last_unstale":"2024-02-16T10:33:06.615377+0000","last_undegraded":"2024-02-16T10:33:06.615377+0000","last_fullsized":"2024-02-16T10:33:06.615377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.615187+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.615187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:22.617170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.279087+0000","last_change":"2024-02-16T10:32:57.279157+0000","last_active":"2024-02-16T10:32:57.279087+0000","last_peered":"2024-02-16T10:32:57.279087+0000","last_clean":"2024-02-16T10:32:57.279087+0000","last_became_active":"2024-02-16T10:30:26.093258+0000","last_became_peered":"2024-02-16T10:30:26.093258+0000","last_unstale":"2024-02-16T10:32:57.279087+0000","last_undegraded":"2024-02-16T10:32:57.279087+0000","last_fullsized":"2024-02-16T10:32:57.279087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:57.278888+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.278888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:40:25.271612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.440004+0000","last_change":"2024-02-16T10:32:32.440004+0000","last_active":"2024-02-16T10:32:32.440004+0000","last_peered":"2024-02-16T10:32:32.440004+0000","last_clean":"2024-02-16T10:32:32.440004+0000","last_became_active":"2024-02-16T10:30:30.074582+0000","last_became_peered":"2024-02-16T10:30:30.074582+0000","last_unstale":"2024-02-16T10:32:32.440004+0000","last_undegraded":"2024-02-16T10:32:32.440004+0000","last_fullsized":"2024-02-16T10:32:32.440004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:32.439721+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.439721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:38.399449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.980131+0000","last_change":"2024-02-16T10:32:45.980131+0000","last_active":"2024-02-16T10:32:45.980131+0000","last_peered":"2024-02-16T10:32:45.980131+0000","last_clean":"2024-02-16T10:32:45.980131+0000","last_became_active":"2024-02-16T10:30:32.119827+0000","last_became_peered":"2024-02-16T10:30:32.119827+0000","last_unstale":"2024-02-16T10:32:45.980131+0000","last_undegraded":"2024-02-16T10:32:45.980131+0000","last_fullsized":"2024-02-16T10:32:45.980131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-02-16T10:32:45.979834+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.979834+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:01.136119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:22.184210+0000","last_change":"2024-02-16T10:32:22.184210+0000","last_active":"2024-02-16T10:32:22.184210+0000","last_peered":"2024-02-16T10:32:22.184210+0000","last_clean":"2024-02-16T10:32:22.184210+0000","last_became_active":"2024-02-16T10:30:34.124163+0000","last_became_peered":"2024-02-16T10:30:34.124163+0000","last_unstale":"2024-02-16T10:32:22.184210+0000","last_undegraded":"2024-02-16T10:32:22.184210+0000","last_fullsized":"2024-02-16T10:32:22.184210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:22.183927+0000","last_clean_scrub_stamp":"2024-02-16T10:32:22.183927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:23:58.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.985188+0000","last_change":"2024-02-16T10:32:56.985252+0000","last_active":"2024-02-16T10:32:56.985188+0000","last_peered":"2024-02-16T10:32:56.985188+0000","last_clean":"2024-02-16T10:32:56.985188+0000","last_became_active":"2024-02-16T10:30:36.132101+0000","last_became_peered":"2024-02-16T10:30:36.132101+0000","last_unstale":"2024-02-16T10:32:56.985188+0000","last_undegraded":"2024-02-16T10:32:56.985188+0000","last_fullsized":"2024-02-16T10:32:56.985188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.984974+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.984974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:05:02.646087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:27.887571+0000","last_change":"2024-02-16T10:32:27.887571+0000","last_active":"2024-02-16T10:32:27.887571+0000","last_peered":"2024-02-16T10:32:27.887571+0000","last_clean":"2024-02-16T10:32:27.887571+0000","last_became_active":"2024-02-16T10:30:28.086603+0000","last_became_peered":"2024-02-16T10:30:28.086603+0000","last_unstale":"2024-02-16T10:32:27.887571+0000","last_undegraded":"2024-02-16T10:32:27.887571+0000","last_fullsized":"2024-02-16T10:32:27.887571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:27.887325+0000","last_clean_scrub_stamp":"2024-02-16T10:32:27.887325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:24.904620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:06.216574+0000","last_change":"2024-02-16T10:33:06.216636+0000","last_active":"2024-02-16T10:33:06.216574+0000","last_peered":"2024-02-16T10:33:06.216574+0000","last_clean":"2024-02-16T10:33:06.216574+0000","last_became_active":"2024-02-16T10:30:26.091092+0000","last_became_peered":"2024-02-16T10:30:26.091092+0000","last_unstale":"2024-02-16T10:33:06.216574+0000","last_undegraded":"2024-02-16T10:33:06.216574+0000","last_fullsized":"2024-02-16T10:33:06.216574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:06.216374+0000","last_clean_scrub_stamp":"2024-02-16T10:33:06.216374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:59:22.837708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:31.436035+0000","last_change":"2024-02-16T10:32:31.436035+0000","last_active":"2024-02-16T10:32:31.436035+0000","last_peered":"2024-02-16T10:32:31.436035+0000","last_clean":"2024-02-16T10:32:31.436035+0000","last_became_active":"2024-02-16T10:30:30.074292+0000","last_became_peered":"2024-02-16T10:30:30.074292+0000","last_unstale":"2024-02-16T10:32:31.436035+0000","last_undegraded":"2024-02-16T10:32:31.436035+0000","last_fullsized":"2024-02-16T10:32:31.436035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:31.435793+0000","last_clean_scrub_stamp":"2024-02-16T10:32:31.435793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:41:15.086149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:19.510077+0000","last_change":"2024-02-16T10:32:19.510077+0000","last_active":"2024-02-16T10:32:19.510077+0000","last_peered":"2024-02-16T10:32:19.510077+0000","last_clean":"2024-02-16T10:32:19.510077+0000","last_became_active":"2024-02-16T10:30:32.118343+0000","last_became_peered":"2024-02-16T10:30:32.118343+0000","last_unstale":"2024-02-16T10:32:19.510077+0000","last_undegraded":"2024-02-16T10:32:19.510077+0000","last_fullsized":"2024-02-16T10:32:19.510077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-02-16T10:32:19.509815+0000","last_clean_scrub_stamp":"2024-02-16T10:32:19.509815+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:37:06.881445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:12.449861+0000","last_change":"2024-02-16T10:32:12.449861+0000","last_active":"2024-02-16T10:32:12.449861+0000","last_peered":"2024-02-16T10:32:12.449861+0000","last_clean":"2024-02-16T10:32:12.449861+0000","last_became_active":"2024-02-16T10:30:34.124031+0000","last_became_peered":"2024-02-16T10:30:34.124031+0000","last_unstale":"2024-02-16T10:32:12.449861+0000","last_undegraded":"2024-02-16T10:32:12.449861+0000","last_fullsized":"2024-02-16T10:32:12.449861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:12.449759+0000","last_clean_scrub_stamp":"2024-02-16T10:32:12.449759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:42:28.024682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.014475+0000","last_change":"2024-02-16T10:33:01.014585+0000","last_active":"2024-02-16T10:33:01.014475+0000","last_peered":"2024-02-16T10:33:01.014475+0000","last_clean":"2024-02-16T10:33:01.014475+0000","last_became_active":"2024-02-16T10:30:36.142300+0000","last_became_peered":"2024-02-16T10:30:36.142300+0000","last_unstale":"2024-02-16T10:33:01.014475+0000","last_undegraded":"2024-02-16T10:33:01.014475+0000","last_fullsized":"2024-02-16T10:33:01.014475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.014232+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.014232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:43:02.321815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.608039+0000","last_change":"2024-02-16T10:32:52.608039+0000","last_active":"2024-02-16T10:32:52.608039+0000","last_peered":"2024-02-16T10:32:52.608039+0000","last_clean":"2024-02-16T10:32:52.608039+0000","last_became_active":"2024-02-16T10:30:28.072573+0000","last_became_peered":"2024-02-16T10:30:28.072573+0000","last_unstale":"2024-02-16T10:32:52.608039+0000","last_undegraded":"2024-02-16T10:32:52.608039+0000","last_fullsized":"2024-02-16T10:32:52.608039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.607781+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.607781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:42:26.752711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:20.024979+0000","last_change":"2024-02-16T10:33:20.025028+0000","last_active":"2024-02-16T10:33:20.024979+0000","last_peered":"2024-02-16T10:33:20.024979+0000","last_clean":"2024-02-16T10:33:20.024979+0000","last_became_active":"2024-02-16T10:30:26.067979+0000","last_became_peered":"2024-02-16T10:30:26.067979+0000","last_unstale":"2024-02-16T10:33:20.024979+0000","last_undegraded":"2024-02-16T10:33:20.024979+0000","last_fullsized":"2024-02-16T10:33:20.024979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:20.024832+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:20.024832+0000","last_clean_scrub_stamp":"2024-02-16T10:33:20.024832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:52:09.643261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:28.250844+0000","last_change":"2024-02-16T10:32:28.250844+0000","last_active":"2024-02-16T10:32:28.250844+0000","last_peered":"2024-02-16T10:32:28.250844+0000","last_clean":"2024-02-16T10:32:28.250844+0000","last_became_active":"2024-02-16T10:30:30.090471+0000","last_became_peered":"2024-02-16T10:30:30.090471+0000","last_unstale":"2024-02-16T10:32:28.250844+0000","last_undegraded":"2024-02-16T10:32:28.250844+0000","last_fullsized":"2024-02-16T10:32:28.250844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:28.250601+0000","last_clean_scrub_stamp":"2024-02-16T10:32:28.250601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:49:40.734413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:42.941423+0000","last_change":"2024-02-16T10:32:42.941509+0000","last_active":"2024-02-16T10:32:42.941423+0000","last_peered":"2024-02-16T10:32:42.941423+0000","last_clean":"2024-02-16T10:32:42.941423+0000","last_became_active":"2024-02-16T10:30:32.122557+0000","last_became_peered":"2024-02-16T10:30:32.122557+0000","last_unstale":"2024-02-16T10:32:42.941423+0000","last_undegraded":"2024-02-16T10:32:42.941423+0000","last_fullsized":"2024-02-16T10:32:42.941423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-02-16T10:32:42.941156+0000","last_clean_scrub_stamp":"2024-02-16T10:32:42.941156+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:58:59.562490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":303,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:26.416755+0000","last_change":"2024-02-16T10:32:26.416755+0000","last_active":"2024-02-16T10:32:26.416755+0000","last_peered":"2024-02-16T10:32:26.416755+0000","last_clean":"2024-02-16T10:32:26.416755+0000","last_became_active":"2024-02-16T10:30:34.142795+0000","last_became_peered":"2024-02-16T10:30:34.142795+0000","last_unstale":"2024-02-16T10:32:26.416755+0000","last_undegraded":"2024-02-16T10:32:26.416755+0000","last_fullsized":"2024-02-16T10:32:26.416755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'243","last_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_deep_scrub":"33'243","last_deep_scrub_stamp":"2024-02-16T10:32:26.416475+0000","last_clean_scrub_stamp":"2024-02-16T10:32:26.416475+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:44:59.606871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:31.991078+0000","last_change":"2024-02-16T10:33:31.991131+0000","last_active":"2024-02-16T10:33:31.991078+0000","last_peered":"2024-02-16T10:33:31.991078+0000","last_clean":"2024-02-16T10:33:31.991078+0000","last_became_active":"2024-02-16T10:30:36.142860+0000","last_became_peered":"2024-02-16T10:30:36.142860+0000","last_unstale":"2024-02-16T10:33:31.991078+0000","last_undegraded":"2024-02-16T10:33:31.991078+0000","last_fullsized":"2024-02-16T10:33:31.991078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:31.990885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:31.990885+0000","last_clean_scrub_stamp":"2024-02-16T10:33:31.990885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:15:34.154927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.312242+0000","last_change":"2024-02-16T10:32:48.312242+0000","last_active":"2024-02-16T10:32:48.312242+0000","last_peered":"2024-02-16T10:32:48.312242+0000","last_clean":"2024-02-16T10:32:48.312242+0000","last_became_active":"2024-02-16T10:30:28.067923+0000","last_became_peered":"2024-02-16T10:30:28.067923+0000","last_unstale":"2024-02-16T10:32:48.312242+0000","last_undegraded":"2024-02-16T10:32:48.312242+0000","last_fullsized":"2024-02-16T10:32:48.312242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:48.311977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.311977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:16.686464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:02.230708+0000","last_change":"2024-02-16T10:33:02.230789+0000","last_active":"2024-02-16T10:33:02.230708+0000","last_peered":"2024-02-16T10:33:02.230708+0000","last_clean":"2024-02-16T10:33:02.230708+0000","last_became_active":"2024-02-16T10:30:26.084879+0000","last_became_peered":"2024-02-16T10:30:26.084879+0000","last_unstale":"2024-02-16T10:33:02.230708+0000","last_undegraded":"2024-02-16T10:33:02.230708+0000","last_fullsized":"2024-02-16T10:33:02.230708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:02.230512+0000","last_clean_scrub_stamp":"2024-02-16T10:33:02.230512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:07:41.751700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.296238+0000","last_change":"2024-02-16T10:32:25.296238+0000","last_active":"2024-02-16T10:32:25.296238+0000","last_peered":"2024-02-16T10:32:25.296238+0000","last_clean":"2024-02-16T10:32:25.296238+0000","last_became_active":"2024-02-16T10:30:30.097206+0000","last_became_peered":"2024-02-16T10:30:30.097206+0000","last_unstale":"2024-02-16T10:32:25.296238+0000","last_undegraded":"2024-02-16T10:32:25.296238+0000","last_fullsized":"2024-02-16T10:32:25.296238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:25.295850+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.295850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:44:52.338795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:17.346391+0000","last_change":"2024-02-16T10:32:17.346391+0000","last_active":"2024-02-16T10:32:17.346391+0000","last_peered":"2024-02-16T10:32:17.346391+0000","last_clean":"2024-02-16T10:32:17.346391+0000","last_became_active":"2024-02-16T10:30:32.094576+0000","last_became_peered":"2024-02-16T10:30:32.094576+0000","last_unstale":"2024-02-16T10:32:17.346391+0000","last_undegraded":"2024-02-16T10:32:17.346391+0000","last_fullsized":"2024-02-16T10:32:17.346391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2024-02-16T10:32:17.346100+0000","last_clean_scrub_stamp":"2024-02-16T10:32:17.346100+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:49:27.923447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.576651+0000","last_change":"2024-02-16T10:32:24.576651+0000","last_active":"2024-02-16T10:32:24.576651+0000","last_peered":"2024-02-16T10:32:24.576651+0000","last_clean":"2024-02-16T10:32:24.576651+0000","last_became_active":"2024-02-16T10:30:34.134870+0000","last_became_peered":"2024-02-16T10:30:34.134870+0000","last_unstale":"2024-02-16T10:32:24.576651+0000","last_undegraded":"2024-02-16T10:32:24.576651+0000","last_fullsized":"2024-02-16T10:32:24.576651+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.576402+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.576402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:55:39.040594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:11.231903+0000","last_change":"2024-02-16T10:33:11.231970+0000","last_active":"2024-02-16T10:33:11.231903+0000","last_peered":"2024-02-16T10:33:11.231903+0000","last_clean":"2024-02-16T10:33:11.231903+0000","last_became_active":"2024-02-16T10:30:36.150065+0000","last_became_peered":"2024-02-16T10:30:36.150065+0000","last_unstale":"2024-02-16T10:33:11.231903+0000","last_undegraded":"2024-02-16T10:33:11.231903+0000","last_fullsized":"2024-02-16T10:33:11.231903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-02-16T10:33:11.231704+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-02-16T10:33:11.231704+0000","last_clean_scrub_stamp":"2024-02-16T10:33:11.231704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:54:03.021386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.301320+0000","last_change":"2024-02-16T10:32:50.301320+0000","last_active":"2024-02-16T10:32:50.301320+0000","last_peered":"2024-02-16T10:32:50.301320+0000","last_clean":"2024-02-16T10:32:50.301320+0000","last_became_active":"2024-02-16T10:30:28.067723+0000","last_became_peered":"2024-02-16T10:30:28.067723+0000","last_unstale":"2024-02-16T10:32:50.301320+0000","last_undegraded":"2024-02-16T10:32:50.301320+0000","last_fullsized":"2024-02-16T10:32:50.301320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-02-16T10:32:50.301175+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.301175+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:19:18.159316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:13.080022+0000","last_change":"2024-02-16T10:33:13.080084+0000","last_active":"2024-02-16T10:33:13.080022+0000","last_peered":"2024-02-16T10:33:13.080022+0000","last_clean":"2024-02-16T10:33:13.080022+0000","last_became_active":"2024-02-16T10:30:26.085273+0000","last_became_peered":"2024-02-16T10:30:26.085273+0000","last_unstale":"2024-02-16T10:33:13.080022+0000","last_undegraded":"2024-02-16T10:33:13.080022+0000","last_fullsized":"2024-02-16T10:33:13.080022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:13.079825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:13.079825+0000","last_clean_scrub_stamp":"2024-02-16T10:33:13.079825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:19:53.541711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.413364+0000","last_change":"2024-02-16T10:32:33.413364+0000","last_active":"2024-02-16T10:32:33.413364+0000","last_peered":"2024-02-16T10:32:33.413364+0000","last_clean":"2024-02-16T10:32:33.413364+0000","last_became_active":"2024-02-16T10:30:30.073854+0000","last_became_peered":"2024-02-16T10:30:30.073854+0000","last_unstale":"2024-02-16T10:32:33.413364+0000","last_undegraded":"2024-02-16T10:32:33.413364+0000","last_fullsized":"2024-02-16T10:32:33.413364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:33.413126+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.413126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:45:00.456070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.600445+0000","last_change":"2024-02-16T10:32:25.600445+0000","last_active":"2024-02-16T10:32:25.600445+0000","last_peered":"2024-02-16T10:32:25.600445+0000","last_clean":"2024-02-16T10:32:25.600445+0000","last_became_active":"2024-02-16T10:30:32.088147+0000","last_became_peered":"2024-02-16T10:30:32.088147+0000","last_unstale":"2024-02-16T10:32:25.600445+0000","last_undegraded":"2024-02-16T10:32:25.600445+0000","last_fullsized":"2024-02-16T10:32:25.600445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:25.600171+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.600171+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:59:50.787242+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.000355+0000","last_change":"2024-02-16T10:32:36.000355+0000","last_active":"2024-02-16T10:32:36.000355+0000","last_peered":"2024-02-16T10:32:36.000355+0000","last_clean":"2024-02-16T10:32:36.000355+0000","last_became_active":"2024-02-16T10:30:34.136068+0000","last_became_peered":"2024-02-16T10:30:34.136068+0000","last_unstale":"2024-02-16T10:32:36.000355+0000","last_undegraded":"2024-02-16T10:32:36.000355+0000","last_fullsized":"2024-02-16T10:32:36.000355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.000094+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.000094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:36.814271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:37.001696+0000","last_change":"2024-02-16T10:33:37.001752+0000","last_active":"2024-02-16T10:33:37.001696+0000","last_peered":"2024-02-16T10:33:37.001696+0000","last_clean":"2024-02-16T10:33:37.001696+0000","last_became_active":"2024-02-16T10:30:36.159817+0000","last_became_peered":"2024-02-16T10:30:36.159817+0000","last_unstale":"2024-02-16T10:33:37.001696+0000","last_undegraded":"2024-02-16T10:33:37.001696+0000","last_fullsized":"2024-02-16T10:33:37.001696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:37.001504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:37.001504+0000","last_clean_scrub_stamp":"2024-02-16T10:33:37.001504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:18:04.515648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.991391+0000","last_change":"2024-02-16T10:32:50.991391+0000","last_active":"2024-02-16T10:32:50.991391+0000","last_peered":"2024-02-16T10:32:50.991391+0000","last_clean":"2024-02-16T10:32:50.991391+0000","last_became_active":"2024-02-16T10:30:28.067646+0000","last_became_peered":"2024-02-16T10:30:28.067646+0000","last_unstale":"2024-02-16T10:32:50.991391+0000","last_undegraded":"2024-02-16T10:32:50.991391+0000","last_fullsized":"2024-02-16T10:32:50.991391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.990977+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.990977+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:13:14.412923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:00.548693+0000","last_change":"2024-02-16T10:33:00.548760+0000","last_active":"2024-02-16T10:33:00.548693+0000","last_peered":"2024-02-16T10:33:00.548693+0000","last_clean":"2024-02-16T10:33:00.548693+0000","last_became_active":"2024-02-16T10:30:26.085509+0000","last_became_peered":"2024-02-16T10:30:26.085509+0000","last_unstale":"2024-02-16T10:33:00.548693+0000","last_undegraded":"2024-02-16T10:33:00.548693+0000","last_fullsized":"2024-02-16T10:33:00.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:00.548502+0000","last_clean_scrub_stamp":"2024-02-16T10:33:00.548502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:59:58.925451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.282549+0000","last_change":"2024-02-16T10:32:24.282549+0000","last_active":"2024-02-16T10:32:24.282549+0000","last_peered":"2024-02-16T10:32:24.282549+0000","last_clean":"2024-02-16T10:32:24.282549+0000","last_became_active":"2024-02-16T10:30:30.097923+0000","last_became_peered":"2024-02-16T10:30:30.097923+0000","last_unstale":"2024-02-16T10:32:24.282549+0000","last_undegraded":"2024-02-16T10:32:24.282549+0000","last_fullsized":"2024-02-16T10:32:24.282549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:24.282291+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.282291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:58:30.242018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:20.877073+0000","last_change":"2024-02-16T10:32:20.877073+0000","last_active":"2024-02-16T10:32:20.877073+0000","last_peered":"2024-02-16T10:32:20.877073+0000","last_clean":"2024-02-16T10:32:20.877073+0000","last_became_active":"2024-02-16T10:30:32.119146+0000","last_became_peered":"2024-02-16T10:30:32.119146+0000","last_unstale":"2024-02-16T10:32:20.877073+0000","last_undegraded":"2024-02-16T10:32:20.877073+0000","last_fullsized":"2024-02-16T10:32:20.877073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2024-02-16T10:32:20.876820+0000","last_clean_scrub_stamp":"2024-02-16T10:32:20.876820+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:18:48.734961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:34.959040+0000","last_change":"2024-02-16T10:32:34.959040+0000","last_active":"2024-02-16T10:32:34.959040+0000","last_peered":"2024-02-16T10:32:34.959040+0000","last_clean":"2024-02-16T10:32:34.959040+0000","last_became_active":"2024-02-16T10:30:34.136237+0000","last_became_peered":"2024-02-16T10:30:34.136237+0000","last_unstale":"2024-02-16T10:32:34.959040+0000","last_undegraded":"2024-02-16T10:32:34.959040+0000","last_fullsized":"2024-02-16T10:32:34.959040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:34.958764+0000","last_clean_scrub_stamp":"2024-02-16T10:32:34.958764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:01.301485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:36.018662+0000","last_change":"2024-02-16T10:33:36.018729+0000","last_active":"2024-02-16T10:33:36.018662+0000","last_peered":"2024-02-16T10:33:36.018662+0000","last_clean":"2024-02-16T10:33:36.018662+0000","last_became_active":"2024-02-16T10:30:36.159681+0000","last_became_peered":"2024-02-16T10:30:36.159681+0000","last_unstale":"2024-02-16T10:33:36.018662+0000","last_undegraded":"2024-02-16T10:33:36.018662+0000","last_fullsized":"2024-02-16T10:33:36.018662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:36.018459+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:36.018459+0000","last_clean_scrub_stamp":"2024-02-16T10:33:36.018459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:18:57.264640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.240998+0000","last_change":"2024-02-16T10:32:44.240998+0000","last_active":"2024-02-16T10:32:44.240998+0000","last_peered":"2024-02-16T10:32:44.240998+0000","last_clean":"2024-02-16T10:32:44.240998+0000","last_became_active":"2024-02-16T10:30:28.067854+0000","last_became_peered":"2024-02-16T10:30:28.067854+0000","last_unstale":"2024-02-16T10:32:44.240998+0000","last_undegraded":"2024-02-16T10:32:44.240998+0000","last_fullsized":"2024-02-16T10:32:44.240998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.240707+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.240707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:01:10.432991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:53.198662+0000","last_change":"2024-02-16T10:32:53.198731+0000","last_active":"2024-02-16T10:32:53.198662+0000","last_peered":"2024-02-16T10:32:53.198662+0000","last_clean":"2024-02-16T10:32:53.198662+0000","last_became_active":"2024-02-16T10:30:26.093756+0000","last_became_peered":"2024-02-16T10:30:26.093756+0000","last_unstale":"2024-02-16T10:32:53.198662+0000","last_undegraded":"2024-02-16T10:32:53.198662+0000","last_fullsized":"2024-02-16T10:32:53.198662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:53.198470+0000","last_clean_scrub_stamp":"2024-02-16T10:32:53.198470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:45:23.978649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:32.164334+0000","last_change":"2024-02-16T10:32:32.164334+0000","last_active":"2024-02-16T10:32:32.164334+0000","last_peered":"2024-02-16T10:32:32.164334+0000","last_clean":"2024-02-16T10:32:32.164334+0000","last_became_active":"2024-02-16T10:30:30.089529+0000","last_became_peered":"2024-02-16T10:30:30.089529+0000","last_unstale":"2024-02-16T10:32:32.164334+0000","last_undegraded":"2024-02-16T10:32:32.164334+0000","last_fullsized":"2024-02-16T10:32:32.164334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-02-16T10:32:32.164046+0000","last_clean_scrub_stamp":"2024-02-16T10:32:32.164046+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:38:25.665188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":968,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:24.857295+0000","last_change":"2024-02-16T10:32:24.857295+0000","last_active":"2024-02-16T10:32:24.857295+0000","last_peered":"2024-02-16T10:32:24.857295+0000","last_clean":"2024-02-16T10:32:24.857295+0000","last_became_active":"2024-02-16T10:30:32.119870+0000","last_became_peered":"2024-02-16T10:30:32.119870+0000","last_unstale":"2024-02-16T10:32:24.857295+0000","last_undegraded":"2024-02-16T10:32:24.857295+0000","last_fullsized":"2024-02-16T10:32:24.857295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-02-16T10:32:24.857001+0000","last_clean_scrub_stamp":"2024-02-16T10:32:24.857001+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:07:32.050416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":988,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:18.493966+0000","last_change":"2024-02-16T10:32:18.493966+0000","last_active":"2024-02-16T10:32:18.493966+0000","last_peered":"2024-02-16T10:32:18.493966+0000","last_clean":"2024-02-16T10:32:18.493966+0000","last_became_active":"2024-02-16T10:30:34.104220+0000","last_became_peered":"2024-02-16T10:30:34.104220+0000","last_unstale":"2024-02-16T10:32:18.493966+0000","last_undegraded":"2024-02-16T10:32:18.493966+0000","last_fullsized":"2024-02-16T10:32:18.493966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:18.493720+0000","last_clean_scrub_stamp":"2024-02-16T10:32:18.493720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:17:29.969992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:33.978788+0000","last_change":"2024-02-16T10:33:33.978842+0000","last_active":"2024-02-16T10:33:33.978788+0000","last_peered":"2024-02-16T10:33:33.978788+0000","last_clean":"2024-02-16T10:33:33.978788+0000","last_became_active":"2024-02-16T10:30:36.153278+0000","last_became_peered":"2024-02-16T10:30:36.153278+0000","last_unstale":"2024-02-16T10:33:33.978788+0000","last_undegraded":"2024-02-16T10:33:33.978788+0000","last_fullsized":"2024-02-16T10:33:33.978788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:33.978591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:33.978591+0000","last_clean_scrub_stamp":"2024-02-16T10:33:33.978591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:53:07.102478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:33.185600+0000","last_change":"2024-02-16T10:32:33.185600+0000","last_active":"2024-02-16T10:32:33.185600+0000","last_peered":"2024-02-16T10:32:33.185600+0000","last_clean":"2024-02-16T10:32:33.185600+0000","last_became_active":"2024-02-16T10:30:28.078171+0000","last_became_peered":"2024-02-16T10:30:28.078171+0000","last_unstale":"2024-02-16T10:32:33.185600+0000","last_undegraded":"2024-02-16T10:32:33.185600+0000","last_fullsized":"2024-02-16T10:32:33.185600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-02-16T10:32:33.185313+0000","last_clean_scrub_stamp":"2024-02-16T10:32:33.185313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:23:38.162727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.322881+0000","last_change":"2024-02-16T10:32:58.322937+0000","last_active":"2024-02-16T10:32:58.322881+0000","last_peered":"2024-02-16T10:32:58.322881+0000","last_clean":"2024-02-16T10:32:58.322881+0000","last_became_active":"2024-02-16T10:30:26.082218+0000","last_became_peered":"2024-02-16T10:30:26.082218+0000","last_unstale":"2024-02-16T10:32:58.322881+0000","last_undegraded":"2024-02-16T10:32:58.322881+0000","last_fullsized":"2024-02-16T10:32:58.322881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:58.322698+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.322698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:50:34.132775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:48.540064+0000","last_change":"2024-02-16T10:32:48.540133+0000","last_active":"2024-02-16T10:32:48.540064+0000","last_peered":"2024-02-16T10:32:48.540064+0000","last_clean":"2024-02-16T10:32:48.540064+0000","last_became_active":"2024-02-16T10:30:28.066281+0000","last_became_peered":"2024-02-16T10:30:28.066281+0000","last_unstale":"2024-02-16T10:32:48.540064+0000","last_undegraded":"2024-02-16T10:32:48.540064+0000","last_fullsized":"2024-02-16T10:32:48.540064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:48.539875+0000","last_clean_scrub_stamp":"2024-02-16T10:32:48.539875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:22:16.085207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:01.598643+0000","last_change":"2024-02-16T10:33:01.598701+0000","last_active":"2024-02-16T10:33:01.598643+0000","last_peered":"2024-02-16T10:33:01.598643+0000","last_clean":"2024-02-16T10:33:01.598643+0000","last_became_active":"2024-02-16T10:30:26.085686+0000","last_became_peered":"2024-02-16T10:30:26.085686+0000","last_unstale":"2024-02-16T10:33:01.598643+0000","last_undegraded":"2024-02-16T10:33:01.598643+0000","last_fullsized":"2024-02-16T10:33:01.598643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:01.598443+0000","last_clean_scrub_stamp":"2024-02-16T10:33:01.598443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:35.785450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.000443+0000","last_change":"2024-02-16T10:32:56.000511+0000","last_active":"2024-02-16T10:32:56.000443+0000","last_peered":"2024-02-16T10:32:56.000443+0000","last_clean":"2024-02-16T10:32:56.000443+0000","last_became_active":"2024-02-16T10:30:28.066702+0000","last_became_peered":"2024-02-16T10:30:28.066702+0000","last_unstale":"2024-02-16T10:32:56.000443+0000","last_undegraded":"2024-02-16T10:32:56.000443+0000","last_fullsized":"2024-02-16T10:32:56.000443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:56.000250+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.000250+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T20:26:36.211245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:08.145997+0000","last_change":"2024-02-16T10:33:08.146092+0000","last_active":"2024-02-16T10:33:08.145997+0000","last_peered":"2024-02-16T10:33:08.145997+0000","last_clean":"2024-02-16T10:33:08.145997+0000","last_became_active":"2024-02-16T10:30:26.079805+0000","last_became_peered":"2024-02-16T10:30:26.079805+0000","last_unstale":"2024-02-16T10:33:08.145997+0000","last_undegraded":"2024-02-16T10:33:08.145997+0000","last_fullsized":"2024-02-16T10:33:08.145997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:08.145748+0000","last_clean_scrub_stamp":"2024-02-16T10:33:08.145748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:40:23.931103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:54.548252+0000","last_change":"2024-02-16T10:32:54.548318+0000","last_active":"2024-02-16T10:32:54.548252+0000","last_peered":"2024-02-16T10:32:54.548252+0000","last_clean":"2024-02-16T10:32:54.548252+0000","last_became_active":"2024-02-16T10:30:28.072653+0000","last_became_peered":"2024-02-16T10:30:28.072653+0000","last_unstale":"2024-02-16T10:32:54.548252+0000","last_undegraded":"2024-02-16T10:32:54.548252+0000","last_fullsized":"2024-02-16T10:32:54.548252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:54.548056+0000","last_clean_scrub_stamp":"2024-02-16T10:32:54.548056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:20.890776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:57.566223+0000","last_change":"2024-02-16T10:32:57.566279+0000","last_active":"2024-02-16T10:32:57.566223+0000","last_peered":"2024-02-16T10:32:57.566223+0000","last_clean":"2024-02-16T10:32:57.566223+0000","last_became_active":"2024-02-16T10:30:26.088064+0000","last_became_peered":"2024-02-16T10:30:26.088064+0000","last_unstale":"2024-02-16T10:32:57.566223+0000","last_undegraded":"2024-02-16T10:32:57.566223+0000","last_fullsized":"2024-02-16T10:32:57.566223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:57.566031+0000","last_clean_scrub_stamp":"2024-02-16T10:32:57.566031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:17:13.287403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.579220+0000","last_change":"2024-02-16T10:32:50.579281+0000","last_active":"2024-02-16T10:32:50.579220+0000","last_peered":"2024-02-16T10:32:50.579220+0000","last_clean":"2024-02-16T10:32:50.579220+0000","last_became_active":"2024-02-16T10:30:28.069535+0000","last_became_peered":"2024-02-16T10:30:28.069535+0000","last_unstale":"2024-02-16T10:32:50.579220+0000","last_undegraded":"2024-02-16T10:32:50.579220+0000","last_fullsized":"2024-02-16T10:32:50.579220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:50.579036+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.579036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:33:04.624348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:55.576029+0000","last_change":"2024-02-16T10:32:55.576097+0000","last_active":"2024-02-16T10:32:55.576029+0000","last_peered":"2024-02-16T10:32:55.576029+0000","last_clean":"2024-02-16T10:32:55.576029+0000","last_became_active":"2024-02-16T10:30:26.094497+0000","last_became_peered":"2024-02-16T10:30:26.094497+0000","last_unstale":"2024-02-16T10:32:55.576029+0000","last_undegraded":"2024-02-16T10:32:55.576029+0000","last_fullsized":"2024-02-16T10:32:55.576029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:55.575824+0000","last_clean_scrub_stamp":"2024-02-16T10:32:55.575824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:12:56.390001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:36.190748+0000","last_change":"2024-02-16T10:32:36.190802+0000","last_active":"2024-02-16T10:32:36.190748+0000","last_peered":"2024-02-16T10:32:36.190748+0000","last_clean":"2024-02-16T10:32:36.190748+0000","last_became_active":"2024-02-16T10:30:28.082358+0000","last_became_peered":"2024-02-16T10:30:28.082358+0000","last_unstale":"2024-02-16T10:32:36.190748+0000","last_undegraded":"2024-02-16T10:32:36.190748+0000","last_fullsized":"2024-02-16T10:32:36.190748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:36.190560+0000","last_clean_scrub_stamp":"2024-02-16T10:32:36.190560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:03:11.479999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.205255+0000","last_change":"2024-02-16T10:33:05.205325+0000","last_active":"2024-02-16T10:33:05.205255+0000","last_peered":"2024-02-16T10:33:05.205255+0000","last_clean":"2024-02-16T10:33:05.205255+0000","last_became_active":"2024-02-16T10:30:26.090359+0000","last_became_peered":"2024-02-16T10:30:26.090359+0000","last_unstale":"2024-02-16T10:33:05.205255+0000","last_undegraded":"2024-02-16T10:33:05.205255+0000","last_fullsized":"2024-02-16T10:33:05.205255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.205045+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.205045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:17:39.392051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:37.677808+0000","last_change":"2024-02-16T10:32:37.677881+0000","last_active":"2024-02-16T10:32:37.677808+0000","last_peered":"2024-02-16T10:32:37.677808+0000","last_clean":"2024-02-16T10:32:37.677808+0000","last_became_active":"2024-02-16T10:30:28.087837+0000","last_became_peered":"2024-02-16T10:30:28.087837+0000","last_unstale":"2024-02-16T10:32:37.677808+0000","last_undegraded":"2024-02-16T10:32:37.677808+0000","last_fullsized":"2024-02-16T10:32:37.677808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:37.677622+0000","last_clean_scrub_stamp":"2024-02-16T10:32:37.677622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:43.521167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.315982+0000","last_change":"2024-02-16T10:32:59.316060+0000","last_active":"2024-02-16T10:32:59.315982+0000","last_peered":"2024-02-16T10:32:59.315982+0000","last_clean":"2024-02-16T10:32:59.315982+0000","last_became_active":"2024-02-16T10:30:26.082385+0000","last_became_peered":"2024-02-16T10:30:26.082385+0000","last_unstale":"2024-02-16T10:32:59.315982+0000","last_undegraded":"2024-02-16T10:32:59.315982+0000","last_fullsized":"2024-02-16T10:32:59.315982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.315796+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.315796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:07.517582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:56.299862+0000","last_change":"2024-02-16T10:32:56.299931+0000","last_active":"2024-02-16T10:32:56.299862+0000","last_peered":"2024-02-16T10:32:56.299862+0000","last_clean":"2024-02-16T10:32:56.299862+0000","last_became_active":"2024-02-16T10:30:28.072607+0000","last_became_peered":"2024-02-16T10:30:28.072607+0000","last_unstale":"2024-02-16T10:32:56.299862+0000","last_undegraded":"2024-02-16T10:32:56.299862+0000","last_fullsized":"2024-02-16T10:32:56.299862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-02-16T10:32:56.299671+0000","last_clean_scrub_stamp":"2024-02-16T10:32:56.299671+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:36:59.215228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:05.641025+0000","last_change":"2024-02-16T10:33:05.641087+0000","last_active":"2024-02-16T10:33:05.641025+0000","last_peered":"2024-02-16T10:33:05.641025+0000","last_clean":"2024-02-16T10:33:05.641025+0000","last_became_active":"2024-02-16T10:30:26.086717+0000","last_became_peered":"2024-02-16T10:30:26.086717+0000","last_unstale":"2024-02-16T10:33:05.641025+0000","last_undegraded":"2024-02-16T10:33:05.641025+0000","last_fullsized":"2024-02-16T10:33:05.641025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:05.640833+0000","last_clean_scrub_stamp":"2024-02-16T10:33:05.640833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:36:20.797119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'16","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:41.246185+0000","last_change":"2024-02-16T10:32:41.246185+0000","last_active":"2024-02-16T10:32:41.246185+0000","last_peered":"2024-02-16T10:32:41.246185+0000","last_clean":"2024-02-16T10:32:41.246185+0000","last_became_active":"2024-02-16T10:30:28.077865+0000","last_became_peered":"2024-02-16T10:30:28.077865+0000","last_unstale":"2024-02-16T10:32:41.246185+0000","last_undegraded":"2024-02-16T10:32:41.246185+0000","last_fullsized":"2024-02-16T10:32:41.246185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-02-16T10:32:41.245938+0000","last_clean_scrub_stamp":"2024-02-16T10:32:41.245938+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:51:09.620425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":85,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:21.049562+0000","last_change":"2024-02-16T10:33:21.049628+0000","last_active":"2024-02-16T10:33:21.049562+0000","last_peered":"2024-02-16T10:33:21.049562+0000","last_clean":"2024-02-16T10:33:21.049562+0000","last_became_active":"2024-02-16T10:30:26.081725+0000","last_became_peered":"2024-02-16T10:30:26.081725+0000","last_unstale":"2024-02-16T10:33:21.049562+0000","last_undegraded":"2024-02-16T10:33:21.049562+0000","last_fullsized":"2024-02-16T10:33:21.049562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:21.049344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:21.049344+0000","last_clean_scrub_stamp":"2024-02-16T10:33:21.049344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:58:46.546048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:47.952981+0000","last_change":"2024-02-16T10:32:47.952981+0000","last_active":"2024-02-16T10:32:47.952981+0000","last_peered":"2024-02-16T10:32:47.952981+0000","last_clean":"2024-02-16T10:32:47.952981+0000","last_became_active":"2024-02-16T10:30:28.069354+0000","last_became_peered":"2024-02-16T10:30:28.069354+0000","last_unstale":"2024-02-16T10:32:47.952981+0000","last_undegraded":"2024-02-16T10:32:47.952981+0000","last_fullsized":"2024-02-16T10:32:47.952981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:47.952562+0000","last_clean_scrub_stamp":"2024-02-16T10:32:47.952562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:53:39.742244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.575826+0000","last_change":"2024-02-16T10:32:45.575891+0000","last_active":"2024-02-16T10:32:45.575826+0000","last_peered":"2024-02-16T10:32:45.575826+0000","last_clean":"2024-02-16T10:32:45.575826+0000","last_became_active":"2024-02-16T10:30:26.098411+0000","last_became_peered":"2024-02-16T10:30:26.098411+0000","last_unstale":"2024-02-16T10:32:45.575826+0000","last_undegraded":"2024-02-16T10:32:45.575826+0000","last_fullsized":"2024-02-16T10:32:45.575826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:45.575628+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.575628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T16:23:09.375444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:44.598992+0000","last_change":"2024-02-16T10:32:44.598992+0000","last_active":"2024-02-16T10:32:44.598992+0000","last_peered":"2024-02-16T10:32:44.598992+0000","last_clean":"2024-02-16T10:32:44.598992+0000","last_became_active":"2024-02-16T10:30:28.064631+0000","last_became_peered":"2024-02-16T10:30:28.064631+0000","last_unstale":"2024-02-16T10:32:44.598992+0000","last_undegraded":"2024-02-16T10:32:44.598992+0000","last_fullsized":"2024-02-16T10:32:44.598992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:32:44.598712+0000","last_clean_scrub_stamp":"2024-02-16T10:32:44.598712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:34:57.295017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:59.202881+0000","last_change":"2024-02-16T10:32:59.202949+0000","last_active":"2024-02-16T10:32:59.202881+0000","last_peered":"2024-02-16T10:32:59.202881+0000","last_clean":"2024-02-16T10:32:59.202881+0000","last_became_active":"2024-02-16T10:30:26.091464+0000","last_became_peered":"2024-02-16T10:30:26.091464+0000","last_unstale":"2024-02-16T10:32:59.202881+0000","last_undegraded":"2024-02-16T10:32:59.202881+0000","last_fullsized":"2024-02-16T10:32:59.202881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:59.202685+0000","last_clean_scrub_stamp":"2024-02-16T10:32:59.202685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:48:45.027138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:52.214931+0000","last_change":"2024-02-16T10:32:52.214993+0000","last_active":"2024-02-16T10:32:52.214931+0000","last_peered":"2024-02-16T10:32:52.214931+0000","last_clean":"2024-02-16T10:32:52.214931+0000","last_became_active":"2024-02-16T10:30:28.075166+0000","last_became_peered":"2024-02-16T10:30:28.075166+0000","last_unstale":"2024-02-16T10:32:52.214931+0000","last_undegraded":"2024-02-16T10:32:52.214931+0000","last_fullsized":"2024-02-16T10:32:52.214931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:52.214700+0000","last_clean_scrub_stamp":"2024-02-16T10:32:52.214700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T14:14:00.416486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:04.225619+0000","last_change":"2024-02-16T10:33:04.225678+0000","last_active":"2024-02-16T10:33:04.225619+0000","last_peered":"2024-02-16T10:33:04.225619+0000","last_clean":"2024-02-16T10:33:04.225619+0000","last_became_active":"2024-02-16T10:30:26.086353+0000","last_became_peered":"2024-02-16T10:30:26.086353+0000","last_unstale":"2024-02-16T10:33:04.225619+0000","last_undegraded":"2024-02-16T10:33:04.225619+0000","last_fullsized":"2024-02-16T10:33:04.225619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:04.225415+0000","last_clean_scrub_stamp":"2024-02-16T10:33:04.225415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:42:09.053096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:45.293261+0000","last_change":"2024-02-16T10:32:45.293261+0000","last_active":"2024-02-16T10:32:45.293261+0000","last_peered":"2024-02-16T10:32:45.293261+0000","last_clean":"2024-02-16T10:32:45.293261+0000","last_became_active":"2024-02-16T10:30:28.064401+0000","last_became_peered":"2024-02-16T10:30:28.064401+0000","last_unstale":"2024-02-16T10:32:45.293261+0000","last_undegraded":"2024-02-16T10:32:45.293261+0000","last_fullsized":"2024-02-16T10:32:45.293261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:45.293004+0000","last_clean_scrub_stamp":"2024-02-16T10:32:45.293004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:20:04.774717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:14.111853+0000","last_change":"2024-02-16T10:33:14.111920+0000","last_active":"2024-02-16T10:33:14.111853+0000","last_peered":"2024-02-16T10:33:14.111853+0000","last_clean":"2024-02-16T10:33:14.111853+0000","last_became_active":"2024-02-16T10:30:26.068375+0000","last_became_peered":"2024-02-16T10:30:26.068375+0000","last_unstale":"2024-02-16T10:33:14.111853+0000","last_undegraded":"2024-02-16T10:33:14.111853+0000","last_fullsized":"2024-02-16T10:33:14.111853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:14.111629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:14.111629+0000","last_clean_scrub_stamp":"2024-02-16T10:33:14.111629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:11:29.896314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'2","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:58.239268+0000","last_change":"2024-02-16T10:32:58.239330+0000","last_active":"2024-02-16T10:32:58.239268+0000","last_peered":"2024-02-16T10:32:58.239268+0000","last_clean":"2024-02-16T10:32:58.239268+0000","last_became_active":"2024-02-16T10:30:28.073071+0000","last_became_peered":"2024-02-16T10:30:28.073071+0000","last_unstale":"2024-02-16T10:32:58.239268+0000","last_undegraded":"2024-02-16T10:32:58.239268+0000","last_fullsized":"2024-02-16T10:32:58.239268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:58.239053+0000","last_clean_scrub_stamp":"2024-02-16T10:32:58.239053+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T15:01:24.581773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:22.033134+0000","last_change":"2024-02-16T10:33:22.033199+0000","last_active":"2024-02-16T10:33:22.033134+0000","last_peered":"2024-02-16T10:33:22.033134+0000","last_clean":"2024-02-16T10:33:22.033134+0000","last_became_active":"2024-02-16T10:30:26.067025+0000","last_became_peered":"2024-02-16T10:30:26.067025+0000","last_unstale":"2024-02-16T10:33:22.033134+0000","last_undegraded":"2024-02-16T10:33:22.033134+0000","last_fullsized":"2024-02-16T10:33:22.033134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:22.032918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:22.032918+0000","last_clean_scrub_stamp":"2024-02-16T10:33:22.032918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:34:29.482490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:25.834500+0000","last_change":"2024-02-16T10:32:25.834500+0000","last_active":"2024-02-16T10:32:25.834500+0000","last_peered":"2024-02-16T10:32:25.834500+0000","last_clean":"2024-02-16T10:32:25.834500+0000","last_became_active":"2024-02-16T10:30:28.086924+0000","last_became_peered":"2024-02-16T10:30:28.086924+0000","last_unstale":"2024-02-16T10:32:25.834500+0000","last_undegraded":"2024-02-16T10:32:25.834500+0000","last_fullsized":"2024-02-16T10:32:25.834500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:32:25.834247+0000","last_clean_scrub_stamp":"2024-02-16T10:32:25.834247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T18:36:24.022521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:49.284240+0000","last_change":"2024-02-16T10:32:49.284313+0000","last_active":"2024-02-16T10:32:49.284240+0000","last_peered":"2024-02-16T10:32:49.284240+0000","last_clean":"2024-02-16T10:32:49.284240+0000","last_became_active":"2024-02-16T10:30:26.083259+0000","last_became_peered":"2024-02-16T10:30:26.083259+0000","last_unstale":"2024-02-16T10:32:49.284240+0000","last_undegraded":"2024-02-16T10:32:49.284240+0000","last_fullsized":"2024-02-16T10:32:49.284240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:49.284010+0000","last_clean_scrub_stamp":"2024-02-16T10:32:49.284010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T19:25:24.829083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:50.208137+0000","last_change":"2024-02-16T10:32:50.208221+0000","last_active":"2024-02-16T10:32:50.208137+0000","last_peered":"2024-02-16T10:32:50.208137+0000","last_clean":"2024-02-16T10:32:50.208137+0000","last_became_active":"2024-02-16T10:30:28.072208+0000","last_became_peered":"2024-02-16T10:30:28.072208+0000","last_unstale":"2024-02-16T10:32:50.208137+0000","last_undegraded":"2024-02-16T10:32:50.208137+0000","last_fullsized":"2024-02-16T10:32:50.208137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-02-16T10:32:50.207953+0000","last_clean_scrub_stamp":"2024-02-16T10:32:50.207953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T13:17:47.225247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:18.108000+0000","last_change":"2024-02-16T10:33:18.108059+0000","last_active":"2024-02-16T10:33:18.108000+0000","last_peered":"2024-02-16T10:33:18.108000+0000","last_clean":"2024-02-16T10:33:18.108000+0000","last_became_active":"2024-02-16T10:30:26.068369+0000","last_became_peered":"2024-02-16T10:30:26.068369+0000","last_unstale":"2024-02-16T10:33:18.108000+0000","last_undegraded":"2024-02-16T10:33:18.108000+0000","last_fullsized":"2024-02-16T10:33:18.108000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:33:18.107832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:33:18.107832+0000","last_clean_scrub_stamp":"2024-02-16T10:33:18.107832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T11:29:14.091400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:07.177112+0000","last_change":"2024-02-16T10:33:07.177182+0000","last_active":"2024-02-16T10:33:07.177112+0000","last_peered":"2024-02-16T10:33:07.177112+0000","last_clean":"2024-02-16T10:33:07.177112+0000","last_became_active":"2024-02-16T10:30:26.081647+0000","last_became_peered":"2024-02-16T10:30:26.081647+0000","last_unstale":"2024-02-16T10:33:07.177112+0000","last_undegraded":"2024-02-16T10:33:07.177112+0000","last_fullsized":"2024-02-16T10:33:07.177112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-02-16T10:33:07.176913+0000","last_clean_scrub_stamp":"2024-02-16T10:33:07.176913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T17:18:41.892085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:39.631778+0000","last_change":"2024-02-16T10:32:39.631778+0000","last_active":"2024-02-16T10:32:39.631778+0000","last_peered":"2024-02-16T10:32:39.631778+0000","last_clean":"2024-02-16T10:32:39.631778+0000","last_became_active":"2024-02-16T10:30:28.087849+0000","last_became_peered":"2024-02-16T10:30:28.087849+0000","last_unstale":"2024-02-16T10:32:39.631778+0000","last_undegraded":"2024-02-16T10:32:39.631778+0000","last_fullsized":"2024-02-16T10:32:39.631778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:39.631520+0000","last_clean_scrub_stamp":"2024-02-16T10:32:39.631520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T22:18:00.127318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:32:43.564996+0000","last_change":"2024-02-16T10:32:43.564996+0000","last_active":"2024-02-16T10:32:43.564996+0000","last_peered":"2024-02-16T10:32:43.564996+0000","last_clean":"2024-02-16T10:32:43.564996+0000","last_became_active":"2024-02-16T10:30:26.097439+0000","last_became_peered":"2024-02-16T10:30:26.097439+0000","last_unstale":"2024-02-16T10:32:43.564996+0000","last_undegraded":"2024-02-16T10:32:43.564996+0000","last_fullsized":"2024-02-16T10:32:43.564996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-16T10:32:43.564745+0000","last_clean_scrub_stamp":"2024-02-16T10:32:43.564745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T21:24:47.346981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-16T10:33:15.165007+0000","last_change":"2024-02-16T10:33:15.165078+0000","last_active":"2024-02-16T10:33:15.165007+0000","last_peered":"2024-02-16T10:33:15.165007+0000","last_clean":"2024-02-16T10:33:15.165007+0000","last_became_active":"2024-02-16T10:31:06.936936+0000","last_became_peered":"2024-02-16T10:31:06.936936+0000","last_unstale":"2024-02-16T10:33:15.165007+0000","last_undegraded":"2024-02-16T10:33:15.165007+0000","last_fullsized":"2024-02-16T10:33:15.165007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-02-16T10:33:15.164794+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-02-16T10:33:15.164794+0000","last_clean_scrub_stamp":"2024-02-16T10:33:15.164794+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T12:22:57.912596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1676,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1418,"ondisk_log_size":1418,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1527,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":152703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.55700000000000005,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.60499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":1.268,"15min":1.268},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59699999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.74399999999999999,"5min":1.139,"15min":1.139},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41899999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.76700000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Feb 16 10:33:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.55200000000000005,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80400000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.53000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.78300000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69999999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":740656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86499999999999999,"15min":0.95299999999999996},"min":{"1min":0.54400000000000004,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82699999999999996,"5min":8.2560000000000002,"15min":8.2560000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.61399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.752,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.212,"15min":1.4950000000000001},"min":{"1min":0.44600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.752,"5min":24.481999999999999,"15min":24.481999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.78000000000000003,"5min":0.873,"15min":0.873},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.75900000000000001,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.74099999999999999,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":1.103,"15min":1.2949999999999999},"min":{"1min":0.52600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.81999999999999995,"5min":18.614999999999998,"15min":18.614999999999998},"last":0.67000000000000004}]}]},{"osd":1,"up_from":9,"seq":38654705713,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":741796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.56699999999999995,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.55600000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.77600000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.46200000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.74199999999999999,"5min":1.022,"15min":1.022},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Feb 16 10:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.48999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.55400000000000005,"5min":0.251,"15min":0.251},"max":{"1min":0.81299999999999994,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71399999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":150025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.60799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.66300000000000003},"min":{"1min":0.56200000000000006,"5min":0.378,"15min":0.378},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.74099999999999999}]},{"osd":2,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89900000000000002,"5min":1.115,"15min":1.115},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.59199999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Feb 16 10:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.61399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76000000000000001,"15min":0.75800000000000001},"min":{"1min":0.61599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95499999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-16T10:33:56.043 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-16T10:33:56.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df7c6d640 1 Processor -- start 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df7c6d640 1 -- start start 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df7c6d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2df0132850 0x7f2df0132c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df7c6d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df0070090 con 0x7f2df0133170 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df7c6d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df0070fa0 con 0x7f2df0132850 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2df0132850 0x7f2df0132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2df0132850 0x7f2df0132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55224/0 (socket says 172.21.15.107:55224) 2024-02-16T10:33:56.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 -- 172.21.15.107:0/1529016903 learned_addr learned my addr 172.21.15.107:0/1529016903 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:33:56.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5208640 1 --1- 172.21.15.107:0/1529016903 >> v1:172.21.15.107:6789/0 conn(0x7f2df0133170 0x7f2df006e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:59278/0 (socket says 172.21.15.107:59278) 2024-02-16T10:33:56.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 -- 172.21.15.107:0/1529016903 >> v1:172.21.15.107:6789/0 conn(0x7f2df0133170 legacy=0x7f2df006e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 -- 172.21.15.107:0/1529016903 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df006fb70 con 0x7f2df0132850 2024-02-16T10:33:56.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df5a09640 1 --2- 172.21.15.107:0/1529016903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0132850 0x7f2df0132c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0097f0 tx=0x7f2dec01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bc9ad595c26860 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:56.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df4a07640 1 -- 172.21.15.107:0/1529016903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0ab520 con 0x7f2df0132850 2024-02-16T10:33:56.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df4a07640 1 -- 172.21.15.107:0/1529016903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0ab680 con 0x7f2df0132850 2024-02-16T10:33:56.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.189+0000 7f2df4a07640 1 -- 172.21.15.107:0/1529016903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0ab940 con 0x7f2df0132850 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/1529016903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0132850 msgr2=0x7f2df0132c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/1529016903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0132850 0x7f2df0132c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0097f0 tx=0x7f2dec01c3d0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/1529016903 shutdown_connections 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/1529016903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0132850 0x7f2df0132c30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/1529016903 >> 172.21.15.107:0/1529016903 conn(0x7f2df0099cd0 msgr2=0x7f2df006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:56.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/1529016903 shutdown_connections 2024-02-16T10:33:56.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/1529016903 wait complete. 2024-02-16T10:33:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 Processor -- start 2024-02-16T10:33:56.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- start start 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0124850 con 0x7f2df0133170 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df5a09640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df5a09640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55234/0 (socket says 172.21.15.107:55234) 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df5a09640 1 -- 172.21.15.107:0/2312654449 learned_addr learned my addr 172.21.15.107:0/2312654449 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df5a09640 1 -- 172.21.15.107:0/2312654449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0094d0 con 0x7f2df0133170 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df5a09640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2dec01a060 tx=0x7f2dec01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0ab4f0 con 0x7f2df0133170 2024-02-16T10:33:56.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0b4600 con 0x7f2df0133170 2024-02-16T10:33:56.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df0116270 con 0x7f2df0133170 2024-02-16T10:33:56.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec0b48a0 con 0x7f2df0133170 2024-02-16T10:33:56.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.193+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df01237e0 con 0x7f2df0133170 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df0122b70 con 0x7f2df0133170 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 43535+0+0 (secure 0 0 0) 0x7f2dec0b4a00 con 0x7f2df0133170 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2de67fc640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 0x7f2dd4037ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f2dec0a8050 con 0x7f2df0133170 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2df5208640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 0x7f2dd4037ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-16T10:33:56.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.197+0000 7f2df5208640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 0x7f2dd4037ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000f70 tx=0x7f2de0007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-16T10:33:56.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.201+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2dec0aa350 con 0x7f2df0133170 2024-02-16T10:33:56.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.357+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2df0062980 con 0x7f2df0133170 2024-02-16T10:33:56.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.361+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2dec0c5b80 con 0x7f2df0133170 2024-02-16T10:33:56.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.361+0000 7f2de67fc640 1 -- 172.21.15.107:0/2312654449 <== mon.0 v2:172.21.15.107:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2dec0aa350 con 0x7f2df0133170 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 msgr2=0x7f2dd4037ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 0x7f2dd4037ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000f70 tx=0x7f2de0007a90 comp rx=0 tx=0).stop 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 msgr2=0x7f2df0121040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2dec01a060 tx=0x7f2dec01ac70 comp rx=0 tx=0).stop 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 shutdown_connections 2024-02-16T10:33:56.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.138:6824/2589059759,v1:172.21.15.138:6825/2589059759] conn(0x7f2dd4035a10 0x7f2dd4037ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 --2- 172.21.15.107:0/2312654449 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2df0133170 0x7f2df0121040 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-16T10:33:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 >> 172.21.15.107:0/2312654449 conn(0x7f2df0132850 msgr2=0x7f2df01335e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-16T10:33:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 shutdown_connections 2024-02-16T10:33:56.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-02-16T10:33:56.365+0000 7f2df7c6d640 1 -- 172.21.15.107:0/2312654449 wait complete. 2024-02-16T10:33:56.385 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-16T10:33:56.386 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-16T10:33:56.386 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-16T10:33:56.386 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.456 INFO:tasks.ceph.osd.0:Stopped 2024-02-16T10:33:56.457 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-16T10:33:56.457 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.538 INFO:tasks.ceph.osd.1:Stopped 2024-02-16T10:33:56.538 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-16T10:33:56.538 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.631 INFO:tasks.ceph.osd.2:Stopped 2024-02-16T10:33:56.631 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-16T10:33:56.631 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.723 INFO:tasks.ceph.osd.3:Stopped 2024-02-16T10:33:56.724 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-16T10:33:56.724 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-16T10:33:56.724 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.753 INFO:tasks.ceph.mgr.x:Stopped 2024-02-16T10:33:56.754 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-16T10:33:56.754 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-16T10:33:56.754 INFO:teuthology.orchestra.run:waiting for 300 2024-02-16T10:33:56.779 INFO:tasks.ceph.mon.a:Stopped 2024-02-16T10:33:56.779 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-16T10:33:56.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-02-16T10:33:56.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-02-16T10:33:56.838 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-16T10:33:57.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:33:57.028 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-16T10:33:57.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:33:57.233 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-16T10:33:57.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:33:57.427 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-16T10:33:57.586 INFO:tasks.ceph:Archiving mon data... 2024-02-16T10:33:57.587 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/data/mon.a.tgz 2024-02-16T10:33:57.587 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-02-16T10:33:57.593 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.dpnyU5fWt6 2024-02-16T10:33:57.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dpnyU5fWt6 2024-02-16T10:33:57.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.dpnyU5fWt6 2024-02-16T10:33:57.768 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.dpnyU5fWt6 is 241KB 2024-02-16T10:33:57.829 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.dpnyU5fWt6 2024-02-16T10:33:57.835 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-16T10:33:57.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T10:33:57.881 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-16T10:33:57.940 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T10:33:57.946 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-16T10:33:57.946 INFO:tasks.ceph:Archiving crash dumps... 2024-02-16T10:33:57.948 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi107/crash 2024-02-16T10:33:57.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T10:33:57.996 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi138/crash 2024-02-16T10:33:57.997 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-16T10:33:58.010 INFO:tasks.ceph:Compressing logs... 2024-02-16T10:33:58.010 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T10:33:58.041 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-16T10:33:58.060 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23495.log 2024-02-16T10:33:58.061 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23275.log 2024-02-16T10:33:58.061 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23385.log 2024-02-16T10:33:58.061 INFO:teuthology.orchestra.run.smithi107.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23495.log.gz 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24095.log 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23275.log.gz 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23587.log 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23385.log: /var/log/ceph/ceph-client.admin.24095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23861.log 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24095.log.gz 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23587.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-16T10:33:58.064 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23385.log.gz 2024-02-16T10:33:58.065 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23939.log 2024-02-16T10:33:58.065 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23587.log.gz 2024-02-16T10:33:58.065 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23861.log.gz 2024-02-16T10:33:58.065 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24017.log 2024-02-16T10:33:58.065 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23384.log 2024-02-16T10:33:58.069 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23598.log 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23939.log.gz 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23384.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24017.log.gz 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23249.log 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23384.log.gz 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23598.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23913.log 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23598.log.gz 2024-02-16T10:33:58.070 INFO:teuthology.orchestra.run.smithi107.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23249.log.gz 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23327.log 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23186.log 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23913.log.gz 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24147.log 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23327.log.gz 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24225.log 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose 86.3%/var/log/ceph/ceph-client.admin.24147.log: -- /var/log/ceph/ceph-client.admin.24069.log -- replaced with /var/log/ceph/ceph-client.admin.23186.log.gz 2024-02-16T10:33:58.071 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24147.log.gz 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23835.log 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23691.log 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24225.log.gz 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24069.log: /var/log/ceph/ceph-client.admin.23835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21546.log 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24069.log.gz 2024-02-16T10:33:58.072 INFO:teuthology.orchestra.run.smithi107.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23835.log.gz 2024-02-16T10:33:58.073 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23493.log 2024-02-16T10:33:58.073 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23691.log.gz 2024-02-16T10:33:58.073 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.21546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21588.log 2024-02-16T10:33:58.073 INFO:teuthology.orchestra.run.smithi107.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.21546.log.gz 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23493.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.21588.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23493.log.gz 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24121.log 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.21588.log.gz 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24199.log 2024-02-16T10:33:58.085 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.24121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23743.log 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24121.log.gz 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21475.log 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24199.log: /var/log/ceph/ceph-client.admin.23743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23483.log 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24199.log.gz 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23743.log.gz 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.21475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24043.log 2024-02-16T10:33:58.086 INFO:teuthology.orchestra.run.smithi107.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.21475.log.gz 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23483.log: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23353.log 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23483.log.gz 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23991.log 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23353.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24043.log.gz 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23353.log.gz 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23809.log 2024-02-16T10:33:58.087 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23991.log.gz 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23301.log 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23809.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20221.log 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23809.log.gz 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23494.log 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.tmp-client.admin.20221.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23301.log.gz 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23887.log 2024-02-16T10:33:58.088 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20221.log.gz 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23965.log 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23887.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23494.log.gz 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23783.log 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23887.log.gz 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23599.log 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24249.log 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23965.log.gz 2024-02-16T10:33:58.089 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23599.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23783.log.gz 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23591.log 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23599.log.gz 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23391.log 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24249.log.gz 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23390.log 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23591.log.gz 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24173.log 2024-02-16T10:33:58.090 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23390.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23391.log.gz 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23717.log 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23390.log.gz 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.24173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23224.log 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24173.log.gz 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.23717.log: /var/log/ceph/ceph-client.admin.23224.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23717.log.gz 2024-02-16T10:33:58.091 INFO:teuthology.orchestra.run.smithi107.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23224.log.gz 2024-02-16T10:33:58.104 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71974.log 2024-02-16T10:33:58.104 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-02-16T10:33:58.104 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.71974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66074.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70794.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40114.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71974.log.gz 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.66074.log: /var/log/ceph/ceph-client.0.70794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46014.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.40114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23748.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79024.log 2024-02-16T10:33:58.105 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40114.log.gz 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.46014.log: /var/log/ceph/ceph-client.admin.23748.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.70794.log.gz 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48374.log 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.23748.log.gz 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.79024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53684.log 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.48374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59584.log 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr: 90.8% 92.0% -- replaced with /var/log/ceph/ceph-client.0.66074.log.gz 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.79024.log.gz 2024-02-16T10:33:58.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.53684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50144.log 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46014.log.gz 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.59584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55454.log 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60764.log 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.50144.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48374.log.gz 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.55454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46604.log 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53684.log.gz 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr:gzip/var/log/ceph/ceph-client.0.60764.log: -5 --verbose -- /var/log/ceph/ceph-client.0.33034.log 2024-02-16T10:33:58.107 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59584.log.gz 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.46604.log: /var/log/ceph/ceph-client.0.33034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79608.log 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.50144.log.gz 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76104.log 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.55454.log.gz 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.79608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73744.log 2024-02-16T10:33:58.108 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.33034.log.gz 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.76104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71384.log 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.46604.log.gz 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.79608.log.gz 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.76104.log.gz 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.73744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62534.log 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.60764.log.gz 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.71384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67254.log 2024-02-16T10:33:58.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.62534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60174.log 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.67254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69614.log 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73744.log.gz 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.60174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77272.log 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71384.log.gz 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.69614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57814.log 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3%/var/log/ceph/ceph-client.0.77272.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67254.log.gz 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.62534.log.gz 2024-02-16T10:33:58.110 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73154.log 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67844.log 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.57814.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77272.log.gz 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.73154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49554.log 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69614.log.gz 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.67844.log: 92.9% -- replaced with /var/log/ceph/ceph-client.0.60174.log.gz 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42474.log 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.49554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56044.log 2024-02-16T10:33:58.111 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.57814.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.42474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28227.log 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.56044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72564.log 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67844.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28227.log: 91.8% 91.3% -- replaced with /var/log/ceph/ceph-client.0.49554.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.73154.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.42474.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28227.log.gz 2024-02-16T10:33:58.112 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69024.log 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.72564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37754.log 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.69024.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56044.log.gz 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51324.log 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52504.log 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.51324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44244.log 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69024.log.gz 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72564.log.gz 2024-02-16T10:33:58.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.52504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76688.log 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.44244.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64304.log 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37754.log.gz 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51324.log.gz 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.76688.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52504.log.gz 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44244.log.gz 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.76688.log.gz 2024-02-16T10:33:58.114 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74924.log 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.64304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45424.log 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.74924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68434.log 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.45424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28179.log 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.68434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47194.log 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64304.log.gz 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28179.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45424.log.gz 2024-02-16T10:33:58.115 INFO:teuthology.orchestra.run.smithi138.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28179.log.gz 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68434.log.gz 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.28910.log 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.74924.log.gz 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80195.log 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.47194.log: /var/log/ceph/ceph-client.0.28910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31860.log 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.80195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35984.log 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.31860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50734.log 2024-02-16T10:33:58.116 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.47194.log.gz 2024-02-16T10:33:58.117 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35984.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.31860.log.gz 2024-02-16T10:33:58.117 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.28910.log.gz 2024-02-16T10:33:58.117 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-16T10:33:58.134 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.50734.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.35984.log.gz 2024-02-16T10:33:58.134 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61354.log 2024-02-16T10:33:58.134 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32444.log 2024-02-16T10:33:58.134 INFO:teuthology.orchestra.run.smithi138.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.80195.log.gz 2024-02-16T10:33:58.134 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23820.log 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.61354.log: /var/log/ceph/ceph-client.0.32444.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.50734.log.gz 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.32444.log.gz 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61354.log.gz 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48964.log 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.23820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61944.log 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23820.log.gz 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.48964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23772.log 2024-02-16T10:33:58.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.61944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64894.log 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.23772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77856.log 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23772.log.gz/var/log/ceph/ceph-client.0.64894.log: 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48964.log.gz 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.77856.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.61944.log.gz 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77856.log.gz 2024-02-16T10:33:58.136 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63714.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64894.log.gz 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47784.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.63714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51914.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.47784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70204.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.51914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28251.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.70204.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47784.log.gz 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% 91.7% -- replaced with /var/log/ceph/ceph-client.0.51914.log.gz 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57224.log 2024-02-16T10:33:58.137 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.63714.log.gz 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34214.log 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70204.log.gz 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28251.log.gz 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.57224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29500.log 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37164.log 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.29500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58994.log 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37164.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57224.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.34214.log.gz 2024-02-16T10:33:58.138 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34804.log 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29500.log.gz 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.58994.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37164.log.gz 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78440.log 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35394.log 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.78440.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35394.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78440.log.gz 2024-02-16T10:33:58.139 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% 91.7% -- replaced with /var/log/ceph/ceph-client.0.34804.log.gz 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.58994.log.gz 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35394.log.gz 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74334.log 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44834.log 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr: 90.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.74334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39524.log 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.44834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28155.log 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75514.log 2024-02-16T10:33:58.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28155.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74334.log.gz 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28155.log.gz 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.44834.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.36574.log 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.75514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53094.log 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39524.log.gz 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56634.log 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.53094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58404.log 2024-02-16T10:33:58.141 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75514.log.gz 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30090.log 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.56634.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36574.log.gz 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.58404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41294.log 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.30090.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53094.log.gz 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.58404.log.gz 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56634.log.gz 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63124.log 2024-02-16T10:33:58.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.41294.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38344.log 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.30090.log.gz 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.63124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31270.log 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40704.log 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.38344.log: /var/log/ceph/ceph-client.0.31270.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41294.log.gz 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63124.log.gz 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38344.log.gz 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28203.log 2024-02-16T10:33:58.143 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31270.log.gz 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.40704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65484.log 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33624.log 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28203.log.gz/var/log/ceph/ceph-client.0.65484.log: 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66664.log 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23796.log 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.40704.log.gz 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.33624.log: /var/log/ceph/ceph-client.0.66664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43064.log 2024-02-16T10:33:58.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.23796.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.65484.log.gz 2024-02-16T10:33:58.145 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.23796.log.gz 2024-02-16T10:33:58.145 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43654.log 2024-02-16T10:33:58.148 INFO:teuthology.orchestra.run.smithi138.stderr: 92.0% 91.6% -- replaced with /var/log/ceph/ceph-client.0.33624.log.gz 2024-02-16T10:33:58.148 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.43064.log: -- replaced with /var/log/ceph/ceph-client.0.66664.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.30680.log 2024-02-16T10:33:58.148 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.43654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54274.log 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38934.log 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.30680.log: /var/log/ceph/ceph-client.0.54274.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43064.log.gz 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43654.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.54864.log 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.38934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41884.log 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr: 91.5%/var/log/ceph/ceph-client.0.54864.log: -- replaced with /var/log/ceph/ceph-client.0.54274.log.gz 2024-02-16T10:33:58.149 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.30680.log.gz 2024-02-16T10:33:58.150 INFO:teuthology.orchestra.run.smithi138.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38934.log.gz 2024-02-16T10:33:58.150 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.41884.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54864.log.gz 2024-02-16T10:33:58.150 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41884.log.gz 2024-02-16T10:33:58.155 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-16T10:33:58.221 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-16T10:33:58.822 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-16T10:33:58.849 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-16T10:33:58.849 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-02-16T10:33:58.850 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m0.807s 2024-02-16T10:33:58.850 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m0.971s 2024-02-16T10:33:58.850 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.051s 2024-02-16T10:33:58.961 INFO:teuthology.orchestra.run.smithi138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-16T10:33:58.981 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-16T10:33:58.983 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-16T10:33:58.984 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m0.927s 2024-02-16T10:33:58.984 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m2.677s 2024-02-16T10:33:58.984 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.130s 2024-02-16T10:33:58.984 INFO:tasks.ceph:Archiving logs... 2024-02-16T10:33:58.985 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi107/log 2024-02-16T10:33:58.986 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T10:33:59.180 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi138/log 2024-02-16T10:33:59.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-16T10:33:59.603 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-16T10:33:59.615 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-16T10:33:59.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T10:33:59.618 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-16T10:33:59.684 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-16T10:33:59.694 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-16T10:33:59.694 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:33:59.697 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-16T10:33:59.706 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:33:59.707 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-02-16T10:33:59.707 INFO:teuthology.orchestra.run.smithi107.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 77 0.076 -0.141 0.846 2024-02-16T10:33:59.707 INFO:teuthology.orchestra.run.smithi107.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 77 0.093 +1.430 0.758 2024-02-16T10:33:59.707 INFO:teuthology.orchestra.run.smithi107.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 77 0.131 -2.360 0.780 2024-02-16T10:33:59.707 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:33:59.708 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-02-16T10:33:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-02-16T10:33:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 77 0.076 +0.964 1.502 2024-02-16T10:33:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 40 64 77 0.074 +1.314 1.164 2024-02-16T10:33:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 77 0.094 -1.273 1.521 2024-02-16T10:33:59.709 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-16T10:33:59.710 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-16T10:33:59.720 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-16T10:33:59.721 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-16T10:33:59.729 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-16T10:33:59.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-16T10:33:59.748 INFO:teuthology.task.internal:Duration was 800.116817 seconds 2024-02-16T10:33:59.748 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-16T10:33:59.757 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-16T10:33:59.757 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T10:33:59.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-16T10:33:59.795 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-16T10:33:59.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-02-16T10:33:59.796 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T10:33:59.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-02-16T10:33:59.845 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-16T10:33:59.854 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-16T10:33:59.855 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T10:33:59.889 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-16T10:33:59.923 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-16T10:33:59.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T10:33:59.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-16T10:34:00.020 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-16T10:34:00.030 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-16T10:34:00.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T10:34:00.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-16T10:34:00.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-16T10:34:00.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:34:00.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:34:00.095 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-02-16T10:34:00.101 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-02-16T10:34:00.197 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:34:00.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:34:00.243 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-16T10:34:00.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-16T10:34:00.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-16T10:34:00.260 INFO:teuthology.task.internal:Transferring archived files... 2024-02-16T10:34:00.261 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi107 2024-02-16T10:34:00.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T10:34:00.307 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795/remote/smithi138 2024-02-16T10:34:00.307 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-16T10:34:00.328 INFO:teuthology.task.internal:Removing archive directory... 2024-02-16T10:34:00.328 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T10:34:00.348 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-16T10:34:00.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-16T10:34:00.384 INFO:teuthology.task.internal:Not uploading archives. 2024-02-16T10:34:00.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-16T10:34:00.505 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-16T10:34:00.505 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T10:34:00.508 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-16T10:34:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 10:34 /home/ubuntu/cephtest 2024-02-16T10:34:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 16 10:34 /home/ubuntu/cephtest 2024-02-16T10:34:00.514 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-16T10:34:00.525 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-16T10:34:00.545 INFO:teuthology.nuke:Checking targets against current locks 2024-02-16T10:34:00.571 DEBUG:teuthology.nuke:shortname: smithi107 2024-02-16T10:34:00.571 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:34:00.596 DEBUG:teuthology.nuke:shortname: smithi138 2024-02-16T10:34:00.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-16T10:34:00.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:11:54.941610', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBC6nXrM+OlF3aafwpMNs7Np4TJA+QMDswYRDat8a0+w4BFAI9SznJ3h29y3218fB+v5492vJ1qXn0H+yJ3oVI='} 2024-02-16T10:34:00.619 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-02-15_21:52:48-rgw-wip-cbodley-testing-distro-default-smithi/7561795', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-16 10:11:54.939710', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGzAcIUZ/qYTjP43Vy5kCT9OIQgki1Lv8KAzjb4Esofbb4K6FvArPg0VhO0gPDA6beK9BzhqGY4WJqswewmN6Wg='} 2024-02-16T10:34:00.651 INFO:teuthology.orchestra.console.smithi107:Power off 2024-02-16T10:34:00.651 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T10:34:00.677 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-02-16T10:34:00.677 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:00.700 INFO:teuthology.orchestra.console.smithi138:Power off 2024-02-16T10:34:00.701 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T10:34:00.713 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-16T10:34:00.725 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-02-16T10:34:00.725 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:00.751 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-16T10:34:04.714 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:04.752 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:04.828 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-02-16T10:34:04.867 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-16T10:34:08.830 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:08.868 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T10:34:08.944 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-02-16T10:34:08.981 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-02-16T10:34:09.046 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-02-16T10:34:09.082 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-02-16T10:34:09.187 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 800.1168172359467 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx000003ded8e9e76a71822-0065cf39a2-4227-default4227-default-default' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2fe278560e52440eaf78739548c05c4b status: fail success: false 2024-02-16T10:34:09.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T10:34:09.267 INFO:teuthology.run:FAIL